2018-04-07 18:56:24,115 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-apex-baremetal-daily-master-110 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-odl-bgpvpn-ha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod1 | +--------------------------------------+----------------------------------------------------------+ 2018-04-07 18:56:24,117 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Clear any old environment that may conflict. for key in $( set | awk '{FS="="} /^OS_/ {print $1}' ); do unset $key ; done export OS_USERNAME=admin export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_BAREMETAL_API_VERSION=1.34 export NOVA_VERSION=1.1 export OS_PROJECT_NAME=admin export OS_PASSWORD=wCjXvd9xErUHZxR7ZmGsHVpnc export OS_NO_CACHE=True export COMPUTE_API_VERSION=1.1 export no_proxy=,172.30.9.22,192.30.9.6 export OS_VOLUME_API_VERSION=3 export OS_CLOUDNAME=overcloud export OS_AUTH_URL=http://172.30.9.22:5000/v3 export IRONIC_API_VERSION=1.34 export OS_IDENTITY_API_VERSION=3 export OS_IMAGE_API_VERSION=2 export OS_AUTH_TYPE=password export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available" # Add OS_CLOUDNAME to PS1 if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then export PS1=${PS1:-""} export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1 export CLOUDPROMPT_ENABLED=1 fi export SDN_CONTROLLER_IP=192.30.9.6 export OS_REGION_NAME=regionOne 2018-04-07 18:56:24,117 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-04-07 18:56:24,118 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------------+---------------+-------------------------------------------+-------------------------------------------------+------------------------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------------+---------------+-------------------------------------------+-------------------------------------------------+------------------------------------+ | healthcheck | 0 | (merge)|(verify)|(daily)|(weekly) | First tier to be executed to verify the | connection_check api_check | | | | | basic operations in the VIM. | snaps_health_check | +---------------------+---------------+-------------------------------------------+-------------------------------------------------+------------------------------------+ 2018-04-07 18:56:24,118 - xtesting.ci.run_tests - INFO - Running tier 'healthcheck' 2018-04-07 18:56:24,118 - xtesting.ci.run_tests - INFO - Running test case 'connection_check'... 2018-04-07 18:56:26,964 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-04-07 18:56:37,597 - xtesting.core.unit - DEBUG - test_glance_connect_fail (snaps.openstack.utils.tests.glance_utils_tests.GlanceSmokeTests) ... ok test_glance_connect_success (snaps.openstack.utils.tests.glance_utils_tests.GlanceSmokeTests) ... ok test_keystone_connect_fail (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneSmokeTests) ... ok test_keystone_connect_success (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneSmokeTests) ... ok test_neutron_connect_fail (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_neutron_connect_success (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_retrieve_ext_network_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_nova_connect_fail (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_nova_connect_success (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_nova_get_hypervisor_hosts (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_heat_connect_fail (snaps.openstack.utils.tests.heat_utils_tests.HeatSmokeTests) ... ok test_heat_connect_success (snaps.openstack.utils.tests.heat_utils_tests.HeatSmokeTests) ... ok test_cinder_connect_fail (snaps.openstack.utils.tests.cinder_utils_tests.CinderSmokeTests) ... ok test_cinder_connect_success (snaps.openstack.utils.tests.cinder_utils_tests.CinderSmokeTests) ... ok ---------------------------------------------------------------------- Ran 14 tests in 10.622s OK 2018-04-07 18:56:37,731 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-07 18:56:37,731 - xtesting.ci.run_tests - INFO - Test result: +--------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------------+------------------+------------------+----------------+ | connection_check | functest | 00:11 | PASS | +--------------------------+------------------+------------------+----------------+ 2018-04-07 18:56:37,735 - xtesting.ci.run_tests - INFO - Running test case 'api_check'... 2018-04-07 18:56:38,660 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-04-07 19:09:43,778 - xtesting.core.unit - DEBUG - test_create_project_minimal (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_create_user_minimal (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_fail_without_proper_credentials (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_fail_without_proper_service (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_success (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_with_each_interface (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_grant_user_role_to_project (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_create_admin_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_delete_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_user_2x (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_delete_project (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_2x (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_bad_domain (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_quota_override (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_update_quotas (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_sec_grp_one_user (snaps.openstack.tests.create_project_tests.CreateProjectUserTests) ... ok test_create_project_sec_grp_two_users (snaps.openstack.tests.create_project_tests.CreateProjectUserTests) ... ok test_create_image_minimal_file (snaps.openstack.utils.tests.glance_utils_tests.GlanceUtilsTests) ... ok test_create_image_minimal_url (snaps.openstack.utils.tests.glance_utils_tests.GlanceUtilsTests) ... ok test_create_network (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_network_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_network_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_empty_cidr (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_null_cidr (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_add_interface_router (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_missing_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_null_router (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_null_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_invalid_ip (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_invalid_ip_to_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_ip (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_network_object (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_router_simple (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_router_with_public_interface (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_delete_simple_sec_grp (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_no_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_no_rules (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_one_rule (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_get_sec_grp_by_id (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_floating_ips (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsFloatingIpTests) ... ok test_create_delete_keypair (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_key_from_file (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_keypair (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_delete_flavor (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsFlavorTests) ... ok test_create_flavor (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsFlavorTests) ... ok test_create_instance (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceTests) ... ok test_add_remove_volume (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_attach_volume_nowait (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_detach_volume_nowait (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_create_clean_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_delete_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor_all_settings (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor_existing (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateSimpleStackTests) ... ok test_create_stack_x2 (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateSimpleStackTests) ... ok test_get_settings_from_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateComplexStackTests) ... ok test_create_flavor_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsFlavorTests) ... ok test_create_keypair_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsKeypairTests) ... ok test_create_security_group_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsSecurityGroupTests) ... ok test_create_delete_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_back (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_both (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_front (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_delete_volume (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTests) ... ok test_create_simple_volume (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTests) ... ok test_create_delete_volume_type (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsSimpleVolumeTypeTests) ... ok test_create_simple_volume_type (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsSimpleVolumeTypeTests) ... ok test_create_bad_key_size (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_delete_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_simple_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_with_all_attrs (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_with_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_invalid_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_qos_and_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok ---------------------------------------------------------------------- Ran 84 tests in 785.064s OK 2018-04-07 19:09:43,915 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-07 19:09:43,916 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | api_check | functest | 13:05 | PASS | +-------------------+------------------+------------------+----------------+ 2018-04-07 19:09:43,920 - xtesting.ci.run_tests - INFO - Running test case 'snaps_health_check'... 2018-04-07 19:09:44,852 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-04-07 19:10:26,929 - xtesting.core.unit - DEBUG - test_check_vm_ip_dhcp (snaps.openstack.tests.create_instance_tests.SimpleHealthCheck) ... ok ---------------------------------------------------------------------- Ran 1 test in 42.076s OK 2018-04-07 19:10:27,048 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-07 19:10:27,048 - xtesting.ci.run_tests - INFO - Test result: +----------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +----------------------------+------------------+------------------+----------------+ | snaps_health_check | functest | 00:42 | PASS | +----------------------------+------------------+------------------+----------------+ 2018-04-07 19:10:27,052 - xtesting.ci.run_tests - INFO - Xtesting report: +----------------------------+------------------+---------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +----------------------------+------------------+---------------------+------------------+----------------+ | connection_check | functest | healthcheck | 00:11 | PASS | | api_check | functest | healthcheck | 13:05 | PASS | | snaps_health_check | functest | healthcheck | 00:42 | PASS | +----------------------------+------------------+---------------------+------------------+----------------+ 2018-04-07 19:10:27,055 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK 2018-04-07 19:10:29,696 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-apex-baremetal-daily-master-110 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-odl-bgpvpn-ha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod1 | +--------------------------------------+----------------------------------------------------------+ 2018-04-07 19:10:29,700 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Clear any old environment that may conflict. for key in $( set | awk '{FS="="} /^OS_/ {print $1}' ); do unset $key ; done export OS_USERNAME=admin export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_BAREMETAL_API_VERSION=1.34 export NOVA_VERSION=1.1 export OS_PROJECT_NAME=admin export OS_PASSWORD=wCjXvd9xErUHZxR7ZmGsHVpnc export OS_NO_CACHE=True export COMPUTE_API_VERSION=1.1 export no_proxy=,172.30.9.22,192.30.9.6 export OS_VOLUME_API_VERSION=3 export OS_CLOUDNAME=overcloud export OS_AUTH_URL=http://172.30.9.22:5000/v3 export IRONIC_API_VERSION=1.34 export OS_IDENTITY_API_VERSION=3 export OS_IMAGE_API_VERSION=2 export OS_AUTH_TYPE=password export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available" # Add OS_CLOUDNAME to PS1 if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then export PS1=${PS1:-""} export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1 export CLOUDPROMPT_ENABLED=1 fi export SDN_CONTROLLER_IP=192.30.9.6 export OS_REGION_NAME=regionOne 2018-04-07 19:10:29,700 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-04-07 19:10:29,701 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------+---------------+--------------------------+------------------------------------------+-----------------------------------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------+---------------+--------------------------+------------------------------------------+-----------------------------------------------+ | smoke | 1 | (daily)|(weekly) | Set of basic Functional tests to | vping_userdata tempest_smoke_serial | | | | | validate the OPNFV scenarios. | rally_sanity refstack_defcore patrole | | | | | | odl snaps_smoke neutron_trunk | +---------------+---------------+--------------------------+------------------------------------------+-----------------------------------------------+ 2018-04-07 19:10:29,703 - xtesting.ci.run_tests - INFO - Running tier 'smoke' 2018-04-07 19:10:29,703 - xtesting.ci.run_tests - INFO - Running test case 'vping_userdata'... 2018-04-07 19:10:30,229 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin virtual environment setup 2018-04-07 19:10:30,229 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing Start Time:'2018-04-07 19:10:30' 2018-04-07 19:10:30,229 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating image with name: 'functest-vping--28a378b8-697a-4690-9637-b36727c0c544' 2018-04-07 19:10:33,960 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating network with name: 'vping-net-28a378b8-697a-4690-9637-b36727c0c544' 2018-04-07 19:10:37,231 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating router with name: 'vping-router-28a378b8-697a-4690-9637-b36727c0c544' 2018-04-07 19:10:47,726 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating flavor with name: 'vping-flavor-28a378b8-697a-4690-9637-b36727c0c544' 2018-04-07 19:10:48,557 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 1 instance with name: 'opnfv-vping-1-28a378b8-697a-4690-9637-b36727c0c544' 2018-04-07 19:10:55,252 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 2 instance with name: 'opnfv-vping-2-28a378b8-697a-4690-9637-b36727c0c544' 2018-04-07 19:11:02,726 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin test execution 2018-04-07 19:11:13,360 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Waiting for ping... 2018-04-07 19:11:16,020 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing detected! 2018-04-07 19:11:16,135 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-07 19:11:16,135 - xtesting.ci.run_tests - INFO - Test result: +------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +------------------------+------------------+------------------+----------------+ | vping_userdata | functest | 00:46 | PASS | +------------------------+------------------+------------------+----------------+ 2018-04-07 19:11:35,634 - xtesting.ci.run_tests - INFO - Running test case 'tempest_smoke_serial'... 2018-04-07 19:11:35,734 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-04-07 19:11:40,321 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-04-07 19:11:40.034 14 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=ddd6c6c2-3735-4385-a76e-f770b0334bd1) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | ddd6c6c2-3735-4385-a76e-f770b0334bd1 | 2018-04-07T19:11:39 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: ddd6c6c2-3735-4385-a76e-f770b0334bd1 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-04-07 19:11:43,719 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | key-manager | Available | | __unknown__ | placement | Available | | __unknown__ | policy | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+----------------+-----------+ 2018-04-07 19:11:43,720 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-04-07 19:11:49,093 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide 2018-04-07 19:11:47.740 23 INFO rally.api [-] Creating verifier 'opnfv-tempest'. 2018-04-07 19:11:47.896 23 INFO rally.verification.manager [-] Cloning verifier repo from /src/tempest. 2018-04-07 19:11:48.895 23 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=e79780f8-f5e1-45ef-aaac-6e53c64d6a04) has been successfully created! Using verifier 'opnfv-tempest' (UUID=e79780f8-f5e1-45ef-aaac-6e53c64d6a04) as the default verifier for the future CLI operations. 2018-04-07 19:11:52,012 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-04-07 19:11:54,704 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating two images for Tempest suite 2018-04-07 19:12:01,462 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-04-07 19:12:06,663 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-04-07 19:12:05.641 42 INFO rally.api [-] Configuring verifier 'opnfv-tempest' (UUID=e79780f8-f5e1-45ef-aaac-6e53c64d6a04) for deployment 'opnfv-rally' (UUID=ddd6c6c2-3735-4385-a76e-f770b0334bd1). 2018-04-07 19:12:06.510 42 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=e79780f8-f5e1-45ef-aaac-6e53c64d6a04) has been successfully configured for deployment 'opnfv-rally' (UUID=ddd6c6c2-3735-4385-a76e-f770b0334bd1)! 2018-04-07 19:12:06,663 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-04-07 19:12:06,664 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-04-07 19:12:06,666 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-04-07 19:12:06,669 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Generating test case list... 2018-04-07 19:12:09,746 - functest.opnfv_tests.openstack.tempest.tempest - INFO - (cd /root/.rally/verification/verifier-e79780f8-f5e1-45ef-aaac-6e53c64d6a04/repo; testr list-tests '^tempest\.(api|scenario).*\[.*\bsmoke\b.*\]$' >/home/opnfv/functest/results/tempest/test_list.txt 2>/dev/null) 2018-04-07 19:12:09,746 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Applying tempest blacklist... 2018-04-07 19:12:09,748 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Tempest blacklist file does not exist. 2018-04-07 19:12:09,748 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', u'/home/opnfv/functest/results/tempest/test_list.txt', '--concurrency', '1']'. 2018-04-07 19:12:11,937 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:12:11.936 51 INFO rally.api [-] Starting verification (UUID=0c03c7d5-d5e6-491c-a015-6e91e16057e7) for deployment 'opnfv-rally' (UUID=ddd6c6c2-3735-4385-a76e-f770b0334bd1) by verifier 'opnfv-tempest' (UUID=e79780f8-f5e1-45ef-aaac-6e53c64d6a04). 2018-04-07 19:12:11,937 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Verification UUID: 0c03c7d5-d5e6-491c-a015-6e91e16057e7 2018-04-07 19:12:19,498 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:12:19.497 51 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor ... success [0.177s] 2018-04-07 19:12:19,552 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:12:19.552 51 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.055s] 2018-04-07 19:12:26,601 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:12:26.600 51 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create ... success [1.680s] 2018-04-07 19:12:30,350 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:12:30.349 51 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list ... success [3.748s] 2018-04-07 19:12:43,883 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:12:43.882 51 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete ... success [6.492s] 2018-04-07 19:13:01,001 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:13:01.000 51 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip ... success [10.164s] 2018-04-07 19:13:37,664 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:13:37.663 51 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_list_servers ... success [0.066s] 2018-04-07 19:13:37,665 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:13:37.665 51 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_verify_server_details ... success [0.001s] 2018-04-07 19:14:09,625 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:14:09.625 51 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers ... success [0.074s] 2018-04-07 19:14:09,626 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:14:09.626 51 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details ... success [0.001s] 2018-04-07 19:14:38,924 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:14:38.923 51 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers ... success [0.067s] 2018-04-07 19:14:38,926 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:14:38.926 51 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details ... success [0.001s] 2018-04-07 19:15:21,164 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:15:21.164 51 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard ... success [13.340s] 2018-04-07 19:15:43,297 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:15:43.297 51 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses ... success [0.051s] 2018-04-07 19:15:43,407 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:15:43.407 51 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network ... success [0.110s] 2018-04-07 19:15:52,184 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:15:52.184 51 INFO opnfv-tempest [-] {0} tempest.api.compute.test_versions.TestVersions.test_get_version_details ... success [0.670s] 2018-04-07 19:15:52,194 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:15:52.193 51 INFO opnfv-tempest [-] {0} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.010s] 2018-04-07 19:15:53,779 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:15:53.778 51 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v2.test_services.ServicesTestJSON ... skip: Identity api v2 is not enabled 2018-04-07 19:15:53,780 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:15:53.780 51 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v2.test_users.UsersTestJSON ... skip: Identity api v2 is not enabled 2018-04-07 19:15:57,809 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:15:57.809 51 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete ... success [0.381s] 2018-04-07 19:16:04,433 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:16:04.433 51 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists ... success [0.085s] 2018-04-07 19:16:11,023 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:16:11.023 51 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain ... success [0.636s] 2018-04-07 19:16:18,803 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:16:18.803 51 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint ... success [0.441s] 2018-04-07 19:16:28,417 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:16:28.416 51 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete ... success [3.309s] 2018-04-07 19:16:34,673 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:16:34.673 51 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy ... success [0.371s] 2018-04-07 19:16:40,676 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:16:40.675 51 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id ... success [0.229s] 2018-04-07 19:16:47,830 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:16:47.829 51 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_show_list ... success [0.461s] 2018-04-07 19:16:55,511 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:16:55.511 51 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service ... success [0.471s] 2018-04-07 19:17:04,097 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:17:04.096 51 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all ... success [2.831s] 2018-04-07 19:17:07,071 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:17:07.071 51 INFO opnfv-tempest [-] {0} tempest.api.identity.v2.test_api_discovery.TestApiDiscovery ... skip: Identity api v2 is not enabled 2018-04-07 19:17:09,043 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:17:09.042 51 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.076s] 2018-04-07 19:17:09,121 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:17:09.121 51 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.077s] 2018-04-07 19:17:09,197 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:17:09.197 51 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.075s] 2018-04-07 19:17:09,203 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:17:09.203 51 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_list_api_versions ... success [0.007s] 2018-04-07 19:17:13,435 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:17:13.435 51 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [0.773s] 2018-04-07 19:17:15,234 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:17:15.234 51 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file ... success [1.798s] 2018-04-07 19:17:17,289 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:17:17.289 51 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [2.055s] 2018-04-07 19:17:23,947 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:17:23.946 51 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_versions.VersionsTest.test_list_versions ... success [0.006s] 2018-04-07 19:17:31,088 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:17:31.088 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions ... success [3.594s] 2018-04-07 19:17:44,589 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:17:44.589 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address ... success [2.678s] 2018-04-07 19:17:48,171 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:17:48.171 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip ... success [3.581s] 2018-04-07 19:17:59,100 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:17:59.100 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_network ... success [2.806s] 2018-04-07 19:18:02,670 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:18:02.670 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_port ... success [3.569s] 2018-04-07 19:18:12,064 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:18:12.064 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_subnet ... success [9.393s] 2018-04-07 19:18:21,927 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:18:21.926 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_network ... success [3.361s] 2018-04-07 19:18:26,252 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:18:26.252 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_port ... success [4.324s] 2018-04-07 19:18:31,018 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:18:31.017 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_subnet ... success [4.764s] 2018-04-07 19:18:49,022 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:18:49.021 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_update_delete_network_subnet ... success [7.581s] 2018-04-07 19:18:49,455 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:18:49.455 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_external_network_visibility ... success [0.434s] 2018-04-07 19:18:49,726 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:18:49.726 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_networks ... success [0.271s] 2018-04-07 19:18:49,927 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:18:49.926 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_subnets ... success [0.200s] 2018-04-07 19:18:50,210 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:18:50.210 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_network ... success [0.283s] 2018-04-07 19:18:50,424 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:18:50.423 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_subnet ... success [0.213s] 2018-04-07 19:19:06,834 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:19:06.834 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [7.551s] 2018-04-07 19:19:07,262 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:19:07.262 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_external_network_visibility ... success [0.428s] 2018-04-07 19:19:07,401 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:19:07.401 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.139s] 2018-04-07 19:19:07,491 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:19:07.491 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.089s] 2018-04-07 19:19:07,611 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:19:07.611 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.119s] 2018-04-07 19:19:07,987 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:19:07.986 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.375s] 2018-04-07 19:19:21,200 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:19:21.200 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools ... success [4.621s] 2018-04-07 19:19:27,756 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:19:27.755 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups ... success [6.555s] 2018-04-07 19:19:29,591 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:19:29.591 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port ... success [1.834s] 2018-04-07 19:19:29,799 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:19:29.799 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports ... success [0.208s] 2018-04-07 19:19:30,011 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:19:30.011 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port ... success [0.212s] 2018-04-07 19:19:43,197 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:19:43.196 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [5.777s] 2018-04-07 19:19:50,283 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:19:50.283 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups ... success [7.086s] 2018-04-07 19:19:52,193 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:19:52.193 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [1.909s] 2018-04-07 19:19:52,407 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:19:52.406 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.213s] 2018-04-07 19:19:52,602 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:19:52.602 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.196s] 2018-04-07 19:20:07,670 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:20:07.669 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces ... success [9.350s] 2018-04-07 19:20:13,391 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:20:13.390 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id ... success [5.720s] 2018-04-07 19:20:18,552 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:20:18.552 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id ... success [5.161s] 2018-04-07 19:20:21,510 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:20:21.510 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router ... success [2.957s] 2018-04-07 19:20:46,525 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:20:46.524 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces ... success [9.865s] 2018-04-07 19:20:52,455 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:20:52.455 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id ... success [5.931s] 2018-04-07 19:20:57,590 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:20:57.590 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id ... success [5.134s] 2018-04-07 19:21:00,599 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:21:00.599 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router ... success [3.007s] 2018-04-07 19:21:17,839 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:21:17.838 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group ... success [1.588s] 2018-04-07 19:21:19,953 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:21:19.953 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule ... success [2.112s] 2018-04-07 19:21:20,155 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:21:20.155 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups ... success [0.204s] 2018-04-07 19:21:25,282 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:21:25.282 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.747s] 2018-04-07 19:21:27,936 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:21:27.936 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [2.652s] 2018-04-07 19:21:28,129 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:21:28.129 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.196s] 2018-04-07 19:21:32,725 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:21:32.724 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [1.278s] 2018-04-07 19:21:36,090 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:21:36.089 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_versions.NetworksApiDiscovery.test_api_version_resources ... success [0.006s] 2018-04-07 19:21:37,501 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:21:37.501 51 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_quotas.AccountQuotasTest ... skip: AccountQuotasTest skipped as swift is not available 2018-04-07 19:21:37,503 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:21:37.503 51 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_services.AccountTest ... skip: AccountTest skipped as swift is not available 2018-04-07 19:21:37,505 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:21:37.504 51 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest ... skip: ContainerQuotasTest skipped as swift is not available 2018-04-07 19:21:37,506 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:21:37.506 51 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_services.ContainerTest ... skip: ContainerTest skipped as swift is not available 2018-04-07 19:21:37,507 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:21:37.507 51 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_object_services.ObjectTest ... skip: ObjectTest skipped as swift is not available 2018-04-07 19:21:39,519 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:21:39.519 51 INFO opnfv-tempest [-] {0} tempest.api.volume.test_versions.VersionsTest.test_list_versions ... success [0.012s] 2018-04-07 19:21:55,531 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:21:55.531 51 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_attach_detach_volume_to_instance ... success [10.756s] 2018-04-07 19:22:09,242 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:22:09.241 51 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [7.778s] 2018-04-07 19:22:22,099 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:22:22.098 51 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [12.856s] 2018-04-07 19:22:31,217 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:22:31.216 51 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.044s] 2018-04-07 19:23:38,083 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:23:38.083 51 INFO opnfv-tempest [-] {0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops ... success [59.547s] 2018-04-07 19:24:13,326 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:24:13.325 51 INFO opnfv-tempest [-] {0} tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basic_ops ... success [26.358s] 2018-04-07 19:24:58,912 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:24:58.911 51 INFO opnfv-tempest [-] {0} tempest.scenario.test_server_multinode.TestServerMultinode.test_schedule_to_all_nodes ... success [23.557s] 2018-04-07 19:25:15,059 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', '0c03c7d5-d5e6-491c-a015-6e91e16057e7']'. 2018-04-07 19:25:16,043 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2018-04-07 19:25:16,043 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2018-04-07 19:25:16,043 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-04-07 19:25:16,043 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | 0c03c7d5-d5e6-491c-a015-6e91e16057e7 | 2018-04-07 19:25:16,043 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | finished | 2018-04-07 19:25:16,043 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2018-04-07 19:12:11 | 2018-04-07 19:25:16,043 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2018-04-07 19:25:14 | 2018-04-07 19:25:16,044 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 0:13:03 | 2018-04-07 19:25:16,044 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | concurrency: 1 | 2018-04-07 19:25:16,044 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | | load_list: (value is too long, use 'detailed' flag to display it) | 2018-04-07 19:25:16,044 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2018-04-07 19:25:16,044 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: e79780f8-f5e1-45ef-aaac-6e53c64d6a04) | 2018-04-07 19:25:16,044 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2018-04-07 19:25:16,044 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: ddd6c6c2-3735-4385-a76e-f770b0334bd1) | 2018-04-07 19:25:16,044 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 109 | 2018-04-07 19:25:16,044 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 761.69 | 2018-04-07 19:25:16,044 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 90 | 2018-04-07 19:25:16,044 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 19 | 2018-04-07 19:25:16,044 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2018-04-07 19:25:16,044 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2018-04-07 19:25:16,045 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 0 | 2018-04-07 19:25:16,045 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-04-07 19:25:16,045 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------------------------------------------------------------------+ 2018-04-07 19:25:16,134 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest tempest_smoke_serial success_rate is 100.0% 2018-04-07 19:25:24,635 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-07 19:25:24,636 - xtesting.ci.run_tests - INFO - Test result: +------------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +------------------------------+------------------+------------------+----------------+ | tempest_smoke_serial | functest | 13:33 | PASS | +------------------------------+------------------+------------------+----------------+ 2018-04-07 19:25:24,640 - xtesting.ci.run_tests - INFO - Running test case 'rally_sanity'... 2018-04-07 19:25:26,463 - xtesting.energy.energy - INFO - Energy recorder API is not available, cause=No JSON object could be decoded 2018-04-07 19:25:26,463 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-04-07 19:25:28,931 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-04-07 19:25:28.544 118 INFO rally.deployment.engine [-] Deployment ddd6c6c2-3735-4385-a76e-f770b0334bd1 | Starting: Destroy cloud and free allocated resources. 2018-04-07 19:25:28.627 118 INFO rally.deployment.engine [-] Deployment ddd6c6c2-3735-4385-a76e-f770b0334bd1 | Completed: Destroy cloud and free allocated resources. 2018-04-07 19:25:28.645 118 INFO rally.api [-] Deleting all verifications created by verifier 'opnfv-tempest' (UUID=e79780f8-f5e1-45ef-aaac-6e53c64d6a04) for deployment 'opnfv-rally'. 2018-04-07 19:25:28.655 118 INFO rally.api [-] Deleting verification (UUID=0c03c7d5-d5e6-491c-a015-6e91e16057e7). 2018-04-07 19:25:28.705 118 INFO rally.api [-] Verification has been successfully deleted! 2018-04-07 19:25:28.705 118 INFO rally.api [-] Deleting deployment-specific data for verifier 'opnfv-tempest' (UUID=e79780f8-f5e1-45ef-aaac-6e53c64d6a04). 2018-04-07 19:25:28.714 118 INFO rally.api [-] Deployment-specific data has been successfully deleted! 2018-04-07 19:25:31,303 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-04-07 19:25:31.012 121 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=7d0ad23a-b9b3-427d-b818-5c07381cd15a) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | 7d0ad23a-b9b3-427d-b818-5c07381cd15a | 2018-04-07T19:25:30 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: 7d0ad23a-b9b3-427d-b818-5c07381cd15a ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-04-07 19:25:34,515 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | key-manager | Available | | __unknown__ | placement | Available | | __unknown__ | policy | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+----------------+-----------+ 2018-04-07 19:25:34,515 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating the test name... 2018-04-07 19:25:36,028 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating image 'Cirros-0.4.0-0e89a36a-26b3-4688-9df6-9ca1a7bda4d9'... 2018-04-07 19:25:39,366 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating network 'rally-net-0e89a36a-26b3-4688-9df6-9ca1a7bda4d9'... 2018-04-07 19:25:42,218 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating router 'rally-router-0e89a36a-26b3-4688-9df6-9ca1a7bda4d9'... 2018-04-07 19:25:49,396 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating flavor 'rally-tiny-0e89a36a-26b3-4688-9df6-9ca1a7bda4d9'... 2018-04-07 19:25:50,133 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating flavor 'rally-mini-0e89a36a-26b3-4688-9df6-9ca1a7bda4d9'... 2018-04-07 19:25:50,864 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2018-04-07 19:25:50,865 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-authenticate.yaml 2018-04-07 19:25:50,866 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-07 19:25:50,905 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-04-07 19:25:50,910 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['authenticate'], 'concurrency': 4, 'netid': '908e9bc6-e401-4a98-86d9-a7a732ca206e', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-0e89a36a-26b3-4688-9df6-9ca1a7bda4d9', 'flavor_name': 'rally-tiny-0e89a36a-26b3-4688-9df6-9ca1a7bda4d9', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-0e89a36a-26b3-4688-9df6-9ca1a7bda4d9', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-07 19:26:51,220 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 1d4badf9-38a8-4849-9a69-a78daf9b10c9 2018-04-07 19:26:51,220 - functest.opnfv_tests.openstack.rally.rally - DEBUG - /home/opnfv/functest/results/rally does not exist, we create it. 2018-04-07 19:26:51,221 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '1d4badf9-38a8-4849-9a69-a78daf9b10c9'] 2018-04-07 19:26:52,271 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 1d4badf9-38a8-4849-9a69-a78daf9b10c9: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 1d4badf9-38a8-4849-9a69-a78daf9b10c9 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 0.475 | 0.475 | 0.475 | 0.475 | 0.475 | 0.475 | 100.0% | 1 | | total | 0.475 | 0.475 | 0.475 | 0.475 | 0.475 | 0.475 | 100.0% | 1 | | -> duration | 0.475 | 0.475 | 0.475 | 0.475 | 0.475 | 0.475 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.47513 Full duration: 7.39859 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 1d4badf9-38a8-4849-9a69-a78daf9b10c9 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.344 | 0.344 | 0.344 | 0.344 | 0.344 | 0.344 | 100.0% | 1 | | total | 0.779 | 0.779 | 0.779 | 0.779 | 0.779 | 0.779 | 100.0% | 1 | | -> duration | 0.779 | 0.779 | 0.779 | 0.779 | 0.779 | 0.779 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.77869 Full duration: 7.522664 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 1d4badf9-38a8-4849-9a69-a78daf9b10c9 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.528 | 0.528 | 0.528 | 0.528 | 0.528 | 0.528 | 100.0% | 1 | | total | 1.036 | 1.036 | 1.036 | 1.036 | 1.036 | 1.036 | 100.0% | 1 | | -> duration | 1.036 | 1.036 | 1.036 | 1.036 | 1.036 | 1.036 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.036041 Full duration: 7.934352 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 1d4badf9-38a8-4849-9a69-a78daf9b10c9 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.357 | 0.357 | 0.357 | 0.357 | 0.357 | 0.357 | 100.0% | 1 | | total | 0.783 | 0.783 | 0.783 | 0.783 | 0.783 | 0.783 | 100.0% | 1 | | -> duration | 0.783 | 0.783 | 0.783 | 0.783 | 0.783 | 0.783 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.782769 Full duration: 7.81176 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 1d4badf9-38a8-4849-9a69-a78daf9b10c9 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.518 | 0.518 | 0.518 | 0.518 | 0.518 | 0.518 | 100.0% | 1 | | total | 0.92 | 0.92 | 0.92 | 0.92 | 0.92 | 0.92 | 100.0% | 1 | | -> duration | 0.92 | 0.92 | 0.92 | 0.92 | 0.92 | 0.92 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.91981 Full duration: 7.76513 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 1d4badf9-38a8-4849-9a69-a78daf9b10c9 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.223 | 0.223 | 0.223 | 0.223 | 0.223 | 0.223 | 100.0% | 1 | | total | 0.676 | 0.676 | 0.676 | 0.676 | 0.676 | 0.676 | 100.0% | 1 | | -> duration | 0.676 | 0.676 | 0.676 | 0.676 | 0.676 | 0.676 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.67588 Full duration: 7.570071 HINTS: * To plot HTML graphics with this data, run: rally task report 1d4badf9-38a8-4849-9a69-a78daf9b10c9 --out output.html * To generate a JUnit report, run: rally task export 1d4badf9-38a8-4849-9a69-a78daf9b10c9 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 1d4badf9-38a8-4849-9a69-a78daf9b10c9 --json --out output.json 2018-04-07 19:26:52,271 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '1d4badf9-38a8-4849-9a69-a78daf9b10c9'] 2018-04-07 19:26:53,339 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-07 19:26:53,340 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '1d4badf9-38a8-4849-9a69-a78daf9b10c9', '--out', u'/home/opnfv/functest/results/rally/opnfv-authenticate.html'] 2018-04-07 19:26:53,347 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2018-04-07 19:26:53,347 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2018-04-07 19:26:53,347 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-glance.yaml 2018-04-07 19:26:53,348 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-07 19:26:53,379 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-04-07 19:26:53,381 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['glance'], 'concurrency': 4, 'netid': '908e9bc6-e401-4a98-86d9-a7a732ca206e', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-0e89a36a-26b3-4688-9df6-9ca1a7bda4d9', 'flavor_name': 'rally-tiny-0e89a36a-26b3-4688-9df6-9ca1a7bda4d9', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-0e89a36a-26b3-4688-9df6-9ca1a7bda4d9', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-07 19:28:59,592 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 223e442b-36b0-4270-9c98-2483c615aef6 2018-04-07 19:28:59,593 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '223e442b-36b0-4270-9c98-2483c615aef6'] 2018-04-07 19:29:00,626 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 223e442b-36b0-4270-9c98-2483c615aef6: finished -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 223e442b-36b0-4270-9c98-2483c615aef6 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 4.532 | 4.532 | 4.532 | 4.532 | 4.532 | 4.532 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.493 | 0.493 | 0.493 | 0.493 | 0.493 | 0.493 | 100.0% | 1 | | -> glance_v2.upload_data | 1.632 | 1.632 | 1.632 | 1.632 | 1.632 | 1.632 | 100.0% | 1 | | glance_v2.delete_image | 1.29 | 1.29 | 1.29 | 1.29 | 1.29 | 1.29 | 100.0% | 1 | | total | 5.822 | 5.822 | 5.822 | 5.822 | 5.822 | 5.822 | 100.0% | 1 | | -> duration | 5.822 | 5.822 | 5.822 | 5.822 | 5.822 | 5.822 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.822362 Full duration: 14.300213 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 223e442b-36b0-4270-9c98-2483c615aef6 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 5.001 | 5.001 | 5.001 | 5.001 | 5.001 | 5.001 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.502 | 0.502 | 0.502 | 0.502 | 0.502 | 0.502 | 100.0% | 1 | | -> glance_v2.upload_data | 2.039 | 2.039 | 2.039 | 2.039 | 2.039 | 2.039 | 100.0% | 1 | | glance_v2.list_images | 0.175 | 0.175 | 0.175 | 0.175 | 0.175 | 0.175 | 100.0% | 1 | | total | 5.177 | 5.177 | 5.177 | 5.177 | 5.177 | 5.177 | 100.0% | 1 | | -> duration | 5.177 | 5.177 | 5.177 | 5.177 | 5.177 | 5.177 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.176699 Full duration: 17.346427 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 223e442b-36b0-4270-9c98-2483c615aef6 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.365 | 0.365 | 0.365 | 0.365 | 0.365 | 0.365 | 100.0% | 1 | | total | 0.365 | 0.365 | 0.365 | 0.365 | 0.365 | 0.365 | 100.0% | 1 | | -> duration | 0.365 | 0.365 | 0.365 | 0.365 | 0.365 | 0.365 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.36521 Full duration: 8.140385 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": { "name": "rally-tiny-0e89a36a-26b3-4688-9df6-9ca1a7bda4d9" }, "number_instances": 2, "nics": [ { "net-id": "908e9bc6-e401-4a98-86d9-a7a732ca206e" } ] }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } } } -------------------------------------------------------------------------------- Task 223e442b-36b0-4270-9c98-2483c615aef6 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 4.825 | 4.825 | 4.825 | 4.825 | 4.825 | 4.825 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.529 | 0.529 | 0.529 | 0.529 | 0.529 | 0.529 | 100.0% | 1 | | -> glance_v2.upload_data | 1.847 | 1.847 | 1.847 | 1.847 | 1.847 | 1.847 | 100.0% | 1 | | nova.boot_servers | 11.303 | 11.303 | 11.303 | 11.303 | 11.303 | 11.303 | 100.0% | 1 | | total | 16.129 | 16.129 | 16.129 | 16.129 | 16.129 | 16.129 | 100.0% | 1 | | -> duration | 15.129 | 15.129 | 15.129 | 15.129 | 15.129 | 15.129 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.128993 Full duration: 66.891737 HINTS: * To plot HTML graphics with this data, run: rally task report 223e442b-36b0-4270-9c98-2483c615aef6 --out output.html * To generate a JUnit report, run: rally task export 223e442b-36b0-4270-9c98-2483c615aef6 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 223e442b-36b0-4270-9c98-2483c615aef6 --json --out output.json 2018-04-07 19:29:00,626 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '223e442b-36b0-4270-9c98-2483c615aef6'] 2018-04-07 19:29:01,798 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-07 19:29:01,798 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '223e442b-36b0-4270-9c98-2483c615aef6', '--out', u'/home/opnfv/functest/results/rally/opnfv-glance.html'] 2018-04-07 19:29:01,806 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" OK. 2018-04-07 19:29:01,806 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "ceilometer" ... 2018-04-07 19:29:01,807 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-ceilometer.yaml 2018-04-07 19:29:01,807 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-07 19:29:01,850 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-04-07 19:29:01,851 - functest.opnfv_tests.openstack.rally.rally - INFO - No tests for scenario "ceilometer" 2018-04-07 19:29:01,851 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2018-04-07 19:29:01,851 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-cinder.yaml 2018-04-07 19:29:01,852 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-07 19:29:01,885 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-04-07 19:29:01,889 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['cinder'], 'concurrency': 4, 'netid': '908e9bc6-e401-4a98-86d9-a7a732ca206e', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-0e89a36a-26b3-4688-9df6-9ca1a7bda4d9', 'flavor_name': 'rally-tiny-0e89a36a-26b3-4688-9df6-9ca1a7bda4d9', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-0e89a36a-26b3-4688-9df6-9ca1a7bda4d9', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-07 19:32:23,567 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 6e047c40-eee1-481b-9e62-4c4098002b60 2018-04-07 19:32:23,568 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '6e047c40-eee1-481b-9e62-4c4098002b60'] 2018-04-07 19:32:24,662 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 6e047c40-eee1-481b-9e62-4c4098002b60: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "force": false }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 6e047c40-eee1-481b-9e62-4c4098002b60 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_snapshot | 3.132 | 3.132 | 3.132 | 3.132 | 3.132 | 3.132 | 100.0% | 1 | | cinder_v2.delete_snapshot | 2.62 | 2.62 | 2.62 | 2.62 | 2.62 | 2.62 | 100.0% | 1 | | total | 5.752 | 5.752 | 5.752 | 5.752 | 5.752 | 5.752 | 100.0% | 1 | | -> duration | 5.752 | 5.752 | 5.752 | 5.752 | 5.752 | 5.752 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.751947 Full duration: 23.376048 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "size": { "max": 1, "min": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task 6e047c40-eee1-481b-9e62-4c4098002b60 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.141 | 3.141 | 3.141 | 3.141 | 3.141 | 3.141 | 100.0% | 1 | | cinder_v2.delete_volume | 2.638 | 2.638 | 2.638 | 2.638 | 2.638 | 2.638 | 100.0% | 1 | | total | 5.779 | 5.779 | 5.779 | 5.779 | 5.779 | 5.779 | 100.0% | 1 | | -> duration | 5.779 | 5.779 | 5.779 | 5.779 | 5.779 | 5.779 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.779241 Full duration: 16.211496 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "image": { "name": "Cirros-0.4.0-0e89a36a-26b3-4688-9df6-9ca1a7bda4d9" }, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task 6e047c40-eee1-481b-9e62-4c4098002b60 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 8.445 | 8.445 | 8.445 | 8.445 | 8.445 | 8.445 | 100.0% | 1 | | cinder_v2.delete_volume | 3.267 | 3.267 | 3.267 | 3.267 | 3.267 | 3.267 | 100.0% | 1 | | total | 11.713 | 11.713 | 11.713 | 11.713 | 11.713 | 11.713 | 100.0% | 1 | | -> duration | 11.713 | 11.713 | 11.713 | 11.713 | 11.713 | 11.713 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 11.712911 Full duration: 22.491396 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task 6e047c40-eee1-481b-9e62-4c4098002b60 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.143 | 3.143 | 3.143 | 3.143 | 3.143 | 3.143 | 100.0% | 1 | | cinder_v2.delete_volume | 2.452 | 2.452 | 2.452 | 2.452 | 2.452 | 2.452 | 100.0% | 1 | | total | 5.595 | 5.595 | 5.595 | 5.595 | 5.595 | 5.595 | 100.0% | 1 | | -> duration | 5.595 | 5.595 | 5.595 | 5.595 | 5.595 | 5.595 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.595296 Full duration: 15.747939 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "new_size": 2, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task 6e047c40-eee1-481b-9e62-4c4098002b60 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.359 | 3.359 | 3.359 | 3.359 | 3.359 | 3.359 | 100.0% | 1 | | cinder_v2.extend_volume | 2.657 | 2.657 | 2.657 | 2.657 | 2.657 | 2.657 | 100.0% | 1 | | cinder_v2.delete_volume | 2.439 | 2.439 | 2.439 | 2.439 | 2.439 | 2.439 | 100.0% | 1 | | total | 8.456 | 8.456 | 8.456 | 8.456 | 8.456 | 8.456 | 100.0% | 1 | | -> duration | 8.456 | 8.456 | 8.456 | 8.456 | 8.456 | 8.456 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.455973 Full duration: 18.463224 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 6e047c40-eee1-481b-9e62-4c4098002b60 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.184 | 3.184 | 3.184 | 3.184 | 3.184 | 3.184 | 100.0% | 1 | | cinder_v2.delete_volume | 2.626 | 2.626 | 2.626 | 2.626 | 2.626 | 2.626 | 100.0% | 1 | | total | 5.81 | 5.81 | 5.81 | 5.81 | 5.81 | 5.81 | 100.0% | 1 | | -> duration | 5.81 | 5.81 | 5.81 | 5.81 | 5.81 | 5.81 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.810386 Full duration: 22.520002 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 6e047c40-eee1-481b-9e62-4c4098002b60 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_qos | 0.604 | 0.604 | 0.604 | 0.604 | 0.604 | 0.604 | 100.0% | 1 | | cinder_v2.list_qos | 0.252 | 0.252 | 0.252 | 0.252 | 0.252 | 0.252 | 100.0% | 1 | | total | 0.857 | 0.857 | 0.857 | 0.857 | 0.857 | 0.857 | 100.0% | 1 | | -> duration | 0.857 | 0.857 | 0.857 | 0.857 | 0.857 | 0.857 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.856583 Full duration: 12.30451 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "consumer": "back-end", "write_iops_sec": "10", "read_iops_sec": "1000", "set_consumer": "both", "set_write_iops_sec": "11", "set_read_iops_sec": "1001" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 6e047c40-eee1-481b-9e62-4c4098002b60 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_qos | 0.591 | 0.591 | 0.591 | 0.591 | 0.591 | 0.591 | 100.0% | 1 | | cinder_v2.set_qos | 0.204 | 0.204 | 0.204 | 0.204 | 0.204 | 0.204 | 100.0% | 1 | | total | 0.796 | 0.796 | 0.796 | 0.796 | 0.796 | 0.796 | 100.0% | 1 | | -> duration | 0.796 | 0.796 | 0.796 | 0.796 | 0.796 | 0.796 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.795966 Full duration: 12.560624 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "description": "rally tests creating types" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 6e047c40-eee1-481b-9e62-4c4098002b60 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.646 | 0.646 | 0.646 | 0.646 | 0.646 | 0.646 | 100.0% | 1 | | cinder_v2.list_types | 0.16 | 0.16 | 0.16 | 0.16 | 0.16 | 0.16 | 100.0% | 1 | | total | 0.807 | 0.807 | 0.807 | 0.807 | 0.807 | 0.807 | 100.0% | 1 | | -> duration | 0.807 | 0.807 | 0.807 | 0.807 | 0.807 | 0.807 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.807072 Full duration: 12.632037 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "description": "rally tests creating types", "provider": "LuksEncryptor", "cipher": "aes-xts-plain64", "key_size": 512, "control_location": "front-end" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 6e047c40-eee1-481b-9e62-4c4098002b60 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.637 | 0.637 | 0.637 | 0.637 | 0.637 | 0.637 | 100.0% | 1 | | cinder_v2.create_encryption_type | 0.211 | 0.211 | 0.211 | 0.211 | 0.211 | 0.211 | 100.0% | 1 | | total | 0.849 | 0.849 | 0.849 | 0.849 | 0.849 | 0.849 | 100.0% | 1 | | -> duration | 0.849 | 0.849 | 0.849 | 0.849 | 0.849 | 0.849 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.849027 Full duration: 12.149797 HINTS: * To plot HTML graphics with this data, run: rally task report 6e047c40-eee1-481b-9e62-4c4098002b60 --out output.html * To generate a JUnit report, run: rally task export 6e047c40-eee1-481b-9e62-4c4098002b60 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 6e047c40-eee1-481b-9e62-4c4098002b60 --json --out output.json 2018-04-07 19:32:24,662 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '6e047c40-eee1-481b-9e62-4c4098002b60'] 2018-04-07 19:32:25,657 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-07 19:32:25,657 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '6e047c40-eee1-481b-9e62-4c4098002b60', '--out', u'/home/opnfv/functest/results/rally/opnfv-cinder.html'] 2018-04-07 19:32:25,664 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2018-04-07 19:32:25,664 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2018-04-07 19:32:25,664 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-heat.yaml 2018-04-07 19:32:25,664 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-07 19:32:25,693 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-04-07 19:32:25,695 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['heat'], 'concurrency': 4, 'netid': '908e9bc6-e401-4a98-86d9-a7a732ca206e', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-0e89a36a-26b3-4688-9df6-9ca1a7bda4d9', 'flavor_name': 'rally-tiny-0e89a36a-26b3-4688-9df6-9ca1a7bda4d9', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-0e89a36a-26b3-4688-9df6-9ca1a7bda4d9', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-07 19:33:47,530 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 0d11d135-582b-4618-8ae4-83978ffcfe16 2018-04-07 19:33:47,530 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '0d11d135-582b-4618-8ae4-83978ffcfe16'] 2018-04-07 19:33:48,654 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 0d11d135-582b-4618-8ae4-83978ffcfe16: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task 0d11d135-582b-4618-8ae4-83978ffcfe16 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 4.492 | 4.492 | 4.492 | 4.492 | 4.492 | 4.492 | 100.0% | 1 | | heat.update_stack | 3.497 | 3.497 | 3.497 | 3.497 | 3.497 | 3.497 | 100.0% | 1 | | heat.delete_stack | 2.536 | 2.536 | 2.536 | 2.536 | 2.536 | 2.536 | 100.0% | 1 | | total | 10.524 | 10.524 | 10.524 | 10.524 | 10.524 | 10.524 | 100.0% | 1 | | -> duration | 6.524 | 6.524 | 6.524 | 6.524 | 6.524 | 6.524 | 100.0% | 1 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.524306 Full duration: 20.812738 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task 0d11d135-582b-4618-8ae4-83978ffcfe16 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 4.721 | 4.721 | 4.721 | 4.721 | 4.721 | 4.721 | 100.0% | 1 | | heat.check_stack | 0.782 | 0.782 | 0.782 | 0.782 | 0.782 | 0.782 | 100.0% | 1 | | heat.delete_stack | 1.732 | 1.732 | 1.732 | 1.732 | 1.732 | 1.732 | 100.0% | 1 | | total | 7.236 | 7.236 | 7.236 | 7.236 | 7.236 | 7.236 | 100.0% | 1 | | -> duration | 5.236 | 5.236 | 5.236 | 5.236 | 5.236 | 5.236 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.236239 Full duration: 15.673806 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task 0d11d135-582b-4618-8ae4-83978ffcfe16 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 4.781 | 4.781 | 4.781 | 4.781 | 4.781 | 4.781 | 100.0% | 1 | | heat.suspend_stack | 0.781 | 0.781 | 0.781 | 0.781 | 0.781 | 0.781 | 100.0% | 1 | | heat.resume_stack | 0.641 | 0.641 | 0.641 | 0.641 | 0.641 | 0.641 | 100.0% | 1 | | heat.delete_stack | 1.753 | 1.753 | 1.753 | 1.753 | 1.753 | 1.753 | 100.0% | 1 | | total | 7.956 | 7.956 | 7.956 | 7.956 | 7.956 | 7.956 | 100.0% | 1 | | -> duration | 5.956 | 5.956 | 5.956 | 5.956 | 5.956 | 5.956 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.955875 Full duration: 16.355903 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task 0d11d135-582b-4618-8ae4-83978ffcfe16 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 0.597 | 0.597 | 0.597 | 0.597 | 0.597 | 0.597 | 100.0% | 1 | | total | 0.597 | 0.597 | 0.597 | 0.597 | 0.597 | 0.597 | 100.0% | 1 | | -> duration | 0.597 | 0.597 | 0.597 | 0.597 | 0.597 | 0.597 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.596737 Full duration: 8.28278 HINTS: * To plot HTML graphics with this data, run: rally task report 0d11d135-582b-4618-8ae4-83978ffcfe16 --out output.html * To generate a JUnit report, run: rally task export 0d11d135-582b-4618-8ae4-83978ffcfe16 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 0d11d135-582b-4618-8ae4-83978ffcfe16 --json --out output.json 2018-04-07 19:33:48,654 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '0d11d135-582b-4618-8ae4-83978ffcfe16'] 2018-04-07 19:33:49,718 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-07 19:33:49,718 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '0d11d135-582b-4618-8ae4-83978ffcfe16', '--out', u'/home/opnfv/functest/results/rally/opnfv-heat.html'] 2018-04-07 19:33:49,725 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2018-04-07 19:33:49,726 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2018-04-07 19:33:49,726 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-keystone.yaml 2018-04-07 19:33:49,726 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-07 19:33:49,767 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-04-07 19:33:49,771 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['keystone'], 'concurrency': 4, 'netid': '908e9bc6-e401-4a98-86d9-a7a732ca206e', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-0e89a36a-26b3-4688-9df6-9ca1a7bda4d9', 'flavor_name': 'rally-tiny-0e89a36a-26b3-4688-9df6-9ca1a7bda4d9', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-0e89a36a-26b3-4688-9df6-9ca1a7bda4d9', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-07 19:37:06,065 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : ae0b58b5-5f99-420d-ac7f-fc43fb640e0b 2018-04-07 19:37:06,065 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'ae0b58b5-5f99-420d-ac7f-fc43fb640e0b'] 2018-04-07 19:37:07,099 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task ae0b58b5-5f99-420d-ac7f-fc43fb640e0b: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task ae0b58b5-5f99-420d-ac7f-fc43fb640e0b has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.5 | 0.5 | 0.5 | 0.5 | 0.5 | 0.5 | 100.0% | 1 | | keystone_v3.add_role | 0.123 | 0.123 | 0.123 | 0.123 | 0.123 | 0.123 | 100.0% | 1 | | keystone_v3.revoke_role | 0.125 | 0.125 | 0.125 | 0.125 | 0.125 | 0.125 | 100.0% | 1 | | total | 0.748 | 0.748 | 0.748 | 0.748 | 0.748 | 0.748 | 100.0% | 1 | | -> duration | 0.748 | 0.748 | 0.748 | 0.748 | 0.748 | 0.748 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.748309 Full duration: 14.72835 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task ae0b58b5-5f99-420d-ac7f-fc43fb640e0b has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.635 | 0.635 | 0.635 | 0.635 | 0.635 | 0.635 | 100.0% | 1 | | keystone_v3.add_role | 0.122 | 0.122 | 0.122 | 0.122 | 0.122 | 0.122 | 100.0% | 1 | | keystone_v3.list_roles | 0.103 | 0.103 | 0.103 | 0.103 | 0.103 | 0.103 | 100.0% | 1 | | total | 0.86 | 0.86 | 0.86 | 0.86 | 0.86 | 0.86 | 100.0% | 1 | | -> duration | 0.86 | 0.86 | 0.86 | 0.86 | 0.86 | 0.86 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.85996 Full duration: 15.30297 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task ae0b58b5-5f99-420d-ac7f-fc43fb640e0b has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.818 | 0.818 | 0.818 | 0.818 | 0.818 | 0.818 | 100.0% | 1 | | keystone_v3.list_projects | 0.079 | 0.079 | 0.079 | 0.079 | 0.079 | 0.079 | 100.0% | 1 | | total | 0.897 | 0.897 | 0.897 | 0.897 | 0.897 | 0.897 | 100.0% | 1 | | -> duration | 0.897 | 0.897 | 0.897 | 0.897 | 0.897 | 0.897 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.897383 Full duration: 14.968125 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task ae0b58b5-5f99-420d-ac7f-fc43fb640e0b has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.513 | 0.513 | 0.513 | 0.513 | 0.513 | 0.513 | 100.0% | 1 | | keystone_v3.delete_role | 0.113 | 0.113 | 0.113 | 0.113 | 0.113 | 0.113 | 100.0% | 1 | | total | 0.627 | 0.627 | 0.627 | 0.627 | 0.627 | 0.627 | 100.0% | 1 | | -> duration | 0.627 | 0.627 | 0.627 | 0.627 | 0.627 | 0.627 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.626762 Full duration: 12.25784 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task ae0b58b5-5f99-420d-ac7f-fc43fb640e0b has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.496 | 0.496 | 0.496 | 0.496 | 0.496 | 0.496 | 100.0% | 1 | | keystone_v3.delete_service | 0.103 | 0.103 | 0.103 | 0.103 | 0.103 | 0.103 | 100.0% | 1 | | total | 0.599 | 0.599 | 0.599 | 0.599 | 0.599 | 0.599 | 100.0% | 1 | | -> duration | 0.599 | 0.599 | 0.599 | 0.599 | 0.599 | 0.599 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.599391 Full duration: 12.418406 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task ae0b58b5-5f99-420d-ac7f-fc43fb640e0b has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.698 | 0.698 | 0.698 | 0.698 | 0.698 | 0.698 | 100.0% | 1 | | keystone_v3.create_user | 0.512 | 0.512 | 0.512 | 0.512 | 0.512 | 0.512 | 100.0% | 1 | | -> keystone_v3.list_roles | 0.086 | 0.086 | 0.086 | 0.086 | 0.086 | 0.086 | 100.0% | 1 | | -> keystone_v3.add_role | 0.12 | 0.12 | 0.12 | 0.12 | 0.12 | 0.12 | 100.0% | 1 | | keystone_v3.create_role | 0.107 | 0.107 | 0.107 | 0.107 | 0.107 | 0.107 | 100.0% | 1 | | keystone_v3.get_project | 0.084 | 0.084 | 0.084 | 0.084 | 0.084 | 0.084 | 100.0% | 1 | | keystone_v3.get_user | 0.097 | 0.097 | 0.097 | 0.097 | 0.097 | 0.097 | 100.0% | 1 | | keystone_v3.get_role | 0.089 | 0.089 | 0.089 | 0.089 | 0.089 | 0.089 | 100.0% | 1 | | keystone_v3.list_services | 0.078 | 0.078 | 0.078 | 0.078 | 0.078 | 0.078 | 100.0% | 1 | | keystone_v3.get_services | 0.084 | 0.084 | 0.084 | 0.084 | 0.084 | 0.084 | 100.0% | 1 | | total | 1.868 | 1.868 | 1.868 | 1.868 | 1.868 | 1.868 | 100.0% | 1 | | -> duration | 1.868 | 1.868 | 1.868 | 1.868 | 1.868 | 1.868 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.868335 Full duration: 19.519363 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task ae0b58b5-5f99-420d-ac7f-fc43fb640e0b has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.687 | 0.687 | 0.687 | 0.687 | 0.687 | 0.687 | 100.0% | 1 | | keystone_v3.update_project | 0.107 | 0.107 | 0.107 | 0.107 | 0.107 | 0.107 | 100.0% | 1 | | keystone_v3.delete_project | 0.153 | 0.153 | 0.153 | 0.153 | 0.153 | 0.153 | 100.0% | 1 | | total | 0.948 | 0.948 | 0.948 | 0.948 | 0.948 | 0.948 | 100.0% | 1 | | -> duration | 0.948 | 0.948 | 0.948 | 0.948 | 0.948 | 0.948 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.947596 Full duration: 12.918008 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task ae0b58b5-5f99-420d-ac7f-fc43fb640e0b has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.663 | 0.663 | 0.663 | 0.663 | 0.663 | 0.663 | 100.0% | 1 | | total | 0.763 | 0.763 | 0.763 | 0.763 | 0.763 | 0.763 | 100.0% | 1 | | -> duration | 0.763 | 0.763 | 0.763 | 0.763 | 0.763 | 0.763 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.763365 Full duration: 14.781151 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task ae0b58b5-5f99-420d-ac7f-fc43fb640e0b has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.678 | 0.678 | 0.678 | 0.678 | 0.678 | 0.678 | 100.0% | 1 | | total | 0.678 | 0.678 | 0.678 | 0.678 | 0.678 | 0.678 | 100.0% | 1 | | -> duration | 0.678 | 0.678 | 0.678 | 0.678 | 0.678 | 0.678 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.678084 Full duration: 14.502084 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task ae0b58b5-5f99-420d-ac7f-fc43fb640e0b has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.682 | 0.682 | 0.682 | 0.682 | 0.682 | 0.682 | 100.0% | 1 | | keystone_v3.list_users | 0.102 | 0.102 | 0.102 | 0.102 | 0.102 | 0.102 | 100.0% | 1 | | total | 0.881 | 0.881 | 0.881 | 0.881 | 0.881 | 0.881 | 100.0% | 1 | | -> duration | 0.881 | 0.881 | 0.881 | 0.881 | 0.881 | 0.881 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.88148 Full duration: 14.609456 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "users_per_tenant": 10 }, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task ae0b58b5-5f99-420d-ac7f-fc43fb640e0b has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.647 | 0.647 | 0.647 | 0.647 | 0.647 | 0.647 | 100.0% | 1 | | keystone_v3.create_users | 5.117 | 5.117 | 5.117 | 5.117 | 5.117 | 5.117 | 100.0% | 1 | | -> keystone_v3.create_user (x10) | 5.117 | 5.117 | 5.117 | 5.117 | 5.117 | 5.117 | 100.0% | 1 | | --> keystone_v3.list_roles (x10) | 0.944 | 0.944 | 0.944 | 0.944 | 0.944 | 0.944 | 100.0% | 1 | | --> keystone_v3.add_role (x10) | 1.343 | 1.343 | 1.343 | 1.343 | 1.343 | 1.343 | 100.0% | 1 | | total | 6.727 | 6.727 | 6.727 | 6.727 | 6.727 | 6.727 | 100.0% | 1 | | -> duration | 6.727 | 6.727 | 6.727 | 6.727 | 6.727 | 6.727 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.72671 Full duration: 23.942748 HINTS: * To plot HTML graphics with this data, run: rally task report ae0b58b5-5f99-420d-ac7f-fc43fb640e0b --out output.html * To generate a JUnit report, run: rally task export ae0b58b5-5f99-420d-ac7f-fc43fb640e0b --type junit --to output.xml * To get raw JSON output of task results, run: rally task report ae0b58b5-5f99-420d-ac7f-fc43fb640e0b --json --out output.json 2018-04-07 19:37:07,099 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'ae0b58b5-5f99-420d-ac7f-fc43fb640e0b'] 2018-04-07 19:37:08,144 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-07 19:37:08,144 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'ae0b58b5-5f99-420d-ac7f-fc43fb640e0b', '--out', u'/home/opnfv/functest/results/rally/opnfv-keystone.html'] 2018-04-07 19:37:08,152 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2018-04-07 19:37:08,152 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2018-04-07 19:37:08,152 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-neutron.yaml 2018-04-07 19:37:08,152 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-07 19:37:08,178 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-04-07 19:37:08,183 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['neutron'], 'concurrency': 4, 'netid': '908e9bc6-e401-4a98-86d9-a7a732ca206e', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-0e89a36a-26b3-4688-9df6-9ca1a7bda4d9', 'flavor_name': 'rally-tiny-0e89a36a-26b3-4688-9df6-9ca1a7bda4d9', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-0e89a36a-26b3-4688-9df6-9ca1a7bda4d9', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-07 19:40:59,321 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : df596e9c-7e3f-4a72-97ae-1ed21f57ccd7 2018-04-07 19:40:59,321 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'df596e9c-7e3f-4a72-97ae-1ed21f57ccd7'] 2018-04-07 19:41:00,333 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task df596e9c-7e3f-4a72-97ae-1ed21f57ccd7: aborted -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } } } -------------------------------------------------------------------------------- Task df596e9c-7e3f-4a72-97ae-1ed21f57ccd7 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.086 | 1.086 | 1.086 | 1.086 | 1.086 | 1.086 | 100.0% | 1 | | neutron.delete_network | 1.182 | 1.182 | 1.182 | 1.182 | 1.182 | 1.182 | 100.0% | 1 | | total | 2.268 | 2.268 | 2.268 | 2.268 | 2.268 | 2.268 | 100.0% | 1 | | -> duration | 2.268 | 2.268 | 2.268 | 2.268 | 2.268 | 2.268 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.268068 Full duration: 15.712986 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "port": -1 } } } } -------------------------------------------------------------------------------- Task df596e9c-7e3f-4a72-97ae-1ed21f57ccd7 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 1.512 | 1.512 | 1.512 | 1.512 | 1.512 | 1.512 | 100.0% | 1 | | neutron.delete_port | 0.628 | 0.628 | 0.628 | 0.628 | 0.628 | 0.628 | 100.0% | 1 | | total | 2.14 | 2.14 | 2.14 | 2.14 | 2.14 | 2.14 | 100.0% | 1 | | -> duration | 2.14 | 2.14 | 2.14 | 2.14 | 2.14 | 2.14 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.140111 Full duration: 31.725566 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "router_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1, "port": -1, "router": -1 } } } } -------------------------------------------------------------------------------- Task df596e9c-7e3f-4a72-97ae-1ed21f57ccd7 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.885 | 0.885 | 0.885 | 0.885 | 0.885 | 0.885 | 100.0% | 1 | | neutron.create_subnet | 0.91 | 0.91 | 0.91 | 0.91 | 0.91 | 0.91 | 100.0% | 1 | | neutron.create_router | 0.302 | 0.302 | 0.302 | 0.302 | 0.302 | 0.302 | 100.0% | 1 | | neutron.add_interface_router | 1.561 | 1.561 | 1.561 | 1.561 | 1.561 | 1.561 | 100.0% | 1 | | neutron.remove_interface_router | 1.279 | 1.279 | 1.279 | 1.279 | 1.279 | 1.279 | 100.0% | 1 | | neutron.delete_router | 0.587 | 0.587 | 0.587 | 0.587 | 0.587 | 0.587 | 100.0% | 1 | | total | 5.525 | 5.525 | 5.525 | 5.525 | 5.525 | 5.525 | 100.0% | 1 | | -> duration | 5.525 | 5.525 | 5.525 | 5.525 | 5.525 | 5.525 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.524661 Full duration: 38.346577 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1 } } } } -------------------------------------------------------------------------------- Task df596e9c-7e3f-4a72-97ae-1ed21f57ccd7 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet | 1.226 | 1.226 | 1.226 | 1.226 | 1.226 | 1.226 | 100.0% | 1 | | neutron.delete_subnet | 0.603 | 0.603 | 0.603 | 0.603 | 0.603 | 0.603 | 100.0% | 1 | | total | 1.829 | 1.829 | 1.829 | 1.829 | 1.829 | 1.829 | 100.0% | 1 | | -> duration | 1.829 | 1.829 | 1.829 | 1.829 | 1.829 | 1.829 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.828897 Full duration: 30.157417 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } } } -------------------------------------------------------------------------------- Task df596e9c-7e3f-4a72-97ae-1ed21f57ccd7 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.076 | 1.076 | 1.076 | 1.076 | 1.076 | 1.076 | 100.0% | 1 | | neutron.list_networks | 0.28 | 0.28 | 0.28 | 0.28 | 0.28 | 0.28 | 100.0% | 1 | | total | 1.356 | 1.356 | 1.356 | 1.356 | 1.356 | 1.356 | 100.0% | 1 | | -> duration | 1.356 | 1.356 | 1.356 | 1.356 | 1.356 | 1.356 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.356272 Full duration: 16.695632 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "port": -1 } } } } -------------------------------------------------------------------------------- Task df596e9c-7e3f-4a72-97ae-1ed21f57ccd7 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 17.953352 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "router_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } } } -------------------------------------------------------------------------------- Task df596e9c-7e3f-4a72-97ae-1ed21f57ccd7 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 10.414825 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1 } } } } -------------------------------------------------------------------------------- Task df596e9c-7e3f-4a72-97ae-1ed21f57ccd7 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 10.257524 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } } } -------------------------------------------------------------------------------- Task df596e9c-7e3f-4a72-97ae-1ed21f57ccd7 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.989 | 0.989 | 0.989 | 0.989 | 0.989 | 0.989 | 100.0% | 1 | | neutron.delete_security_group | 0.308 | 0.308 | 0.308 | 0.308 | 0.308 | 0.308 | 100.0% | 1 | | total | 1.298 | 1.298 | 1.298 | 1.298 | 1.298 | 1.298 | 100.0% | 1 | | -> duration | 1.298 | 1.298 | 1.298 | 1.298 | 1.298 | 1.298 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.297553 Full duration: 14.701681 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } } } -------------------------------------------------------------------------------- Task df596e9c-7e3f-4a72-97ae-1ed21f57ccd7 has 1 error(s) -------------------------------------------------------------------------------- Conflict: Security Group 3a60f56a-332f-467d-b2a8-bf09c31ddcaf cannot perform precommit_delete due to Callback networking_odl.common.callback.OdlSecurityGroupsHandler.sg_callback_precommit--9223372036854540683 failed with "argument of type 'NoneType' is not iterable". Neutron server returns request_ids: ['req-4e1951a9-13ec-48c0-b1f1-79a459fa2fe7'] Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python2.7/site-packages/rally/plugins/openstack/scenarios/neutron/security_groups.py", line 236, in run self._delete_security_group(security_group) File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 87, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally/plugins/openstack/scenarios/neutron/utils.py", line 631, in _delete_security_group security_group["security_group"]["id"]) File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 962, in delete_security_group return self.delete(self.security_group_path % (security_group)) File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 348, in delete headers=headers, params=params) File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 329, in retry_request headers=headers, params=params) File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 292, in do_request self._handle_fault_response(status_code, replybody, resp) File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 268, in _handle_fault_response exception_handler_v20(status_code, error_body) File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 92, in exception_handler_v20 request_ids=request_ids) Conflict: Security Group 3a60f56a-332f-467d-b2a8-bf09c31ddcaf cannot perform precommit_delete due to Callback networking_odl.common.callback.OdlSecurityGroupsHandler.sg_callback_precommit--9223372036854540683 failed with "argument of type 'NoneType' is not iterable". Neutron server returns request_ids: ['req-4e1951a9-13ec-48c0-b1f1-79a459fa2fe7'] -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.986 | 0.986 | 0.986 | 0.986 | 0.986 | 0.986 | 100.0% | 1 | | neutron.create_security_group_rule | 0.347 | 0.347 | 0.347 | 0.347 | 0.347 | 0.347 | 100.0% | 1 | | neutron.delete_security_group_rule | 0.26 | 0.26 | 0.26 | 0.26 | 0.26 | 0.26 | 100.0% | 1 | | neutron.delete_security_group | 0.104 | 0.104 | 0.104 | 0.104 | 0.104 | 0.104 | 0.0% | 1 | | total | 1.698 | 1.698 | 1.698 | 1.698 | 1.698 | 1.698 | 0.0% | 1 | | -> duration | 1.698 | 1.698 | 1.698 | 1.698 | 1.698 | 1.698 | 0.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0% | 1 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.697809 Full duration: 16.732762 HINTS: * To plot HTML graphics with this data, run: rally task report df596e9c-7e3f-4a72-97ae-1ed21f57ccd7 --out output.html * To generate a JUnit report, run: rally task export df596e9c-7e3f-4a72-97ae-1ed21f57ccd7 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report df596e9c-7e3f-4a72-97ae-1ed21f57ccd7 --json --out output.json 2018-04-07 19:41:00,333 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'df596e9c-7e3f-4a72-97ae-1ed21f57ccd7'] 2018-04-07 19:41:01,360 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-07 19:41:01,360 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'df596e9c-7e3f-4a72-97ae-1ed21f57ccd7', '--out', u'/home/opnfv/functest/results/rally/opnfv-neutron.html'] 2018-04-07 19:41:01,368 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" Failed. 2018-04-07 19:41:01,369 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2018-04-07 19:41:01,369 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-nova.yaml 2018-04-07 19:41:01,369 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-07 19:41:01,418 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-04-07 19:41:01,426 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['nova'], 'concurrency': 4, 'netid': '908e9bc6-e401-4a98-86d9-a7a732ca206e', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-0e89a36a-26b3-4688-9df6-9ca1a7bda4d9', 'flavor_name': 'rally-tiny-0e89a36a-26b3-4688-9df6-9ca1a7bda4d9', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-0e89a36a-26b3-4688-9df6-9ca1a7bda4d9', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-07 19:44:05,382 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : d3a32b4e-29aa-4941-aff8-655a0c116300 2018-04-07 19:44:05,382 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'd3a32b4e-29aa-4941-aff8-655a0c116300'] 2018-04-07 19:44:06,296 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task d3a32b4e-29aa-4941-aff8-655a0c116300: aborted -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_live_migrate_server args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "flavor": { "name": "rally-tiny-0e89a36a-26b3-4688-9df6-9ca1a7bda4d9" }, "image": { "name": "Cirros-0.4.0-0e89a36a-26b3-4688-9df6-9ca1a7bda4d9" }, "block_migration": false, "nics": [ { "net-id": "908e9bc6-e401-4a98-86d9-a7a732ca206e" } ] }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task d3a32b4e-29aa-4941-aff8-655a0c116300 has 1 error(s) -------------------------------------------------------------------------------- RallyException: Live Migration failed: Migration complete but instance did not change host: overcloud-novacompute-1.opnfvlf.org Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python2.7/site-packages/rally/plugins/openstack/scenarios/nova/servers.py", line 722, in run block_migration, disk_over_commit) File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 87, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally/plugins/openstack/scenarios/nova/utils.py", line 770, in _live_migrate "but instance did not change host: %s" % host_pre_migrate) RallyException: Live Migration failed: Migration complete but instance did not change host: overcloud-novacompute-1.opnfvlf.org -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 9.834 | 9.834 | 9.834 | 9.834 | 9.834 | 9.834 | 100.0% | 1 | | nova.find_host_to_migrate | 1.385 | 1.385 | 1.385 | 1.385 | 1.385 | 1.385 | 100.0% | 1 | | nova.live_migrate | 133.707 | 133.707 | 133.707 | 133.707 | 133.707 | 133.707 | 0.0% | 1 | | total | 144.926 | 144.926 | 144.926 | 144.926 | 144.926 | 144.926 | 0.0% | 1 | | -> duration | 143.926 | 143.926 | 143.926 | 143.926 | 143.926 | 143.926 | 0.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 0.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 143.925668 Full duration: 160.654741 HINTS: * To plot HTML graphics with this data, run: rally task report d3a32b4e-29aa-4941-aff8-655a0c116300 --out output.html * To generate a JUnit report, run: rally task export d3a32b4e-29aa-4941-aff8-655a0c116300 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report d3a32b4e-29aa-4941-aff8-655a0c116300 --json --out output.json 2018-04-07 19:44:06,297 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'd3a32b4e-29aa-4941-aff8-655a0c116300'] 2018-04-07 19:44:07,318 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-07 19:44:07,318 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'd3a32b4e-29aa-4941-aff8-655a0c116300', '--out', u'/home/opnfv/functest/results/rally/opnfv-nova.html'] 2018-04-07 19:44:07,325 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" Failed. 2018-04-07 19:44:07,326 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2018-04-07 19:44:07,326 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-quotas.yaml 2018-04-07 19:44:07,326 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-07 19:44:07,382 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-04-07 19:44:07,384 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['quotas'], 'concurrency': 4, 'netid': '908e9bc6-e401-4a98-86d9-a7a732ca206e', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-0e89a36a-26b3-4688-9df6-9ca1a7bda4d9', 'flavor_name': 'rally-tiny-0e89a36a-26b3-4688-9df6-9ca1a7bda4d9', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-0e89a36a-26b3-4688-9df6-9ca1a7bda4d9', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-07 19:45:00,822 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 010003b8-4b7f-40d2-ba98-c949d5f22ac7 2018-04-07 19:45:00,822 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '010003b8-4b7f-40d2-ba98-c949d5f22ac7'] 2018-04-07 19:45:01,834 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 010003b8-4b7f-40d2-ba98-c949d5f22ac7: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 010003b8-4b7f-40d2-ba98-c949d5f22ac7 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.705 | 0.705 | 0.705 | 0.705 | 0.705 | 0.705 | 100.0% | 1 | | quotas.delete_quotas | 0.19 | 0.19 | 0.19 | 0.19 | 0.19 | 0.19 | 100.0% | 1 | | total | 0.896 | 0.896 | 0.896 | 0.896 | 0.896 | 0.896 | 100.0% | 1 | | -> duration | 0.896 | 0.896 | 0.896 | 0.896 | 0.896 | 0.896 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.895516 Full duration: 8.597569 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 010003b8-4b7f-40d2-ba98-c949d5f22ac7 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.697 | 0.697 | 0.697 | 0.697 | 0.697 | 0.697 | 100.0% | 1 | | total | 0.697 | 0.697 | 0.697 | 0.697 | 0.697 | 0.697 | 100.0% | 1 | | -> duration | 0.697 | 0.697 | 0.697 | 0.697 | 0.697 | 0.697 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.697153 Full duration: 8.390854 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 010003b8-4b7f-40d2-ba98-c949d5f22ac7 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.348 | 0.348 | 0.348 | 0.348 | 0.348 | 0.348 | 100.0% | 1 | | total | 0.75 | 0.75 | 0.75 | 0.75 | 0.75 | 0.75 | 100.0% | 1 | | -> duration | 0.75 | 0.75 | 0.75 | 0.75 | 0.75 | 0.75 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.750337 Full duration: 8.792846 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 010003b8-4b7f-40d2-ba98-c949d5f22ac7 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.015 | 1.015 | 1.015 | 1.015 | 1.015 | 1.015 | 100.0% | 1 | | total | 1.015 | 1.015 | 1.015 | 1.015 | 1.015 | 1.015 | 100.0% | 1 | | -> duration | 1.015 | 1.015 | 1.015 | 1.015 | 1.015 | 1.015 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.01474 Full duration: 8.891565 HINTS: * To plot HTML graphics with this data, run: rally task report 010003b8-4b7f-40d2-ba98-c949d5f22ac7 --out output.html * To generate a JUnit report, run: rally task export 010003b8-4b7f-40d2-ba98-c949d5f22ac7 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 010003b8-4b7f-40d2-ba98-c949d5f22ac7 --json --out output.json 2018-04-07 19:45:01,835 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '010003b8-4b7f-40d2-ba98-c949d5f22ac7'] 2018-04-07 19:45:02,689 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-07 19:45:02,689 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '010003b8-4b7f-40d2-ba98-c949d5f22ac7', '--out', u'/home/opnfv/functest/results/rally/opnfv-quotas.html'] 2018-04-07 19:45:02,696 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2018-04-07 19:45:02,699 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:46 | 6 | 100.00% | | glance | 01:46 | 4 | 100.00% | | cinder | 02:48 | 10 | 100.00% | | heat | 01:01 | 4 | 100.00% | | keystone | 02:49 | 11 | 100.00% | | neutron | 03:22 | 7 | 85.71% | | nova | 02:40 | 1 | 0.00% | | quotas | 00:34 | 4 | 100.00% | | | | | | | TOTAL: | 00:15:50 | 47 | 95.74% | +----------------+------------+----------------+-----------+ 2018-04-07 19:45:02,699 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_sanity' success_rate is 95.74% 2018-04-07 19:45:10,598 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-07 19:45:10,598 - xtesting.ci.run_tests - INFO - Test result: +----------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +----------------------+------------------+------------------+----------------+ | rally_sanity | functest | 19:44 | FAIL | +----------------------+------------------+------------------+----------------+ 2018-04-07 19:45:10,603 - xtesting.ci.run_tests - ERROR - The test case 'rally_sanity' failed. 2018-04-07 19:45:10,603 - xtesting.ci.run_tests - INFO - Running test case 'refstack_defcore'... 2018-04-07 19:45:10,696 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-04-07 19:45:13,127 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-04-07 19:45:12.809 8831 INFO rally.deployment.engine [-] Deployment 7d0ad23a-b9b3-427d-b818-5c07381cd15a | Starting: Destroy cloud and free allocated resources. 2018-04-07 19:45:12.888 8831 INFO rally.deployment.engine [-] Deployment 7d0ad23a-b9b3-427d-b818-5c07381cd15a | Completed: Destroy cloud and free allocated resources. 2018-04-07 19:45:12.912 8831 INFO rally.api [-] Deleting deployment-specific data for verifier 'opnfv-tempest' (UUID=e79780f8-f5e1-45ef-aaac-6e53c64d6a04). 2018-04-07 19:45:12.917 8831 INFO rally.api [-] Deployment-specific data has been successfully deleted! 2018-04-07 19:45:15,521 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-04-07 19:45:15.217 8834 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=2447509a-dcb0-4926-8be9-4999bf94896b) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | 2447509a-dcb0-4926-8be9-4999bf94896b | 2018-04-07T19:45:15 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: 2447509a-dcb0-4926-8be9-4999bf94896b ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-04-07 19:45:18,717 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | key-manager | Available | | __unknown__ | placement | Available | | __unknown__ | policy | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+----------------+-----------+ 2018-04-07 19:45:18,717 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-04-07 19:45:21,009 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify delete-verifier --id opnfv-tempest --force 2018-04-07 19:45:20.731 8840 INFO rally.api [-] Deleting verifier 'opnfv-tempest' (UUID=e79780f8-f5e1-45ef-aaac-6e53c64d6a04). 2018-04-07 19:45:20.858 8840 INFO rally.api [-] Verifier has been successfully deleted! 2018-04-07 19:45:24,306 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide 2018-04-07 19:45:23.028 8843 INFO rally.api [-] Creating verifier 'opnfv-tempest'. 2018-04-07 19:45:23.127 8843 INFO rally.verification.manager [-] Cloning verifier repo from /src/tempest. 2018-04-07 19:45:24.140 8843 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=c60c89a9-4557-4317-a338-4fad92c843b9) has been successfully created! Using verifier 'opnfv-tempest' (UUID=c60c89a9-4557-4317-a338-4fad92c843b9) as the default verifier for the future CLI operations. 2018-04-07 19:45:27,366 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-04-07 19:45:30,030 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating two images for Tempest suite 2018-04-07 19:45:36,741 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-04-07 19:45:41,810 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-04-07 19:45:40.769 8862 INFO rally.api [-] Configuring verifier 'opnfv-tempest' (UUID=c60c89a9-4557-4317-a338-4fad92c843b9) for deployment 'opnfv-rally' (UUID=2447509a-dcb0-4926-8be9-4999bf94896b). 2018-04-07 19:45:41.645 8862 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=c60c89a9-4557-4317-a338-4fad92c843b9) has been successfully configured for deployment 'opnfv-rally' (UUID=2447509a-dcb0-4926-8be9-4999bf94896b)! 2018-04-07 19:45:41,810 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-04-07 19:45:41,811 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-04-07 19:45:41,813 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-04-07 19:45:44,020 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', u'/home/opnfv/functest/results/refstack/tempest-list.txt']'. 2018-04-07 19:45:46,057 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:45:46.057 8874 INFO rally.api [-] Starting verification (UUID=4f061ef9-6d46-4b7a-861c-cb0f6d956dad) for deployment 'opnfv-rally' (UUID=2447509a-dcb0-4926-8be9-4999bf94896b) by verifier 'opnfv-tempest' (UUID=c60c89a9-4557-4317-a338-4fad92c843b9). 2018-04-07 19:45:46,057 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Verification UUID: 4f061ef9-6d46-4b7a-861c-cb0f6d956dad 2018-04-07 19:45:54,800 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:45:54.799 8874 INFO opnfv-tempest [-] {4} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.214s] 2018-04-07 19:45:54,872 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:45:54.872 8874 INFO opnfv-tempest [-] {4} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_with_detail ... success [0.072s] 2018-04-07 19:45:54,932 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:45:54.932 8874 INFO opnfv-tempest [-] {14} tempest.api.identity.v3.test_tokens.TokensV3Test.test_create_token ... success [0.314s] 2018-04-07 19:45:55,479 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:45:55.478 8874 INFO opnfv-tempest [-] {9} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [0.936s] 2018-04-07 19:45:57,652 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:45:57.652 8874 INFO opnfv-tempest [-] {9} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [2.173s] 2018-04-07 19:45:59,388 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:45:59.387 8874 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.073s] 2018-04-07 19:45:59,479 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:45:59.479 8874 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.091s] 2018-04-07 19:45:59,558 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:45:59.558 8874 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.079s] 2018-04-07 19:46:01,347 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:01.346 8874 INFO opnfv-tempest [-] {14} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [1.785s] 2018-04-07 19:46:04,071 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:04.071 8874 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_image_null_id ... success [0.158s] 2018-04-07 19:46:04,238 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:04.238 8874 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_non_existing_image ... success [0.166s] 2018-04-07 19:46:05,052 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:05.051 8874 INFO opnfv-tempest [-] {10} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON ... fail 2018-04-07 19:46:05,509 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:05.509 8874 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_with_nonexistent_volume_id ... success [0.195s] 2018-04-07 19:46:05,562 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:05.562 8874 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_delete_deleted_image ... success [1.323s] 2018-04-07 19:46:05,711 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:05.711 8874 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_without_passing_volume_id ... success [0.202s] 2018-04-07 19:46:05,723 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:05.723 8874 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_image_null_id ... success [0.161s] 2018-04-07 19:46:05,980 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:05.980 8874 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_non_existent_image ... success [0.256s] 2018-04-07 19:46:10,578 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:10.577 8874 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_invalid_size ... success [0.202s] 2018-04-07 19:46:10,764 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:10.764 8874 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_snapshot_id ... success [0.186s] 2018-04-07 19:46:10,949 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:10.948 8874 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_source_volid ... success [0.184s] 2018-04-07 19:46:11,106 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:11.105 8874 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_volume_type ... success [0.156s] 2018-04-07 19:46:11,267 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:11.267 8874 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_negative ... success [0.161s] 2018-04-07 19:46:11,434 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:11.434 8874 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_zero ... success [0.166s] 2018-04-07 19:46:11,759 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:11.758 8874 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_without_passing_size ... success [0.323s] 2018-04-07 19:46:11,793 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:11.792 8874 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_invalid_volume_id ... success [0.034s] 2018-04-07 19:46:11,972 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:11.971 8874 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_volume_without_passing_volume_id ... success [0.178s] 2018-04-07 19:46:12,005 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:12.005 8874 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id ... success [0.032s] 2018-04-07 19:46:12,273 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:12.273 8874 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id ... success [0.267s] 2018-04-07 19:46:12,476 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:12.476 8874 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_invalid_status ... success [0.203s] 2018-04-07 19:46:12,544 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:12.543 8874 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_nonexistent_name ... success [0.068s] 2018-04-07 19:46:12,585 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:12.585 8874 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_invalid_status ... success [0.040s] 2018-04-07 19:46:12,777 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:12.777 8874 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_nonexistent_name ... success [0.192s] 2018-04-07 19:46:13,174 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:13.174 8874 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_reserve_volume_with_negative_volume_status ... success [0.396s] 2018-04-07 19:46:13,347 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:13.347 8874 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_reserve_volume_with_nonexistent_volume_id ... success [0.173s] 2018-04-07 19:46:13,720 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:13.719 8874 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_unreserve_volume_with_nonexistent_volume_id ... success [0.372s] 2018-04-07 19:46:13,729 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:13.729 8874 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_empty_volume_id ... success [0.009s] 2018-04-07 19:46:13,895 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:13.895 8874 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_invalid_volume_id ... success [0.166s] 2018-04-07 19:46:14,069 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:14.068 8874 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_nonexistent_volume_id ... success [0.172s] 2018-04-07 19:46:14,102 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:14.101 8874 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_delete_nonexistent_volume_id ... success [0.033s] 2018-04-07 19:46:14,135 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:14.135 8874 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_get_nonexistent_volume_id ... success [0.033s] 2018-04-07 19:46:14,648 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:14.648 8874 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON ... fail 2018-04-07 19:46:15,119 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:15.118 8874 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor ... success [0.821s] 2018-04-07 19:46:15,958 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:15.957 8874 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image ... success [0.837s] 2018-04-07 19:46:16,541 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:16.540 8874 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name ... success [0.583s] 2018-04-07 19:46:17,240 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:17.240 8874 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status ... success [0.698s] 2018-04-07 19:46:17,604 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:17.604 8874 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results ... success [0.364s] 2018-04-07 19:46:17,673 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:17.672 8874 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_active_status ... success [0.068s] 2018-04-07 19:46:17,749 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:17.749 8874 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor ... success [0.076s] 2018-04-07 19:46:17,820 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:17.819 8874 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image ... success [0.069s] 2018-04-07 19:46:17,890 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:17.889 8874 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit ... success [0.069s] 2018-04-07 19:46:17,963 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:17.963 8874 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name ... success [0.072s] 2018-04-07 19:46:18,103 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:18.102 8874 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard ... success [0.139s] 2018-04-07 19:46:25,630 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:25.630 8874 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item ... success [0.863s] 2018-04-07 19:46:25,885 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:25.884 8874 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item ... success [0.254s] 2018-04-07 19:46:26,110 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:26.109 8874 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata ... success [0.225s] 2018-04-07 19:46:26,523 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:26.522 8874 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata ... success [0.412s] 2018-04-07 19:46:27,065 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:27.065 8874 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item ... success [0.542s] 2018-04-07 19:46:27,626 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:27.626 8874 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata ... success [0.561s] 2018-04-07 19:46:32,272 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:32.272 8874 INFO opnfv-tempest [-] {7} tempest.api.volume.test_extensions.ExtensionsTestJSON.test_list_extensions ... success [0.642s] 2018-04-07 19:46:35,824 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:35.824 8874 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.656s] 2018-04-07 19:46:37,722 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:37.721 8874 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_additional_args ... success [1.897s] 2018-04-07 19:46:40,893 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:40.892 8874 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_icmp_type_code ... success [3.167s] 2018-04-07 19:46:42,132 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:42.131 8874 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_protocol_integer_value ... success [1.241s] 2018-04-07 19:46:44,754 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:44.754 8874 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_group_id ... success [2.620s] 2018-04-07 19:46:45,953 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:45.953 8874 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_ip_prefix ... success [1.199s] 2018-04-07 19:46:47,620 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:47.619 8874 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [1.664s] 2018-04-07 19:46:47,667 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:46:47.667 8874 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.050s] 2018-04-07 19:46:51,021 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', '4f061ef9-6d46-4b7a-861c-cb0f6d956dad']'. 2018-04-07 19:46:51,857 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2018-04-07 19:46:51,857 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2018-04-07 19:46:51,858 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-04-07 19:46:51,858 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | 4f061ef9-6d46-4b7a-861c-cb0f6d956dad | 2018-04-07 19:46:51,858 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | failed | 2018-04-07 19:46:51,858 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2018-04-07 19:45:45 | 2018-04-07 19:46:51,858 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2018-04-07 19:46:50 | 2018-04-07 19:46:51,858 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 0:01:05 | 2018-04-07 19:46:51,858 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | load_list: (value is too long, use 'detailed' flag to display it) | 2018-04-07 19:46:51,858 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2018-04-07 19:46:51,858 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: c60c89a9-4557-4317-a338-4fad92c843b9) | 2018-04-07 19:46:51,859 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2018-04-07 19:46:51,859 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: 2447509a-dcb0-4926-8be9-4999bf94896b) | 2018-04-07 19:46:51,859 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 72 | 2018-04-07 19:46:51,859 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 55.096 | 2018-04-07 19:46:51,859 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 65 | 2018-04-07 19:46:51,859 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 0 | 2018-04-07 19:46:51,859 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2018-04-07 19:46:51,859 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2018-04-07 19:46:51,859 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 7 | 2018-04-07 19:46:51,859 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-04-07 19:46:51,859 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +--------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2018-04-07 19:46:51,891 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest refstack_defcore success_rate is 90.2777777778% 2018-04-07 19:46:58,355 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-07 19:46:58,356 - xtesting.ci.run_tests - INFO - Test result: +--------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------------+------------------+------------------+----------------+ | refstack_defcore | functest | 01:31 | FAIL | +--------------------------+------------------+------------------+----------------+ 2018-04-07 19:46:58,360 - xtesting.ci.run_tests - ERROR - The test case 'refstack_defcore' failed. 2018-04-07 19:46:58,360 - xtesting.ci.run_tests - INFO - Running test case 'patrole'... 2018-04-07 19:46:58,456 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-04-07 19:47:00,964 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-04-07 19:47:00.535 8964 INFO rally.deployment.engine [-] Deployment 2447509a-dcb0-4926-8be9-4999bf94896b | Starting: Destroy cloud and free allocated resources. 2018-04-07 19:47:00.637 8964 INFO rally.deployment.engine [-] Deployment 2447509a-dcb0-4926-8be9-4999bf94896b | Completed: Destroy cloud and free allocated resources. 2018-04-07 19:47:00.672 8964 INFO rally.api [-] Deleting all verifications created by verifier 'opnfv-tempest' (UUID=c60c89a9-4557-4317-a338-4fad92c843b9) for deployment 'opnfv-rally'. 2018-04-07 19:47:00.686 8964 INFO rally.api [-] Deleting verification (UUID=4f061ef9-6d46-4b7a-861c-cb0f6d956dad). 2018-04-07 19:47:00.724 8964 INFO rally.api [-] Verification has been successfully deleted! 2018-04-07 19:47:00.724 8964 INFO rally.api [-] Deleting deployment-specific data for verifier 'opnfv-tempest' (UUID=c60c89a9-4557-4317-a338-4fad92c843b9). 2018-04-07 19:47:00.732 8964 INFO rally.api [-] Deployment-specific data has been successfully deleted! 2018-04-07 19:47:03,268 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-04-07 19:47:02.997 8967 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=3f84deff-af70-462f-8255-bfa92b4f0896) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | 3f84deff-af70-462f-8255-bfa92b4f0896 | 2018-04-07T19:47:02 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: 3f84deff-af70-462f-8255-bfa92b4f0896 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-04-07 19:47:06,670 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | key-manager | Available | | __unknown__ | placement | Available | | __unknown__ | policy | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+----------------+-----------+ 2018-04-07 19:47:06,670 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-04-07 19:47:08,953 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify delete-verifier --id opnfv-tempest --force 2018-04-07 19:47:08.691 8973 INFO rally.api [-] Deleting verifier 'opnfv-tempest' (UUID=c60c89a9-4557-4317-a338-4fad92c843b9). 2018-04-07 19:47:08.828 8973 INFO rally.api [-] Verifier has been successfully deleted! 2018-04-07 19:47:12,059 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide 2018-04-07 19:47:10.787 8976 INFO rally.api [-] Creating verifier 'opnfv-tempest'. 2018-04-07 19:47:10.948 8976 INFO rally.verification.manager [-] Cloning verifier repo from /src/tempest. 2018-04-07 19:47:11.888 8976 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=8bc94321-0670-428d-bc6c-00147d8a7a68) has been successfully created! Using verifier 'opnfv-tempest' (UUID=8bc94321-0670-428d-bc6c-00147d8a7a68) as the default verifier for the future CLI operations. 2018-04-07 19:47:14,957 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-04-07 19:47:17,370 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating two images for Tempest suite 2018-04-07 19:47:24,039 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-04-07 19:47:29,258 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-04-07 19:47:28.155 8995 INFO rally.api [-] Configuring verifier 'opnfv-tempest' (UUID=8bc94321-0670-428d-bc6c-00147d8a7a68) for deployment 'opnfv-rally' (UUID=3f84deff-af70-462f-8255-bfa92b4f0896). 2018-04-07 19:47:29.114 8995 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=8bc94321-0670-428d-bc6c-00147d8a7a68) has been successfully configured for deployment 'opnfv-rally' (UUID=3f84deff-af70-462f-8255-bfa92b4f0896)! 2018-04-07 19:47:29,258 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-04-07 19:47:29,259 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-04-07 19:47:29,261 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-04-07 19:47:29,274 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Generating test case list... 2018-04-07 19:47:32,308 - functest.opnfv_tests.openstack.tempest.tempest - INFO - (cd /root/.rally/verification/verifier-8bc94321-0670-428d-bc6c-00147d8a7a68/repo; testr list-tests '(?!.*test_networks_multiprovider_rbac)(?=patrole_tempest_plugin.tests.api.(image|network|volume))' >/home/opnfv/functest/results/patrole/tempest-list.txt 2>/dev/null) 2018-04-07 19:47:32,309 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', u'/home/opnfv/functest/results/patrole/tempest-list.txt']'. 2018-04-07 19:47:34,218 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 19:47:34.217 9004 INFO rally.api [-] Starting verification (UUID=973e9061-e6eb-47ab-9792-71d6e2aba062) for deployment 'opnfv-rally' (UUID=3f84deff-af70-462f-8255-bfa92b4f0896) by verifier 'opnfv-tempest' (UUID=8bc94321-0670-428d-bc6c-00147d8a7a68). 2018-04-07 19:47:34,218 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Verification UUID: 973e9061-e6eb-47ab-9792-71d6e2aba062 2018-04-07 19:50:14,275 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', '973e9061-e6eb-47ab-9792-71d6e2aba062']'. 2018-04-07 19:50:15,230 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2018-04-07 19:50:15,230 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2018-04-07 19:50:15,231 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-04-07 19:50:15,231 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | 973e9061-e6eb-47ab-9792-71d6e2aba062 | 2018-04-07 19:50:15,231 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | failed | 2018-04-07 19:50:15,231 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2018-04-07 19:47:34 | 2018-04-07 19:50:15,231 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2018-04-07 19:50:13 | 2018-04-07 19:50:15,231 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 0:02:39 | 2018-04-07 19:50:15,231 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | load_list: (value is too long, use 'detailed' flag to display it) | 2018-04-07 19:50:15,231 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2018-04-07 19:50:15,231 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: 8bc94321-0670-428d-bc6c-00147d8a7a68) | 2018-04-07 19:50:15,231 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2018-04-07 19:50:15,232 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: 3f84deff-af70-462f-8255-bfa92b4f0896) | 2018-04-07 19:50:15,232 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 287 | 2018-04-07 19:50:15,232 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 150.123 | 2018-04-07 19:50:15,232 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 122 | 2018-04-07 19:50:15,232 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 163 | 2018-04-07 19:50:15,232 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2018-04-07 19:50:15,232 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2018-04-07 19:50:15,232 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 2 | 2018-04-07 19:50:15,232 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-04-07 19:50:15,232 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2018-04-07 19:50:15,387 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest patrole success_rate is 98.3870967742% 2018-04-07 19:50:22,597 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-07 19:50:22,598 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | patrole | functest | 03:08 | FAIL | +-------------------+------------------+------------------+----------------+ 2018-04-07 19:50:22,601 - xtesting.ci.run_tests - ERROR - The test case 'patrole' failed. 2018-04-07 19:50:22,602 - xtesting.ci.run_tests - INFO - Running test case 'odl'... 2018-04-07 19:50:43,604 - xtesting.core.robotframework - INFO - ============================================================================== Basic & Neutron ============================================================================== Basic & Neutron.Basic ============================================================================== Basic & Neutron.Basic.Restconf Modules :: Test suite to verify Restconf is OK. ============================================================================== Get Controller Modules :: Get the restconf modules, check 200 stat... | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Basic.Restconf Modules :: Test suite to verify Res... | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Basic & Neutron.Basic | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Basic & Neutron.Neutron :: Test suite for Neutron Plugin ============================================================================== Basic & Neutron.Neutron.Reachability ============================================================================== Get the complete list of networks :: Get the complete list of netw... | PASS | ------------------------------------------------------------------------------ Get the complete list of subnets :: Get the complete list of subnets | PASS | ------------------------------------------------------------------------------ Get the complete list of ports :: Get the complete list of ports | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Reachability | PASS | 3 critical tests, 3 passed, 0 failed 3 tests total, 3 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Networks :: Checking Network created in OpenStack a... ============================================================================== Check OpenStack Networks :: Checking OpenStack Neutron for known n... | PASS | ------------------------------------------------------------------------------ Check OpenDaylight Networks :: Checking OpenDaylight Neutron API f... | PASS | ------------------------------------------------------------------------------ Create Network :: Create new network in OpenStack | PASS | ------------------------------------------------------------------------------ Check Network :: Check network created in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Networks :: Checking Network created in Op... | PASS | 4 critical tests, 4 passed, 0 failed 4 tests total, 4 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Subnets :: Checking Subnets created in OpenStack ar... ============================================================================== Check OpenStack Subnets :: Checking OpenStack Neutron for known su... | PASS | ------------------------------------------------------------------------------ Check OpenDaylight subnets :: Checking OpenDaylight Neutron API fo... | PASS | ------------------------------------------------------------------------------ Create New subnet :: Create new subnet in OpenStack | PASS | ------------------------------------------------------------------------------ Check New subnet :: Check new subnet created in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Subnets :: Checking Subnets created in Ope... | PASS | 4 critical tests, 4 passed, 0 failed 4 tests total, 4 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Ports :: Checking Port created in OpenStack are pus... ============================================================================== Check OpenStack ports :: Checking OpenStack Neutron for known ports | PASS | ------------------------------------------------------------------------------ Check OpenDaylight ports :: Checking OpenDaylight Neutron API for ... | PASS | ------------------------------------------------------------------------------ Create New Port :: Create new port in OpenStack | PASS | ------------------------------------------------------------------------------ Check New Port :: Check new port created in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Ports :: Checking Port created in OpenStac... | PASS | 4 critical tests, 4 passed, 0 failed 4 tests total, 4 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Delete Ports :: Checking Port deleted in OpenStack ... ============================================================================== Delete New Port :: Delete previously created port in OpenStack | PASS | ------------------------------------------------------------------------------ Check Port Deleted :: Check port deleted in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Delete Ports :: Checking Port deleted in O... | PASS | 2 critical tests, 2 passed, 0 failed 2 tests total, 2 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Delete Subnets :: Checking Subnets deleted in OpenS... ============================================================================== Delete New subnet :: Delete previously created subnet in OpenStack | PASS | ------------------------------------------------------------------------------ Check New subnet deleted :: Check subnet deleted in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Delete Subnets :: Checking Subnets deleted... | PASS | 2 critical tests, 2 passed, 0 failed 2 tests total, 2 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Delete Networks :: Checking Network deleted in Open... ============================================================================== Delete Network :: Delete network in OpenStack | PASS | ------------------------------------------------------------------------------ Check Network deleted :: Check network deleted in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Delete Networks :: Checking Network delete... | PASS | 2 critical tests, 2 passed, 0 failed 2 tests total, 2 passed, 0 failed ============================================================================== Basic & Neutron.Neutron :: Test suite for Neutron Plugin | PASS | 21 critical tests, 21 passed, 0 failed 21 tests total, 21 passed, 0 failed ============================================================================== Basic & Neutron | PASS | 22 critical tests, 22 passed, 0 failed 22 tests total, 22 passed, 0 failed ============================================================================== Output: /home/opnfv/functest/results/odl/output.xml 2018-04-07 19:50:43,604 - xtesting.core.robotframework - INFO - Results were successfully generated 2018-04-07 19:50:43,635 - xtesting.core.robotframework - INFO - Results were successfully parsed 2018-04-07 19:50:43,757 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-07 19:50:43,758 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | odl | functest | 00:20 | PASS | +-------------------+------------------+------------------+----------------+ 2018-04-07 19:50:43,762 - xtesting.ci.run_tests - INFO - Running test case 'snaps_smoke'... 2018-04-07 19:50:45,032 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-04-07 20:32:39,478 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-07 20:32:39,479 - xtesting.ci.run_tests - INFO - Test result: +---------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +---------------------+------------------+------------------+----------------+ | snaps_smoke | functest | 41:54 | FAIL | +---------------------+------------------+------------------+----------------+ 2018-04-07 20:32:39,482 - xtesting.ci.run_tests - ERROR - The test case 'snaps_smoke' failed. 2018-04-07 20:32:39,483 - xtesting.ci.run_tests - INFO - Running test case 'neutron_trunk'... 2018-04-07 20:32:39,580 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-04-07 20:32:42,130 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-04-07 20:32:41.671 9094 INFO rally.deployment.engine [-] Deployment 3f84deff-af70-462f-8255-bfa92b4f0896 | Starting: Destroy cloud and free allocated resources. 2018-04-07 20:32:41.770 9094 INFO rally.deployment.engine [-] Deployment 3f84deff-af70-462f-8255-bfa92b4f0896 | Completed: Destroy cloud and free allocated resources. 2018-04-07 20:32:41.827 9094 INFO rally.api [-] Deleting all verifications created by verifier 'opnfv-tempest' (UUID=8bc94321-0670-428d-bc6c-00147d8a7a68) for deployment 'opnfv-rally'. 2018-04-07 20:32:41.857 9094 INFO rally.api [-] Deleting verification (UUID=973e9061-e6eb-47ab-9792-71d6e2aba062). 2018-04-07 20:32:41.902 9094 INFO rally.api [-] Verification has been successfully deleted! 2018-04-07 20:32:41.902 9094 INFO rally.api [-] Deleting deployment-specific data for verifier 'opnfv-tempest' (UUID=8bc94321-0670-428d-bc6c-00147d8a7a68). 2018-04-07 20:32:41.913 9094 INFO rally.api [-] Deployment-specific data has been successfully deleted! 2018-04-07 20:32:44,541 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-04-07 20:32:44.232 9097 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=81db3d4b-d143-4e9f-b0fe-55979fea373d) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | 81db3d4b-d143-4e9f-b0fe-55979fea373d | 2018-04-07T20:32:44 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: 81db3d4b-d143-4e9f-b0fe-55979fea373d ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-04-07 20:32:47,735 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | key-manager | Available | | __unknown__ | placement | Available | | __unknown__ | policy | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+----------------+-----------+ 2018-04-07 20:32:47,736 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-04-07 20:32:50,121 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify delete-verifier --id opnfv-tempest --force 2018-04-07 20:32:49.849 9103 INFO rally.api [-] Deleting verifier 'opnfv-tempest' (UUID=8bc94321-0670-428d-bc6c-00147d8a7a68). 2018-04-07 20:32:49.991 9103 INFO rally.api [-] Verifier has been successfully deleted! 2018-04-07 20:32:53,688 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide 2018-04-07 20:32:52.195 9106 INFO rally.api [-] Creating verifier 'opnfv-tempest'. 2018-04-07 20:32:52.345 9106 INFO rally.verification.manager [-] Cloning verifier repo from /src/tempest. 2018-04-07 20:32:53.441 9106 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=b59d602b-421b-4642-b464-11736ba39837) has been successfully created! Using verifier 'opnfv-tempest' (UUID=b59d602b-421b-4642-b464-11736ba39837) as the default verifier for the future CLI operations. 2018-04-07 20:33:06,220 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-04-07 20:33:11,414 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-04-07 20:33:10.411 9125 INFO rally.api [-] Configuring verifier 'opnfv-tempest' (UUID=b59d602b-421b-4642-b464-11736ba39837) for deployment 'opnfv-rally' (UUID=81db3d4b-d143-4e9f-b0fe-55979fea373d). 2018-04-07 20:33:11.254 9125 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=b59d602b-421b-4642-b464-11736ba39837) has been successfully configured for deployment 'opnfv-rally' (UUID=81db3d4b-d143-4e9f-b0fe-55979fea373d)! 2018-04-07 20:33:15,677 - functest.opnfv_tests.openstack.tempest.tempest - INFO - (cd /root/.rally/verification/verifier-b59d602b-421b-4642-b464-11736ba39837/repo; testr list-tests 'neutron.tests.tempest.(api|scenario).test_trunk' >/home/opnfv/functest/results/neutron_trunk/test_list.txt 2>/dev/null) 2018-04-07 20:33:15,678 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', u'/home/opnfv/functest/results/neutron_trunk/test_list.txt']'. 2018-04-07 20:33:17,844 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-04-07 20:33:17.843 9134 INFO rally.api [-] Starting verification (UUID=4c27b793-e939-4fbd-a50a-eea7c0380ed8) for deployment 'opnfv-rally' (UUID=81db3d4b-d143-4e9f-b0fe-55979fea373d) by verifier 'opnfv-tempest' (UUID=b59d602b-421b-4642-b464-11736ba39837). 2018-04-07 20:35:12,002 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', '4c27b793-e939-4fbd-a50a-eea7c0380ed8']'. 2018-04-07 20:35:12,926 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2018-04-07 20:35:12,926 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2018-04-07 20:35:12,926 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-04-07 20:35:12,926 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | 4c27b793-e939-4fbd-a50a-eea7c0380ed8 | 2018-04-07 20:35:12,927 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | failed | 2018-04-07 20:35:12,927 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2018-04-07 20:33:17 | 2018-04-07 20:35:12,927 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2018-04-07 20:35:11 | 2018-04-07 20:35:12,927 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 0:01:54 | 2018-04-07 20:35:12,927 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | load_list: (value is too long, use 'detailed' flag to display it) | 2018-04-07 20:35:12,927 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2018-04-07 20:35:12,927 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: b59d602b-421b-4642-b464-11736ba39837) | 2018-04-07 20:35:12,927 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2018-04-07 20:35:12,927 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: 81db3d4b-d143-4e9f-b0fe-55979fea373d) | 2018-04-07 20:35:12,927 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 52 | 2018-04-07 20:35:12,927 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 101.713 | 2018-04-07 20:35:12,927 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 42 | 2018-04-07 20:35:12,927 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 8 | 2018-04-07 20:35:12,927 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2018-04-07 20:35:12,927 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2018-04-07 20:35:12,928 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 2 | 2018-04-07 20:35:12,928 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-04-07 20:35:12,928 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------------------------------------------------------------------+ 2018-04-07 20:35:12,946 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest neutron_trunk success_rate is 95.4545454545% 2018-04-07 20:35:20,525 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-07 20:35:20,526 - xtesting.ci.run_tests - INFO - Test result: +-----------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-----------------------+------------------+------------------+----------------+ | neutron_trunk | functest | 02:24 | FAIL | +-----------------------+------------------+------------------+----------------+ 2018-04-07 20:35:20,530 - xtesting.ci.run_tests - ERROR - The test case 'neutron_trunk' failed. 2018-04-07 20:35:20,531 - xtesting.ci.run_tests - INFO - Xtesting report: +------------------------------+------------------+---------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +------------------------------+------------------+---------------+------------------+----------------+ | vping_userdata | functest | smoke | 00:46 | PASS | | tempest_smoke_serial | functest | smoke | 13:33 | PASS | | rally_sanity | functest | smoke | 19:44 | FAIL | | refstack_defcore | functest | smoke | 01:31 | FAIL | | patrole | functest | smoke | 03:08 | FAIL | | odl | functest | smoke | 00:20 | PASS | | snaps_smoke | functest | smoke | 41:54 | FAIL | | neutron_trunk | functest | smoke | 02:24 | FAIL | | vping_ssh | functest | smoke | 00:00 | SKIP | | odl_netvirt | functest | smoke | 00:00 | SKIP | +------------------------------+------------------+---------------+------------------+----------------+ 2018-04-07 20:35:20,538 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR 2018-04-07 20:35:23,299 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-apex-baremetal-daily-master-110 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-odl-bgpvpn-ha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod1 | +--------------------------------------+----------------------------------------------------------+ 2018-04-07 20:35:23,302 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Clear any old environment that may conflict. for key in $( set | awk '{FS="="} /^OS_/ {print $1}' ); do unset $key ; done export OS_USERNAME=admin export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_BAREMETAL_API_VERSION=1.34 export NOVA_VERSION=1.1 export OS_PROJECT_NAME=admin export OS_PASSWORD=wCjXvd9xErUHZxR7ZmGsHVpnc export OS_NO_CACHE=True export COMPUTE_API_VERSION=1.1 export no_proxy=,172.30.9.22,192.30.9.6 export OS_VOLUME_API_VERSION=3 export OS_CLOUDNAME=overcloud export OS_AUTH_URL=http://172.30.9.22:5000/v3 export IRONIC_API_VERSION=1.34 export OS_IDENTITY_API_VERSION=3 export OS_IMAGE_API_VERSION=2 export OS_AUTH_TYPE=password export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available" # Add OS_CLOUDNAME to PS1 if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then export PS1=${PS1:-""} export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1 export CLOUDPROMPT_ENABLED=1 fi export SDN_CONTROLLER_IP=192.30.9.6 export OS_REGION_NAME=regionOne 2018-04-07 20:35:23,302 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-04-07 20:35:23,302 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +------------------+---------------+--------------------------+-------------------------------------------+------------------------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +------------------+---------------+--------------------------+-------------------------------------------+------------------------------------+ | features | 2 | (daily)|(weekly) | Test suites from feature projects | doctor-notification bgpvpn | | | | | integrated in functest | | +------------------+---------------+--------------------------+-------------------------------------------+------------------------------------+ 2018-04-07 20:35:23,303 - xtesting.ci.run_tests - INFO - Running tier 'features' 2018-04-07 20:35:23,303 - xtesting.ci.run_tests - INFO - Running test case 'doctor-notification'... 2018-04-07 20:39:52,335 - xtesting.core.feature - INFO - Test result is stored in '/var/lib/xtesting/results/doctor-notification.log' 2018-04-07 20:39:52,462 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-07 20:39:52,463 - xtesting.ci.run_tests - INFO - Test result: +-----------------------------+-----------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-----------------------------+-----------------+------------------+----------------+ | doctor-notification | doctor | 04:29 | PASS | +-----------------------------+-----------------+------------------+----------------+ 2018-04-07 20:39:52,466 - xtesting.ci.run_tests - INFO - Running test case 'bgpvpn'... 2018-04-07 20:57:50,671 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-04-07 20:57:59,606 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-04-07 20:57:59.295 151 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=fc8e3912-f62c-4aed-b337-517285698533) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | fc8e3912-f62c-4aed-b337-517285698533 | 2018-04-07T20:57:59 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: fc8e3912-f62c-4aed-b337-517285698533 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-04-07 20:58:02,876 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | key-manager | Available | | __unknown__ | placement | Available | | __unknown__ | policy | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+----------------+-----------+ 2018-04-07 20:58:02,877 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-04-07 20:58:08,905 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide 2018-04-07 20:58:07.013 160 INFO rally.api [-] Creating verifier 'opnfv-tempest'. 2018-04-07 20:58:07.143 160 INFO rally.verification.manager [-] Cloning verifier repo from /src/tempest. 2018-04-07 20:58:08.729 160 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=5a46489b-f9e3-4a04-8542-190b334d9a65) has been successfully created! Using verifier 'opnfv-tempest' (UUID=5a46489b-f9e3-4a04-8542-190b334d9a65) as the default verifier for the future CLI operations. 2018-04-07 20:58:15,257 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-04-07 20:58:13.733 179 INFO rally.api [-] Configuring verifier 'opnfv-tempest' (UUID=5a46489b-f9e3-4a04-8542-190b334d9a65) for deployment 'opnfv-rally' (UUID=fc8e3912-f62c-4aed-b337-517285698533). 2018-04-07 20:58:15.041 179 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=5a46489b-f9e3-4a04-8542-190b334d9a65) has been successfully configured for deployment 'opnfv-rally' (UUID=fc8e3912-f62c-4aed-b337-517285698533)! 2018-04-07 20:58:15,258 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-04-07 21:03:56,712 - functest.utils.functest_utils - DEBUG - Executing command: 'rm -rf /tmp/sdnvpn-logs/;mkdir -p /tmp/sdnvpn-logs/' 2018-04-07 21:04:00,560 - functest.utils.functest_utils - DEBUG - Executing command: 'mkdir -p /tmp/sdnvpn-logs/' 2018-04-07 21:04:00,576 - functest.utils.functest_utils - DEBUG - Executing command: 'cd /tmp/sdnvpn-logs/; tar -xzvf /tmp/log_output-overcloud-controller-2.tar.gz --strip-components=1' 2018-04-07 21:04:05,759 - functest.utils.functest_utils - DEBUG - Executing command: 'mkdir -p /tmp/sdnvpn-logs/' 2018-04-07 21:04:05,776 - functest.utils.functest_utils - DEBUG - Executing command: 'cd /tmp/sdnvpn-logs/; tar -xzvf /tmp/log_output-overcloud-controller-0.tar.gz --strip-components=1' 2018-04-07 21:04:12,903 - functest.utils.functest_utils - DEBUG - Executing command: 'mkdir -p /tmp/sdnvpn-logs/' 2018-04-07 21:04:12,919 - functest.utils.functest_utils - DEBUG - Executing command: 'cd /tmp/sdnvpn-logs/; tar -xzvf /tmp/log_output-overcloud-controller-1.tar.gz --strip-components=1' 2018-04-07 21:04:13,344 - functest.utils.functest_utils - DEBUG - Executing command: 'mkdir -p /tmp/sdnvpn-logs/' 2018-04-07 21:04:13,359 - functest.utils.functest_utils - DEBUG - Executing command: 'cd /tmp/sdnvpn-logs/; tar -xzvf /tmp/log_output-overcloud-novacompute-0.tar.gz --strip-components=1' 2018-04-07 21:04:13,599 - functest.utils.functest_utils - DEBUG - Executing command: 'mkdir -p /tmp/sdnvpn-logs/' 2018-04-07 21:04:13,613 - functest.utils.functest_utils - DEBUG - Executing command: 'cd /tmp/sdnvpn-logs/; tar -xzvf /tmp/log_output-overcloud-novacompute-1.tar.gz --strip-components=1' 2018-04-07 21:04:13,639 - functest.utils.functest_utils - DEBUG - Executing command: 'cd /home/opnfv/functest/results;tar czvf sdnvpn-logs-overall.tar.gz /tmp/sdnvpn-logs/' 2018-04-07 21:04:15,456 - xtesting.core.feature - INFO - Test result is stored in '/var/lib/xtesting/results/bgpvpn.log' 2018-04-07 21:04:15,574 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-07 21:04:15,574 - xtesting.ci.run_tests - INFO - Test result: +-------------------+-----------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+-----------------+------------------+----------------+ | bgpvpn | sdnvpn | 24:21 | FAIL | +-------------------+-----------------+------------------+----------------+ 2018-04-07 21:04:15,579 - xtesting.ci.run_tests - ERROR - The test case 'bgpvpn' failed. 2018-04-07 21:04:15,580 - xtesting.ci.run_tests - INFO - Xtesting report: +-----------------------------+------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +-----------------------------+------------------------+------------------+------------------+----------------+ | doctor-notification | doctor | features | 04:29 | PASS | | bgpvpn | sdnvpn | features | 24:21 | FAIL | | functest-odl-sfc | sfc | features | 00:00 | SKIP | | barometercollectd | barometer | features | 00:00 | SKIP | | fds | fastdatastacks | features | 00:00 | SKIP | +-----------------------------+------------------------+------------------+------------------+----------------+ 2018-04-07 21:04:15,587 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR 2018-04-07 21:04:21,392 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-apex-baremetal-daily-master-110 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-odl-bgpvpn-ha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod1 | +--------------------------------------+----------------------------------------------------------+ 2018-04-07 21:04:21,397 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Clear any old environment that may conflict. for key in $( set | awk '{FS="="} /^OS_/ {print $1}' ); do unset $key ; done export OS_USERNAME=admin export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_BAREMETAL_API_VERSION=1.34 export NOVA_VERSION=1.1 export OS_PROJECT_NAME=admin export OS_PASSWORD=wCjXvd9xErUHZxR7ZmGsHVpnc export OS_NO_CACHE=True export COMPUTE_API_VERSION=1.1 export no_proxy=,172.30.9.22,192.30.9.6 export OS_VOLUME_API_VERSION=3 export OS_CLOUDNAME=overcloud export OS_AUTH_URL=http://172.30.9.22:5000/v3 export IRONIC_API_VERSION=1.34 export OS_IDENTITY_API_VERSION=3 export OS_IMAGE_API_VERSION=2 export OS_AUTH_TYPE=password export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available" # Add OS_CLOUDNAME to PS1 if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then export PS1=${PS1:-""} export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1 export CLOUDPROMPT_ENABLED=1 fi export SDN_CONTROLLER_IP=192.30.9.6 export OS_REGION_NAME=regionOne 2018-04-07 21:04:21,397 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-04-07 21:04:21,398 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------+---------------+-----------------+---------------------+-------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------+---------------+-----------------+---------------------+-------------------+ +---------------+---------------+-----------------+---------------------+-------------------+ 2018-04-07 21:04:21,399 - xtesting.ci.run_tests - INFO - Xtesting report: +----------------------+------------------+--------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +----------------------+------------------+--------------+------------------+----------------+ | cloudify_ims | functest | vnf | 00:00 | SKIP | | vyos_vrouter | functest | vnf | 00:00 | SKIP | | juju_epc | functest | vnf | 00:00 | SKIP | +----------------------+------------------+--------------+------------------+----------------+ 2018-04-07 21:04:21,402 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK 2018-04-07 21:04:23,768 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-apex-baremetal-daily-master-110 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-odl-bgpvpn-ha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod1 | +--------------------------------------+----------------------------------------------------------+ 2018-04-07 21:04:23,771 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Clear any old environment that may conflict. for key in $( set | awk '{FS="="} /^OS_/ {print $1}' ); do unset $key ; done export OS_USERNAME=admin export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_BAREMETAL_API_VERSION=1.34 export NOVA_VERSION=1.1 export OS_PROJECT_NAME=admin export OS_PASSWORD=wCjXvd9xErUHZxR7ZmGsHVpnc export OS_NO_CACHE=True export COMPUTE_API_VERSION=1.1 export no_proxy=,172.30.9.22,192.30.9.6 export OS_VOLUME_API_VERSION=3 export OS_CLOUDNAME=overcloud export OS_AUTH_URL=http://172.30.9.22:5000/v3 export IRONIC_API_VERSION=1.34 export OS_IDENTITY_API_VERSION=3 export OS_IMAGE_API_VERSION=2 export OS_AUTH_TYPE=password export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available" # Add OS_CLOUDNAME to PS1 if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then export PS1=${PS1:-""} export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1 export CLOUDPROMPT_ENABLED=1 fi export SDN_CONTROLLER_IP=192.30.9.6 export OS_REGION_NAME=regionOne 2018-04-07 21:04:23,771 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-04-07 21:04:23,771 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------+---------------+-----------------+---------------------+-------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------+---------------+-----------------+---------------------+-------------------+ +---------------+---------------+-----------------+---------------------+-------------------+ 2018-04-07 21:04:23,771 - xtesting.ci.run_tests - INFO - Xtesting report: +-----------------------+-----------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +-----------------------+-----------------+------------------+------------------+----------------+ | parser-basics | parser | features | 00:00 | SKIP | +-----------------------+-----------------+------------------+------------------+----------------+ 2018-04-07 21:04:23,772 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK