2018-05-07 18:43:24,787 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-apex-baremetal-daily-fraser-99 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-odl-bgpvpn-ha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod1 | +--------------------------------------+----------------------------------------------------------+ 2018-05-07 18:43:24,790 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Clear any old environment that may conflict. for key in $( set | awk '{FS="="} /^OS_/ {print $1}' ); do unset $key ; done export OS_USERNAME=admin export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_BAREMETAL_API_VERSION=1.34 export NOVA_VERSION=1.1 export OS_PROJECT_NAME=admin export OS_PASSWORD=DUKhnEARxVjvNnv2jqXFFVaqx export OS_NO_CACHE=True export COMPUTE_API_VERSION=1.1 export no_proxy=,172.30.9.28,192.30.9.8 export OS_VOLUME_API_VERSION=3 export OS_CLOUDNAME=overcloud export OS_AUTH_URL=http://172.30.9.28:5000/v3 export IRONIC_API_VERSION=1.34 export OS_IDENTITY_API_VERSION=3 export OS_IMAGE_API_VERSION=2 export OS_AUTH_TYPE=password export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available" # Add OS_CLOUDNAME to PS1 if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then export PS1=${PS1:-""} export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1 export CLOUDPROMPT_ENABLED=1 fi export SDN_CONTROLLER_IP=192.30.9.8 export OS_REGION_NAME=regionOne 2018-05-07 18:43:24,791 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-05-07 18:43:24,791 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------------+---------------+--------------------------+-------------------------------------------------+------------------------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------------+---------------+--------------------------+-------------------------------------------------+------------------------------------+ | healthcheck | 0 | (daily)|(weekly) | First tier to be executed to verify the | connection_check api_check | | | | | basic operations in the VIM. | snaps_health_check | +---------------------+---------------+--------------------------+-------------------------------------------------+------------------------------------+ 2018-05-07 18:43:24,792 - xtesting.ci.run_tests - INFO - Running tier 'healthcheck' 2018-05-07 18:43:24,792 - xtesting.ci.run_tests - INFO - Running test case 'connection_check'... 2018-05-07 18:43:27,979 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-05-07 18:43:39,871 - xtesting.core.unit - DEBUG - test_glance_connect_fail (snaps.openstack.utils.tests.glance_utils_tests.GlanceSmokeTests) ... ok test_glance_connect_success (snaps.openstack.utils.tests.glance_utils_tests.GlanceSmokeTests) ... ok test_keystone_connect_fail (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneSmokeTests) ... ok test_keystone_connect_success (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneSmokeTests) ... ok test_neutron_connect_fail (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_neutron_connect_success (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_retrieve_ext_network_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_nova_connect_fail (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_nova_connect_success (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_nova_get_hypervisor_hosts (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_heat_connect_fail (snaps.openstack.utils.tests.heat_utils_tests.HeatSmokeTests) ... ok test_heat_connect_success (snaps.openstack.utils.tests.heat_utils_tests.HeatSmokeTests) ... ok test_cinder_connect_fail (snaps.openstack.utils.tests.cinder_utils_tests.CinderSmokeTests) ... ok test_cinder_connect_success (snaps.openstack.utils.tests.cinder_utils_tests.CinderSmokeTests) ... ok ---------------------------------------------------------------------- Ran 14 tests in 11.879s OK 2018-05-07 18:43:40,059 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-05-07 18:43:40,059 - xtesting.ci.run_tests - INFO - Test result: +--------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------------+------------------+------------------+----------------+ | connection_check | functest | 00:12 | PASS | +--------------------------+------------------+------------------+----------------+ 2018-05-07 18:43:40,063 - xtesting.ci.run_tests - INFO - Running test case 'api_check'... 2018-05-07 18:43:41,716 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-05-07 18:56:09,589 - xtesting.core.unit - DEBUG - test_create_project_minimal (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_create_user_minimal (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_fail_without_proper_credentials (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_fail_without_proper_service (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_success (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_with_each_interface (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_grant_user_role_to_project (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_create_admin_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_delete_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_user_2x (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_delete_project (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_2x (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_bad_domain (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_quota_override (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_update_quotas (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_sec_grp_one_user (snaps.openstack.tests.create_project_tests.CreateProjectUserTests) ... ok test_create_project_sec_grp_two_users (snaps.openstack.tests.create_project_tests.CreateProjectUserTests) ... ok test_create_image_minimal_file (snaps.openstack.utils.tests.glance_utils_tests.GlanceUtilsTests) ... ok test_create_image_minimal_url (snaps.openstack.utils.tests.glance_utils_tests.GlanceUtilsTests) ... ok test_create_network (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_network_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_network_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_empty_cidr (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_null_cidr (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_add_interface_router (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_missing_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_null_router (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_null_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_invalid_ip (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_invalid_ip_to_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_ip (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_network_object (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_router_simple (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_router_with_public_interface (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_delete_simple_sec_grp (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_no_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_no_rules (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_one_rule (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_get_sec_grp_by_id (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_floating_ips (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsFloatingIpTests) ... ok test_create_delete_keypair (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_key_from_file (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_keypair (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_delete_flavor (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsFlavorTests) ... ok test_create_flavor (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsFlavorTests) ... ok test_create_instance (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceTests) ... ok test_add_remove_volume (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_attach_volume_nowait (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_detach_volume_nowait (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_create_clean_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_delete_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor_all_settings (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor_existing (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateSimpleStackTests) ... ok test_create_stack_x2 (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateSimpleStackTests) ... ok test_get_settings_from_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateComplexStackTests) ... ok test_create_flavor_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsFlavorTests) ... ok test_create_keypair_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsKeypairTests) ... ok test_create_security_group_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsSecurityGroupTests) ... ok test_create_delete_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_back (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_both (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_front (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_delete_volume (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTests) ... ok test_create_simple_volume (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTests) ... ok test_create_delete_volume_type (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsSimpleVolumeTypeTests) ... ok test_create_simple_volume_type (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsSimpleVolumeTypeTests) ... ok test_create_bad_key_size (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_delete_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_simple_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_with_all_attrs (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_with_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_invalid_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_qos_and_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok ---------------------------------------------------------------------- Ran 84 tests in 747.821s OK 2018-05-07 18:56:09,753 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-05-07 18:56:09,754 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | api_check | functest | 12:28 | PASS | +-------------------+------------------+------------------+----------------+ 2018-05-07 18:56:09,759 - xtesting.ci.run_tests - INFO - Running test case 'snaps_health_check'... 2018-05-07 18:56:10,623 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-05-07 18:56:51,673 - xtesting.core.unit - DEBUG - test_check_vm_ip_dhcp (snaps.openstack.tests.create_instance_tests.SimpleHealthCheck) ... ok ---------------------------------------------------------------------- Ran 1 test in 41.048s OK 2018-05-07 18:56:51,937 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-05-07 18:56:51,937 - xtesting.ci.run_tests - INFO - Test result: +----------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +----------------------------+------------------+------------------+----------------+ | snaps_health_check | functest | 00:41 | PASS | +----------------------------+------------------+------------------+----------------+ 2018-05-07 18:56:51,939 - xtesting.ci.run_tests - INFO - Xtesting report: +----------------------------+------------------+---------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +----------------------------+------------------+---------------------+------------------+----------------+ | connection_check | functest | healthcheck | 00:12 | PASS | | api_check | functest | healthcheck | 12:28 | PASS | | snaps_health_check | functest | healthcheck | 00:41 | PASS | +----------------------------+------------------+---------------------+------------------+----------------+ 2018-05-07 18:56:51,941 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK 2018-05-07 18:57:22,884 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-apex-baremetal-daily-fraser-99 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-odl-bgpvpn-ha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod1 | +--------------------------------------+----------------------------------------------------------+ 2018-05-07 18:57:22,887 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Clear any old environment that may conflict. for key in $( set | awk '{FS="="} /^OS_/ {print $1}' ); do unset $key ; done export OS_USERNAME=admin export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_BAREMETAL_API_VERSION=1.34 export NOVA_VERSION=1.1 export OS_PROJECT_NAME=admin export OS_PASSWORD=DUKhnEARxVjvNnv2jqXFFVaqx export OS_NO_CACHE=True export COMPUTE_API_VERSION=1.1 export no_proxy=,172.30.9.28,192.30.9.8 export OS_VOLUME_API_VERSION=3 export OS_CLOUDNAME=overcloud export OS_AUTH_URL=http://172.30.9.28:5000/v3 export IRONIC_API_VERSION=1.34 export OS_IDENTITY_API_VERSION=3 export OS_IMAGE_API_VERSION=2 export OS_AUTH_TYPE=password export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available" # Add OS_CLOUDNAME to PS1 if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then export PS1=${PS1:-""} export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1 export CLOUDPROMPT_ENABLED=1 fi export SDN_CONTROLLER_IP=192.30.9.8 export OS_REGION_NAME=regionOne 2018-05-07 18:57:22,887 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-05-07 18:57:22,888 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------+---------------+--------------------------+------------------------------------------+--------------------------------------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------+---------------+--------------------------+------------------------------------------+--------------------------------------------------+ | smoke | 1 | (daily)|(weekly) | Set of basic Functional tests to | vping_ssh vping_userdata | | | | | validate the OPNFV scenarios. | tempest_smoke_serial rally_sanity | | | | | | refstack_defcore patrole odl snaps_smoke | | | | | | neutron_trunk | +---------------+---------------+--------------------------+------------------------------------------+--------------------------------------------------+ 2018-05-07 18:57:22,889 - xtesting.ci.run_tests - INFO - Running tier 'smoke' 2018-05-07 18:57:22,889 - xtesting.ci.run_tests - INFO - Running test case 'vping_ssh'... 2018-05-07 18:57:23,869 - xtesting.energy.energy - INFO - API recorder available at : http://energy.opnfv.fr/resources/recorders/environment/lf-pod1 2018-05-07 18:57:23,870 - xtesting.energy.energy - DEBUG - Getting current scenario 2018-05-07 18:57:24,301 - xtesting.energy.energy - DEBUG - Starting recording 2018-05-07 18:57:24,301 - xtesting.energy.energy - DEBUG - Submitting scenario (vping_ssh/running) 2018-05-07 18:57:24,689 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin virtual environment setup 2018-05-07 18:57:24,689 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing Start Time:'2018-05-07 18:57:24' 2018-05-07 18:57:24,690 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating image with name: 'functest-vping--4862d45a-afe9-45d6-ad85-422283d51e5e' 2018-05-07 18:57:28,121 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating network with name: 'vping-net-4862d45a-afe9-45d6-ad85-422283d51e5e' 2018-05-07 18:57:31,038 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating router with name: 'vping-router-4862d45a-afe9-45d6-ad85-422283d51e5e' 2018-05-07 18:57:37,364 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating flavor with name: 'vping-flavor-4862d45a-afe9-45d6-ad85-422283d51e5e' 2018-05-07 18:57:38,129 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating keypair with name: 'vPing-keypair-4862d45a-afe9-45d6-ad85-422283d51e5e' 2018-05-07 18:57:41,668 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 1 instance with name: 'opnfv-vping-1-4862d45a-afe9-45d6-ad85-422283d51e5e' 2018-05-07 18:57:49,175 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Security group with name: 'vPing-sg-4862d45a-afe9-45d6-ad85-422283d51e5e' 2018-05-07 18:57:53,299 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 2 instance with name: 'opnfv-vping-2-4862d45a-afe9-45d6-ad85-422283d51e5e' 2018-05-07 18:58:15,340 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin test execution 2018-05-07 18:58:20,879 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Trying to transfer ping.sh 2018-05-07 18:58:21,016 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Waiting for ping... 2018-05-07 18:58:22,023 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing detected! 2018-05-07 18:58:22,023 - xtesting.energy.energy - DEBUG - Restoring previous scenario (default/default) 2018-05-07 18:58:22,024 - xtesting.energy.energy - DEBUG - Submitting scenario (default/default) 2018-05-07 18:58:23,029 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-05-07 18:58:23,030 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | vping_ssh | functest | 00:57 | PASS | +-------------------+------------------+------------------+----------------+ 2018-05-07 18:58:40,504 - xtesting.ci.run_tests - INFO - Running test case 'vping_userdata'... 2018-05-07 18:58:40,598 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin virtual environment setup 2018-05-07 18:58:40,598 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing Start Time:'2018-05-07 18:58:40' 2018-05-07 18:58:40,598 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating image with name: 'functest-vping--9031e19c-d85a-4977-9f12-580b36624dfc' 2018-05-07 18:58:44,157 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating network with name: 'vping-net-9031e19c-d85a-4977-9f12-580b36624dfc' 2018-05-07 18:58:47,000 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating router with name: 'vping-router-9031e19c-d85a-4977-9f12-580b36624dfc' 2018-05-07 18:58:53,335 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating flavor with name: 'vping-flavor-9031e19c-d85a-4977-9f12-580b36624dfc' 2018-05-07 18:58:54,037 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 1 instance with name: 'opnfv-vping-1-9031e19c-d85a-4977-9f12-580b36624dfc' 2018-05-07 18:59:00,855 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 2 instance with name: 'opnfv-vping-2-9031e19c-d85a-4977-9f12-580b36624dfc' 2018-05-07 18:59:07,446 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin test execution 2018-05-07 18:59:15,211 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Waiting for ping... 2018-05-07 18:59:17,924 - functest.opnfv_tests.openstack.vping.vping_base - DEBUG - Pinging 192.168.130.12. Waiting for response... 2018-05-07 18:59:44,630 - functest.opnfv_tests.openstack.vping.vping_base - DEBUG - Pinging 192.168.130.12. Waiting for response... 2018-05-07 19:00:11,174 - functest.opnfv_tests.openstack.vping.vping_base - DEBUG - Pinging 192.168.130.12. Waiting for response... 2018-05-07 19:00:16,287 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing detected! 2018-05-07 19:00:16,450 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-05-07 19:00:16,451 - xtesting.ci.run_tests - INFO - Test result: +------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +------------------------+------------------+------------------+----------------+ | vping_userdata | functest | 01:36 | PASS | +------------------------+------------------+------------------+----------------+ 2018-05-07 19:00:35,445 - xtesting.ci.run_tests - INFO - Running test case 'tempest_smoke_serial'... 2018-05-07 19:00:35,538 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-05-07 19:00:40,377 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-05-07 19:00:40.055 19 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=45028c09-e426-407a-b223-3541009da3d2) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | 45028c09-e426-407a-b223-3541009da3d2 | 2018-05-07T19:00:39 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: 45028c09-e426-407a-b223-3541009da3d2 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-05-07 19:00:44,153 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | key-manager | Available | | __unknown__ | placement | Available | | __unknown__ | policy | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+----------------+-----------+ 2018-05-07 19:00:44,153 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-05-07 19:00:50,341 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide 2018-05-07 19:00:48.807 28 INFO rally.api [-] Creating verifier 'opnfv-tempest'. 2018-05-07 19:00:48.982 28 INFO rally.verification.manager [-] Cloning verifier repo from /src/tempest. 2018-05-07 19:00:50.154 28 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=ea2b22ba-0483-432d-b4af-83b7faa7e049) has been successfully created! Using verifier 'opnfv-tempest' (UUID=ea2b22ba-0483-432d-b4af-83b7faa7e049) as the default verifier for the future CLI operations. 2018-05-07 19:00:53,397 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-05-07 19:00:55,775 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating two images for Tempest suite 2018-05-07 19:01:02,474 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-05-07 19:01:07,656 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-05-07 19:01:06.605 47 INFO rally.api [-] Configuring verifier 'opnfv-tempest' (UUID=ea2b22ba-0483-432d-b4af-83b7faa7e049) for deployment 'opnfv-rally' (UUID=45028c09-e426-407a-b223-3541009da3d2). 2018-05-07 19:01:07.491 47 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=ea2b22ba-0483-432d-b4af-83b7faa7e049) has been successfully configured for deployment 'opnfv-rally' (UUID=45028c09-e426-407a-b223-3541009da3d2)! 2018-05-07 19:01:07,657 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-05-07 19:01:07,657 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-05-07 19:01:07,659 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-05-07 19:01:07,663 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Generating test case list... 2018-05-07 19:01:11,809 - functest.opnfv_tests.openstack.tempest.tempest - INFO - (cd /root/.rally/verification/verifier-ea2b22ba-0483-432d-b4af-83b7faa7e049/repo; testr list-tests '^tempest\.(api|scenario).*\[.*\bsmoke\b.*\]$' >/home/opnfv/functest/results/tempest/test_list.txt 2>/dev/null) 2018-05-07 19:01:11,809 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Applying tempest blacklist... 2018-05-07 19:01:11,810 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Tempest blacklist file does not exist. 2018-05-07 19:01:11,810 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', u'/home/opnfv/functest/results/tempest/test_list.txt', '--concurrency', '1']'. 2018-05-07 19:01:14,045 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:01:14.042 56 INFO rally.api [-] Starting verification (UUID=dd4840b3-ce69-46ca-aa89-8bece8362e24) for deployment 'opnfv-rally' (UUID=45028c09-e426-407a-b223-3541009da3d2) by verifier 'opnfv-tempest' (UUID=ea2b22ba-0483-432d-b4af-83b7faa7e049). 2018-05-07 19:01:14,045 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Verification UUID: dd4840b3-ce69-46ca-aa89-8bece8362e24 2018-05-07 19:01:21,453 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:01:21.452 56 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor ... success [0.285s] 2018-05-07 19:01:21,512 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:01:21.512 56 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.060s] 2018-05-07 19:01:28,285 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:01:28.285 56 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create ... success [1.773s] 2018-05-07 19:01:31,732 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:01:31.731 56 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list ... success [3.445s] 2018-05-07 19:01:46,214 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:01:46.214 56 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete ... success [7.020s] 2018-05-07 19:02:03,082 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:02:03.081 56 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip ... success [10.528s] 2018-05-07 19:02:37,341 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:02:37.340 56 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_list_servers ... success [0.067s] 2018-05-07 19:02:37,342 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:02:37.341 56 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_verify_server_details ... success [0.001s] 2018-05-07 19:03:09,101 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:03:09.101 56 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers ... success [0.081s] 2018-05-07 19:03:09,102 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:03:09.102 56 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details ... success [0.001s] 2018-05-07 19:03:40,983 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:03:40.983 56 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers ... success [0.066s] 2018-05-07 19:03:40,984 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:03:40.984 56 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details ... success [0.001s] 2018-05-07 19:06:24,923 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:06:24.922 56 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard ... success [132.246s] 2018-05-07 19:06:47,810 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:06:47.809 56 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses ... success [0.051s] 2018-05-07 19:06:47,906 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:06:47.906 56 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network ... success [0.097s] 2018-05-07 19:06:56,414 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:06:56.414 56 INFO opnfv-tempest [-] {0} tempest.api.compute.test_versions.TestVersions.test_get_version_details ... success [0.655s] 2018-05-07 19:06:56,423 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:06:56.423 56 INFO opnfv-tempest [-] {0} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.009s] 2018-05-07 19:06:58,123 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:06:58.122 56 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v2.test_services.ServicesTestJSON ... skip: Identity api v2 is not enabled 2018-05-07 19:06:58,123 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:06:58.123 56 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v2.test_users.UsersTestJSON ... skip: Identity api v2 is not enabled 2018-05-07 19:07:02,251 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:07:02.250 56 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete ... success [0.453s] 2018-05-07 19:07:08,342 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:07:08.342 56 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists ... success [0.085s] 2018-05-07 19:07:15,100 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:07:15.099 56 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain ... success [0.716s] 2018-05-07 19:07:23,023 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:07:23.023 56 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint ... success [0.609s] 2018-05-07 19:07:32,748 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:07:32.748 56 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete ... success [3.332s] 2018-05-07 19:07:39,721 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:07:39.720 56 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy ... success [0.395s] 2018-05-07 19:07:45,912 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:07:45.912 56 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id ... success [0.204s] 2018-05-07 19:07:53,474 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:07:53.473 56 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_show_list ... success [0.449s] 2018-05-07 19:08:01,249 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:08:01.249 56 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service ... success [0.465s] 2018-05-07 19:08:09,823 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:08:09.823 56 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all ... success [2.888s] 2018-05-07 19:08:12,780 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:08:12.780 56 INFO opnfv-tempest [-] {0} tempest.api.identity.v2.test_api_discovery.TestApiDiscovery ... skip: Identity api v2 is not enabled 2018-05-07 19:08:14,887 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:08:14.887 56 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.072s] 2018-05-07 19:08:14,959 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:08:14.959 56 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.071s] 2018-05-07 19:08:15,034 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:08:15.033 56 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.074s] 2018-05-07 19:08:15,040 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:08:15.040 56 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_list_api_versions ... success [0.006s] 2018-05-07 19:08:19,581 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:08:19.580 56 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [0.889s] 2018-05-07 19:08:21,905 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:08:21.905 56 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file ... success [2.323s] 2018-05-07 19:08:23,884 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:08:23.883 56 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [1.978s] 2018-05-07 19:08:30,822 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:08:30.822 56 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_versions.VersionsTest.test_list_versions ... success [0.007s] 2018-05-07 19:08:38,212 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:08:38.212 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions ... success [3.831s] 2018-05-07 19:08:50,534 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:08:50.533 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address ... success [2.601s] 2018-05-07 19:08:54,074 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:08:54.073 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip ... success [3.539s] 2018-05-07 19:09:04,894 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:09:04.894 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_network ... success [3.092s] 2018-05-07 19:09:08,499 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:09:08.499 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_port ... success [3.603s] 2018-05-07 19:09:17,731 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:09:17.731 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_subnet ... success [9.232s] 2018-05-07 19:09:27,389 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:09:27.389 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_network ... success [3.269s] 2018-05-07 19:09:30,913 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:09:30.912 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_port ... success [3.522s] 2018-05-07 19:09:37,942 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:09:37.942 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_subnet ... success [7.029s] 2018-05-07 19:09:53,500 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:09:53.500 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_update_delete_network_subnet ... success [5.662s] 2018-05-07 19:09:53,941 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:09:53.941 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_external_network_visibility ... success [0.440s] 2018-05-07 19:09:54,337 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:09:54.337 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_networks ... success [0.396s] 2018-05-07 19:09:54,436 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:09:54.436 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_subnets ... success [0.098s] 2018-05-07 19:09:54,680 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:09:54.680 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_network ... success [0.244s] 2018-05-07 19:09:54,741 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:09:54.741 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_subnet ... success [0.060s] 2018-05-07 19:10:10,205 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:10:10.204 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [7.095s] 2018-05-07 19:10:10,644 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:10:10.643 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_external_network_visibility ... success [0.439s] 2018-05-07 19:10:10,919 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:10:10.919 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.274s] 2018-05-07 19:10:10,972 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:10:10.972 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.053s] 2018-05-07 19:10:11,079 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:10:11.079 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.107s] 2018-05-07 19:10:11,297 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:10:11.296 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.216s] 2018-05-07 19:10:24,152 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:10:24.151 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools ... success [4.349s] 2018-05-07 19:10:30,748 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:10:30.748 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups ... success [6.596s] 2018-05-07 19:10:32,901 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:10:32.901 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port ... success [2.152s] 2018-05-07 19:10:33,113 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:10:33.112 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports ... success [0.211s] 2018-05-07 19:10:33,316 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:10:33.316 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port ... success [0.203s] 2018-05-07 19:10:44,927 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:10:44.926 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [4.551s] 2018-05-07 19:10:51,524 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:10:51.524 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups ... success [6.597s] 2018-05-07 19:10:53,186 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:10:53.185 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [1.660s] 2018-05-07 19:10:53,398 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:10:53.398 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.213s] 2018-05-07 19:10:53,451 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:10:53.451 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.053s] 2018-05-07 19:11:08,634 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:11:08.634 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces ... success [9.399s] 2018-05-07 19:11:14,458 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:11:14.458 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id ... success [5.824s] 2018-05-07 19:11:19,178 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:11:19.178 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id ... success [4.720s] 2018-05-07 19:11:22,615 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:11:22.615 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router ... success [3.435s] 2018-05-07 19:11:47,868 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:11:47.868 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces ... success [9.517s] 2018-05-07 19:11:53,374 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:11:53.374 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id ... success [5.506s] 2018-05-07 19:11:57,956 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:11:57.956 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id ... success [4.581s] 2018-05-07 19:12:04,841 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:12:04.841 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router ... success [6.884s] 2018-05-07 19:12:22,511 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:12:22.511 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group ... success [1.703s] 2018-05-07 19:12:24,973 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:12:24.973 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule ... success [2.459s] 2018-05-07 19:12:25,172 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:12:25.172 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups ... success [0.202s] 2018-05-07 19:12:29,980 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:12:29.980 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.698s] 2018-05-07 19:12:32,211 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:12:32.211 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [2.228s] 2018-05-07 19:12:32,257 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:12:32.257 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.049s] 2018-05-07 19:12:36,699 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:12:36.698 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [1.277s] 2018-05-07 19:12:40,142 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:12:40.141 56 INFO opnfv-tempest [-] {0} tempest.api.network.test_versions.NetworksApiDiscovery.test_api_version_resources ... success [0.006s] 2018-05-07 19:12:41,494 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:12:41.494 56 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_quotas.AccountQuotasTest ... skip: AccountQuotasTest skipped as swift is not available 2018-05-07 19:12:41,497 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:12:41.497 56 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_services.AccountTest ... skip: AccountTest skipped as swift is not available 2018-05-07 19:12:41,498 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:12:41.497 56 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest ... skip: ContainerQuotasTest skipped as swift is not available 2018-05-07 19:12:41,498 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:12:41.498 56 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_services.ContainerTest ... skip: ContainerTest skipped as swift is not available 2018-05-07 19:12:41,499 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:12:41.499 56 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_object_services.ObjectTest ... skip: ObjectTest skipped as swift is not available 2018-05-07 19:12:43,469 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:12:43.469 56 INFO opnfv-tempest [-] {0} tempest.api.volume.test_versions.VersionsTest.test_list_versions ... success [0.011s] 2018-05-07 19:12:59,110 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:12:59.110 56 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_attach_detach_volume_to_instance ... success [10.429s] 2018-05-07 19:13:11,808 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:13:11.807 56 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [7.496s] 2018-05-07 19:13:24,298 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:13:24.298 56 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [12.487s] 2018-05-07 19:13:34,419 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:13:34.419 56 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.046s] 2018-05-07 19:16:42,220 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:16:42.220 56 INFO opnfv-tempest [-] {0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops ... success [180.893s] 2018-05-07 19:18:19,997 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:18:19.997 56 INFO opnfv-tempest [-] {0} tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basic_ops ... success [89.301s] 2018-05-07 19:19:03,631 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:19:03.631 56 INFO opnfv-tempest [-] {0} tempest.scenario.test_server_multinode.TestServerMultinode.test_schedule_to_all_nodes ... success [25.106s] 2018-05-07 19:19:20,132 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', 'dd4840b3-ce69-46ca-aa89-8bece8362e24']'. 2018-05-07 19:19:21,238 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2018-05-07 19:19:21,238 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2018-05-07 19:19:21,238 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-05-07 19:19:21,238 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | dd4840b3-ce69-46ca-aa89-8bece8362e24 | 2018-05-07 19:19:21,239 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | finished | 2018-05-07 19:19:21,239 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2018-05-07 19:01:13 | 2018-05-07 19:19:21,239 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2018-05-07 19:19:19 | 2018-05-07 19:19:21,239 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 0:18:06 | 2018-05-07 19:19:21,239 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | concurrency: 1 | 2018-05-07 19:19:21,239 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | | load_list: (value is too long, use 'detailed' flag to display it) | 2018-05-07 19:19:21,239 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2018-05-07 19:19:21,239 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: ea2b22ba-0483-432d-b4af-83b7faa7e049) | 2018-05-07 19:19:21,239 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2018-05-07 19:19:21,239 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: 45028c09-e426-407a-b223-3541009da3d2) | 2018-05-07 19:19:21,240 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 109 | 2018-05-07 19:19:21,240 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 1064.503 | 2018-05-07 19:19:21,240 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 90 | 2018-05-07 19:19:21,240 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 19 | 2018-05-07 19:19:21,240 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2018-05-07 19:19:21,240 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2018-05-07 19:19:21,240 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 0 | 2018-05-07 19:19:21,240 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-05-07 19:19:21,240 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------------------------------------------------------------------+ 2018-05-07 19:19:21,343 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest tempest_smoke_serial success_rate is 100.0% 2018-05-07 19:19:28,673 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-05-07 19:19:28,674 - xtesting.ci.run_tests - INFO - Test result: +------------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +------------------------------+------------------+------------------+----------------+ | tempest_smoke_serial | functest | 18:35 | PASS | +------------------------------+------------------+------------------+----------------+ 2018-05-07 19:19:28,678 - xtesting.ci.run_tests - INFO - Running test case 'rally_sanity'... 2018-05-07 19:19:28,767 - xtesting.energy.energy - DEBUG - Getting current scenario 2018-05-07 19:19:29,205 - xtesting.energy.energy - DEBUG - Starting recording 2018-05-07 19:19:29,205 - xtesting.energy.energy - DEBUG - Submitting scenario (rally_sanity/running) 2018-05-07 19:19:29,646 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-05-07 19:19:32,138 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-05-07 19:19:31.757 183 INFO rally.deployment.engine [-] Deployment 45028c09-e426-407a-b223-3541009da3d2 | Starting: Destroy cloud and free allocated resources. 2018-05-07 19:19:31.835 183 INFO rally.deployment.engine [-] Deployment 45028c09-e426-407a-b223-3541009da3d2 | Completed: Destroy cloud and free allocated resources. 2018-05-07 19:19:31.873 183 INFO rally.api [-] Deleting all verifications created by verifier 'opnfv-tempest' (UUID=ea2b22ba-0483-432d-b4af-83b7faa7e049) for deployment 'opnfv-rally'. 2018-05-07 19:19:31.889 183 INFO rally.api [-] Deleting verification (UUID=dd4840b3-ce69-46ca-aa89-8bece8362e24). 2018-05-07 19:19:31.936 183 INFO rally.api [-] Verification has been successfully deleted! 2018-05-07 19:19:31.937 183 INFO rally.api [-] Deleting deployment-specific data for verifier 'opnfv-tempest' (UUID=ea2b22ba-0483-432d-b4af-83b7faa7e049). 2018-05-07 19:19:31.949 183 INFO rally.api [-] Deployment-specific data has been successfully deleted! 2018-05-07 19:19:34,588 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-05-07 19:19:34.291 186 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=c69c85e1-b6e5-48d3-8521-5b2ea7eb0c56) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | c69c85e1-b6e5-48d3-8521-5b2ea7eb0c56 | 2018-05-07T19:19:34 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: c69c85e1-b6e5-48d3-8521-5b2ea7eb0c56 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-05-07 19:19:37,925 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | key-manager | Available | | __unknown__ | placement | Available | | __unknown__ | policy | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+----------------+-----------+ 2018-05-07 19:19:37,926 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating the test name... 2018-05-07 19:19:39,411 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating image 'Cirros-0.4.0-9e18599c-a795-40e3-9a2f-857e203b0e54'... 2018-05-07 19:19:43,164 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating network 'rally-net-9e18599c-a795-40e3-9a2f-857e203b0e54'... 2018-05-07 19:19:45,701 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating router 'rally-router-9e18599c-a795-40e3-9a2f-857e203b0e54'... 2018-05-07 19:19:51,373 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating flavor 'rally-tiny-9e18599c-a795-40e3-9a2f-857e203b0e54'... 2018-05-07 19:19:52,094 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating flavor 'rally-mini-9e18599c-a795-40e3-9a2f-857e203b0e54'... 2018-05-07 19:19:52,788 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2018-05-07 19:19:52,789 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-authenticate.yaml 2018-05-07 19:19:52,790 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-05-07 19:19:52,807 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-05-07 19:19:52,807 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['authenticate'], 'concurrency': 4, 'netid': '81b197a1-8a9e-4284-93fb-61e3f2721f5d', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-9e18599c-a795-40e3-9a2f-857e203b0e54', 'flavor_name': 'rally-tiny-9e18599c-a795-40e3-9a2f-857e203b0e54', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-9e18599c-a795-40e3-9a2f-857e203b0e54', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-05-07 19:20:54,860 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 424b9313-7d22-41e1-ac40-01a1a08cdb51 2018-05-07 19:20:54,860 - functest.opnfv_tests.openstack.rally.rally - DEBUG - /home/opnfv/functest/results/rally does not exist, we create it. 2018-05-07 19:20:54,861 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '424b9313-7d22-41e1-ac40-01a1a08cdb51'] 2018-05-07 19:20:55,877 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 424b9313-7d22-41e1-ac40-01a1a08cdb51: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 424b9313-7d22-41e1-ac40-01a1a08cdb51 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 0.486 | 0.486 | 0.486 | 0.486 | 0.486 | 0.486 | 100.0% | 1 | | total | 0.486 | 0.486 | 0.486 | 0.486 | 0.486 | 0.486 | 100.0% | 1 | | -> duration | 0.486 | 0.486 | 0.486 | 0.486 | 0.486 | 0.486 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.485664 Full duration: 7.046132 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 424b9313-7d22-41e1-ac40-01a1a08cdb51 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.948 | 0.948 | 0.948 | 0.948 | 0.948 | 0.948 | 100.0% | 1 | | total | 1.395 | 1.395 | 1.395 | 1.395 | 1.395 | 1.395 | 100.0% | 1 | | -> duration | 1.395 | 1.395 | 1.395 | 1.395 | 1.395 | 1.395 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.395496 Full duration: 8.56443 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 424b9313-7d22-41e1-ac40-01a1a08cdb51 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.524 | 0.524 | 0.524 | 0.524 | 0.524 | 0.524 | 100.0% | 1 | | total | 0.954 | 0.954 | 0.954 | 0.954 | 0.954 | 0.954 | 100.0% | 1 | | -> duration | 0.954 | 0.954 | 0.954 | 0.954 | 0.954 | 0.954 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.954304 Full duration: 7.820139 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 424b9313-7d22-41e1-ac40-01a1a08cdb51 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.351 | 0.351 | 0.351 | 0.351 | 0.351 | 0.351 | 100.0% | 1 | | total | 0.766 | 0.766 | 0.766 | 0.766 | 0.766 | 0.766 | 100.0% | 1 | | -> duration | 0.766 | 0.766 | 0.766 | 0.766 | 0.766 | 0.766 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.765826 Full duration: 7.49025 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 424b9313-7d22-41e1-ac40-01a1a08cdb51 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.537 | 0.537 | 0.537 | 0.537 | 0.537 | 0.537 | 100.0% | 1 | | total | 1.034 | 1.034 | 1.034 | 1.034 | 1.034 | 1.034 | 100.0% | 1 | | -> duration | 1.034 | 1.034 | 1.034 | 1.034 | 1.034 | 1.034 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.033793 Full duration: 7.857072 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 424b9313-7d22-41e1-ac40-01a1a08cdb51 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.217 | 0.217 | 0.217 | 0.217 | 0.217 | 0.217 | 100.0% | 1 | | total | 0.758 | 0.758 | 0.758 | 0.758 | 0.758 | 0.758 | 100.0% | 1 | | -> duration | 0.758 | 0.758 | 0.758 | 0.758 | 0.758 | 0.758 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.757584 Full duration: 7.372332 HINTS: * To plot HTML graphics with this data, run: rally task report 424b9313-7d22-41e1-ac40-01a1a08cdb51 --out output.html * To generate a JUnit report, run: rally task export 424b9313-7d22-41e1-ac40-01a1a08cdb51 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 424b9313-7d22-41e1-ac40-01a1a08cdb51 --json --out output.json 2018-05-07 19:20:55,878 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '424b9313-7d22-41e1-ac40-01a1a08cdb51'] 2018-05-07 19:20:56,837 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-05-07 19:20:56,838 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '424b9313-7d22-41e1-ac40-01a1a08cdb51', '--out', u'/home/opnfv/functest/results/rally/opnfv-authenticate.html'] 2018-05-07 19:20:56,845 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2018-05-07 19:20:56,846 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2018-05-07 19:20:56,846 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-glance.yaml 2018-05-07 19:20:56,846 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-05-07 19:20:56,862 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-05-07 19:20:56,862 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['glance'], 'concurrency': 4, 'netid': '81b197a1-8a9e-4284-93fb-61e3f2721f5d', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-9e18599c-a795-40e3-9a2f-857e203b0e54', 'flavor_name': 'rally-tiny-9e18599c-a795-40e3-9a2f-857e203b0e54', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-9e18599c-a795-40e3-9a2f-857e203b0e54', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-05-07 19:22:32,815 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : fcf48549-89d7-41d5-b353-c157250566cf 2018-05-07 19:22:32,816 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'fcf48549-89d7-41d5-b353-c157250566cf'] 2018-05-07 19:22:33,830 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task fcf48549-89d7-41d5-b353-c157250566cf: finished -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task fcf48549-89d7-41d5-b353-c157250566cf has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 3.911 | 3.911 | 3.911 | 3.911 | 3.911 | 3.911 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.498 | 0.498 | 0.498 | 0.498 | 0.498 | 0.498 | 100.0% | 1 | | -> glance_v2.upload_data | 0.977 | 0.977 | 0.977 | 0.977 | 0.977 | 0.977 | 100.0% | 1 | | glance_v2.delete_image | 1.317 | 1.317 | 1.317 | 1.317 | 1.317 | 1.317 | 100.0% | 1 | | total | 5.229 | 5.229 | 5.229 | 5.229 | 5.229 | 5.229 | 100.0% | 1 | | -> duration | 5.229 | 5.229 | 5.229 | 5.229 | 5.229 | 5.229 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.228665 Full duration: 13.792604 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task fcf48549-89d7-41d5-b353-c157250566cf has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 4.635 | 4.635 | 4.635 | 4.635 | 4.635 | 4.635 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.339 | 0.339 | 0.339 | 0.339 | 0.339 | 0.339 | 100.0% | 1 | | -> glance_v2.upload_data | 1.786 | 1.786 | 1.786 | 1.786 | 1.786 | 1.786 | 100.0% | 1 | | glance_v2.list_images | 0.179 | 0.179 | 0.179 | 0.179 | 0.179 | 0.179 | 100.0% | 1 | | total | 4.814 | 4.814 | 4.814 | 4.814 | 4.814 | 4.814 | 100.0% | 1 | | -> duration | 4.814 | 4.814 | 4.814 | 4.814 | 4.814 | 4.814 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.81445 Full duration: 16.92613 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task fcf48549-89d7-41d5-b353-c157250566cf has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.341 | 0.341 | 0.341 | 0.341 | 0.341 | 0.341 | 100.0% | 1 | | total | 0.341 | 0.341 | 0.341 | 0.341 | 0.341 | 0.341 | 100.0% | 1 | | -> duration | 0.341 | 0.341 | 0.341 | 0.341 | 0.341 | 0.341 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.341222 Full duration: 8.186318 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": { "name": "rally-tiny-9e18599c-a795-40e3-9a2f-857e203b0e54" }, "number_instances": 2, "nics": [ { "net-id": "81b197a1-8a9e-4284-93fb-61e3f2721f5d" } ] }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } } } -------------------------------------------------------------------------------- Task fcf48549-89d7-41d5-b353-c157250566cf has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 4.673 | 4.673 | 4.673 | 4.673 | 4.673 | 4.673 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.481 | 0.481 | 0.481 | 0.481 | 0.481 | 0.481 | 100.0% | 1 | | -> glance_v2.upload_data | 1.571 | 1.571 | 1.571 | 1.571 | 1.571 | 1.571 | 100.0% | 1 | | nova.boot_servers | 11.882 | 11.882 | 11.882 | 11.882 | 11.882 | 11.882 | 100.0% | 1 | | total | 16.556 | 16.556 | 16.556 | 16.556 | 16.556 | 16.556 | 100.0% | 1 | | -> duration | 15.556 | 15.556 | 15.556 | 15.556 | 15.556 | 15.556 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.556034 Full duration: 40.212057 HINTS: * To plot HTML graphics with this data, run: rally task report fcf48549-89d7-41d5-b353-c157250566cf --out output.html * To generate a JUnit report, run: rally task export fcf48549-89d7-41d5-b353-c157250566cf --type junit --to output.xml * To get raw JSON output of task results, run: rally task report fcf48549-89d7-41d5-b353-c157250566cf --json --out output.json 2018-05-07 19:22:33,830 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'fcf48549-89d7-41d5-b353-c157250566cf'] 2018-05-07 19:22:34,894 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-05-07 19:22:34,894 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'fcf48549-89d7-41d5-b353-c157250566cf', '--out', u'/home/opnfv/functest/results/rally/opnfv-glance.html'] 2018-05-07 19:22:34,902 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" OK. 2018-05-07 19:22:34,903 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2018-05-07 19:22:34,903 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-cinder.yaml 2018-05-07 19:22:34,903 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-05-07 19:22:34,920 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-05-07 19:22:34,921 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['cinder'], 'concurrency': 4, 'netid': '81b197a1-8a9e-4284-93fb-61e3f2721f5d', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-9e18599c-a795-40e3-9a2f-857e203b0e54', 'flavor_name': 'rally-tiny-9e18599c-a795-40e3-9a2f-857e203b0e54', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-9e18599c-a795-40e3-9a2f-857e203b0e54', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-05-07 19:25:56,291 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : b2631350-43d7-48e4-85e6-3a23d3348471 2018-05-07 19:25:56,292 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'b2631350-43d7-48e4-85e6-3a23d3348471'] 2018-05-07 19:25:57,357 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task b2631350-43d7-48e4-85e6-3a23d3348471: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "force": false }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task b2631350-43d7-48e4-85e6-3a23d3348471 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_snapshot | 3.607 | 3.607 | 3.607 | 3.607 | 3.607 | 3.607 | 100.0% | 1 | | cinder_v2.delete_snapshot | 2.613 | 2.613 | 2.613 | 2.613 | 2.613 | 2.613 | 100.0% | 1 | | total | 6.22 | 6.22 | 6.22 | 6.22 | 6.22 | 6.22 | 100.0% | 1 | | -> duration | 6.22 | 6.22 | 6.22 | 6.22 | 6.22 | 6.22 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.219625 Full duration: 24.273766 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "size": { "max": 1, "min": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task b2631350-43d7-48e4-85e6-3a23d3348471 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.161 | 3.161 | 3.161 | 3.161 | 3.161 | 3.161 | 100.0% | 1 | | cinder_v2.delete_volume | 2.316 | 2.316 | 2.316 | 2.316 | 2.316 | 2.316 | 100.0% | 1 | | total | 5.477 | 5.477 | 5.477 | 5.477 | 5.477 | 5.477 | 100.0% | 1 | | -> duration | 5.477 | 5.477 | 5.477 | 5.477 | 5.477 | 5.477 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.476807 Full duration: 16.067425 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "image": { "name": "Cirros-0.4.0-9e18599c-a795-40e3-9a2f-857e203b0e54" }, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task b2631350-43d7-48e4-85e6-3a23d3348471 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 8.717 | 8.717 | 8.717 | 8.717 | 8.717 | 8.717 | 100.0% | 1 | | cinder_v2.delete_volume | 2.493 | 2.493 | 2.493 | 2.493 | 2.493 | 2.493 | 100.0% | 1 | | total | 11.21 | 11.21 | 11.21 | 11.21 | 11.21 | 11.21 | 100.0% | 1 | | -> duration | 11.21 | 11.21 | 11.21 | 11.21 | 11.21 | 11.21 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 11.210252 Full duration: 22.217134 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task b2631350-43d7-48e4-85e6-3a23d3348471 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.135 | 3.135 | 3.135 | 3.135 | 3.135 | 3.135 | 100.0% | 1 | | cinder_v2.delete_volume | 2.597 | 2.597 | 2.597 | 2.597 | 2.597 | 2.597 | 100.0% | 1 | | total | 5.732 | 5.732 | 5.732 | 5.732 | 5.732 | 5.732 | 100.0% | 1 | | -> duration | 5.732 | 5.732 | 5.732 | 5.732 | 5.732 | 5.732 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.732292 Full duration: 15.900928 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "new_size": 2, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task b2631350-43d7-48e4-85e6-3a23d3348471 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.167 | 3.167 | 3.167 | 3.167 | 3.167 | 3.167 | 100.0% | 1 | | cinder_v2.extend_volume | 2.522 | 2.522 | 2.522 | 2.522 | 2.522 | 2.522 | 100.0% | 1 | | cinder_v2.delete_volume | 2.65 | 2.65 | 2.65 | 2.65 | 2.65 | 2.65 | 100.0% | 1 | | total | 8.34 | 8.34 | 8.34 | 8.34 | 8.34 | 8.34 | 100.0% | 1 | | -> duration | 8.34 | 8.34 | 8.34 | 8.34 | 8.34 | 8.34 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.339591 Full duration: 18.36975 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task b2631350-43d7-48e4-85e6-3a23d3348471 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.33 | 3.33 | 3.33 | 3.33 | 3.33 | 3.33 | 100.0% | 1 | | cinder_v2.delete_volume | 2.447 | 2.447 | 2.447 | 2.447 | 2.447 | 2.447 | 100.0% | 1 | | total | 5.777 | 5.777 | 5.777 | 5.777 | 5.777 | 5.777 | 100.0% | 1 | | -> duration | 5.777 | 5.777 | 5.777 | 5.777 | 5.777 | 5.777 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.77695 Full duration: 22.832555 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task b2631350-43d7-48e4-85e6-3a23d3348471 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_qos | 0.636 | 0.636 | 0.636 | 0.636 | 0.636 | 0.636 | 100.0% | 1 | | cinder_v2.list_qos | 0.179 | 0.179 | 0.179 | 0.179 | 0.179 | 0.179 | 100.0% | 1 | | total | 0.815 | 0.815 | 0.815 | 0.815 | 0.815 | 0.815 | 100.0% | 1 | | -> duration | 0.815 | 0.815 | 0.815 | 0.815 | 0.815 | 0.815 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.815451 Full duration: 12.575761 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "consumer": "back-end", "write_iops_sec": "10", "read_iops_sec": "1000", "set_consumer": "both", "set_write_iops_sec": "11", "set_read_iops_sec": "1001" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task b2631350-43d7-48e4-85e6-3a23d3348471 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_qos | 0.605 | 0.605 | 0.605 | 0.605 | 0.605 | 0.605 | 100.0% | 1 | | cinder_v2.set_qos | 0.21 | 0.21 | 0.21 | 0.21 | 0.21 | 0.21 | 100.0% | 1 | | total | 0.816 | 0.816 | 0.816 | 0.816 | 0.816 | 0.816 | 100.0% | 1 | | -> duration | 0.816 | 0.816 | 0.816 | 0.816 | 0.816 | 0.816 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.816271 Full duration: 12.998489 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "description": "rally tests creating types" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task b2631350-43d7-48e4-85e6-3a23d3348471 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.61 | 0.61 | 0.61 | 0.61 | 0.61 | 0.61 | 100.0% | 1 | | cinder_v2.list_types | 0.193 | 0.193 | 0.193 | 0.193 | 0.193 | 0.193 | 100.0% | 1 | | total | 0.803 | 0.803 | 0.803 | 0.803 | 0.803 | 0.803 | 100.0% | 1 | | -> duration | 0.803 | 0.803 | 0.803 | 0.803 | 0.803 | 0.803 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.802943 Full duration: 12.586737 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "description": "rally tests creating types", "provider": "LuksEncryptor", "cipher": "aes-xts-plain64", "key_size": 512, "control_location": "front-end" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task b2631350-43d7-48e4-85e6-3a23d3348471 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.64 | 0.64 | 0.64 | 0.64 | 0.64 | 0.64 | 100.0% | 1 | | cinder_v2.create_encryption_type | 0.211 | 0.211 | 0.211 | 0.211 | 0.211 | 0.211 | 100.0% | 1 | | total | 0.851 | 0.851 | 0.851 | 0.851 | 0.851 | 0.851 | 100.0% | 1 | | -> duration | 0.851 | 0.851 | 0.851 | 0.851 | 0.851 | 0.851 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.85119 Full duration: 12.593325 HINTS: * To plot HTML graphics with this data, run: rally task report b2631350-43d7-48e4-85e6-3a23d3348471 --out output.html * To generate a JUnit report, run: rally task export b2631350-43d7-48e4-85e6-3a23d3348471 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report b2631350-43d7-48e4-85e6-3a23d3348471 --json --out output.json 2018-05-07 19:25:57,357 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'b2631350-43d7-48e4-85e6-3a23d3348471'] 2018-05-07 19:25:58,390 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-05-07 19:25:58,390 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'b2631350-43d7-48e4-85e6-3a23d3348471', '--out', u'/home/opnfv/functest/results/rally/opnfv-cinder.html'] 2018-05-07 19:25:58,397 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2018-05-07 19:25:58,397 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2018-05-07 19:25:58,397 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-heat.yaml 2018-05-07 19:25:58,397 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-05-07 19:25:58,409 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-05-07 19:25:58,409 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['heat'], 'concurrency': 4, 'netid': '81b197a1-8a9e-4284-93fb-61e3f2721f5d', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-9e18599c-a795-40e3-9a2f-857e203b0e54', 'flavor_name': 'rally-tiny-9e18599c-a795-40e3-9a2f-857e203b0e54', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-9e18599c-a795-40e3-9a2f-857e203b0e54', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-05-07 19:27:19,821 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : cf7e3858-2b0b-49d4-8ee2-7a1aad08b69a 2018-05-07 19:27:19,822 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'cf7e3858-2b0b-49d4-8ee2-7a1aad08b69a'] 2018-05-07 19:27:20,841 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task cf7e3858-2b0b-49d4-8ee2-7a1aad08b69a: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task cf7e3858-2b0b-49d4-8ee2-7a1aad08b69a has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 4.559 | 4.559 | 4.559 | 4.559 | 4.559 | 4.559 | 100.0% | 1 | | heat.update_stack | 2.714 | 2.714 | 2.714 | 2.714 | 2.714 | 2.714 | 100.0% | 1 | | heat.delete_stack | 2.82 | 2.82 | 2.82 | 2.82 | 2.82 | 2.82 | 100.0% | 1 | | total | 10.094 | 10.094 | 10.094 | 10.094 | 10.094 | 10.094 | 100.0% | 1 | | -> duration | 6.094 | 6.094 | 6.094 | 6.094 | 6.094 | 6.094 | 100.0% | 1 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.093618 Full duration: 18.364805 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task cf7e3858-2b0b-49d4-8ee2-7a1aad08b69a has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 4.748 | 4.748 | 4.748 | 4.748 | 4.748 | 4.748 | 100.0% | 1 | | heat.check_stack | 0.678 | 0.678 | 0.678 | 0.678 | 0.678 | 0.678 | 100.0% | 1 | | heat.delete_stack | 1.473 | 1.473 | 1.473 | 1.473 | 1.473 | 1.473 | 100.0% | 1 | | total | 6.899 | 6.899 | 6.899 | 6.899 | 6.899 | 6.899 | 100.0% | 1 | | -> duration | 4.899 | 4.899 | 4.899 | 4.899 | 4.899 | 4.899 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.898842 Full duration: 16.659917 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task cf7e3858-2b0b-49d4-8ee2-7a1aad08b69a has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 4.486 | 4.486 | 4.486 | 4.486 | 4.486 | 4.486 | 100.0% | 1 | | heat.suspend_stack | 0.816 | 0.816 | 0.816 | 0.816 | 0.816 | 0.816 | 100.0% | 1 | | heat.resume_stack | 0.393 | 0.393 | 0.393 | 0.393 | 0.393 | 0.393 | 100.0% | 1 | | heat.delete_stack | 1.788 | 1.788 | 1.788 | 1.788 | 1.788 | 1.788 | 100.0% | 1 | | total | 7.483 | 7.483 | 7.483 | 7.483 | 7.483 | 7.483 | 100.0% | 1 | | -> duration | 5.483 | 5.483 | 5.483 | 5.483 | 5.483 | 5.483 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.48306 Full duration: 17.795742 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task cf7e3858-2b0b-49d4-8ee2-7a1aad08b69a has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 0.583 | 0.583 | 0.583 | 0.583 | 0.583 | 0.583 | 100.0% | 1 | | total | 0.583 | 0.583 | 0.583 | 0.583 | 0.583 | 0.583 | 100.0% | 1 | | -> duration | 0.583 | 0.583 | 0.583 | 0.583 | 0.583 | 0.583 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.583369 Full duration: 8.547074 HINTS: * To plot HTML graphics with this data, run: rally task report cf7e3858-2b0b-49d4-8ee2-7a1aad08b69a --out output.html * To generate a JUnit report, run: rally task export cf7e3858-2b0b-49d4-8ee2-7a1aad08b69a --type junit --to output.xml * To get raw JSON output of task results, run: rally task report cf7e3858-2b0b-49d4-8ee2-7a1aad08b69a --json --out output.json 2018-05-07 19:27:20,841 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'cf7e3858-2b0b-49d4-8ee2-7a1aad08b69a'] 2018-05-07 19:27:21,909 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-05-07 19:27:21,909 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'cf7e3858-2b0b-49d4-8ee2-7a1aad08b69a', '--out', u'/home/opnfv/functest/results/rally/opnfv-heat.html'] 2018-05-07 19:27:21,918 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2018-05-07 19:27:21,918 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2018-05-07 19:27:21,919 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-keystone.yaml 2018-05-07 19:27:21,919 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-05-07 19:27:21,949 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-05-07 19:27:21,950 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['keystone'], 'concurrency': 4, 'netid': '81b197a1-8a9e-4284-93fb-61e3f2721f5d', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-9e18599c-a795-40e3-9a2f-857e203b0e54', 'flavor_name': 'rally-tiny-9e18599c-a795-40e3-9a2f-857e203b0e54', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-9e18599c-a795-40e3-9a2f-857e203b0e54', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-05-07 19:30:38,792 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 3494992e-3e40-45d9-8c70-4c7578c20426 2018-05-07 19:30:38,792 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '3494992e-3e40-45d9-8c70-4c7578c20426'] 2018-05-07 19:30:39,726 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 3494992e-3e40-45d9-8c70-4c7578c20426: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 3494992e-3e40-45d9-8c70-4c7578c20426 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.517 | 0.517 | 0.517 | 0.517 | 0.517 | 0.517 | 100.0% | 1 | | keystone_v3.add_role | 0.128 | 0.128 | 0.128 | 0.128 | 0.128 | 0.128 | 100.0% | 1 | | keystone_v3.revoke_role | 0.138 | 0.138 | 0.138 | 0.138 | 0.138 | 0.138 | 100.0% | 1 | | total | 0.784 | 0.784 | 0.784 | 0.784 | 0.784 | 0.784 | 100.0% | 1 | | -> duration | 0.784 | 0.784 | 0.784 | 0.784 | 0.784 | 0.784 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.783897 Full duration: 14.700753 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 3494992e-3e40-45d9-8c70-4c7578c20426 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.51 | 0.51 | 0.51 | 0.51 | 0.51 | 0.51 | 100.0% | 1 | | keystone_v3.add_role | 0.148 | 0.148 | 0.148 | 0.148 | 0.148 | 0.148 | 100.0% | 1 | | keystone_v3.list_roles | 0.1 | 0.1 | 0.1 | 0.1 | 0.1 | 0.1 | 100.0% | 1 | | total | 0.757 | 0.757 | 0.757 | 0.757 | 0.757 | 0.757 | 100.0% | 1 | | -> duration | 0.757 | 0.757 | 0.757 | 0.757 | 0.757 | 0.757 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.757215 Full duration: 14.216644 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 3494992e-3e40-45d9-8c70-4c7578c20426 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.693 | 0.693 | 0.693 | 0.693 | 0.693 | 0.693 | 100.0% | 1 | | keystone_v3.list_projects | 0.084 | 0.084 | 0.084 | 0.084 | 0.084 | 0.084 | 100.0% | 1 | | total | 0.777 | 0.777 | 0.777 | 0.777 | 0.777 | 0.777 | 100.0% | 1 | | -> duration | 0.777 | 0.777 | 0.777 | 0.777 | 0.777 | 0.777 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.776808 Full duration: 15.250432 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 3494992e-3e40-45d9-8c70-4c7578c20426 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.512 | 0.512 | 0.512 | 0.512 | 0.512 | 0.512 | 100.0% | 1 | | keystone_v3.delete_role | 0.113 | 0.113 | 0.113 | 0.113 | 0.113 | 0.113 | 100.0% | 1 | | total | 0.625 | 0.625 | 0.625 | 0.625 | 0.625 | 0.625 | 100.0% | 1 | | -> duration | 0.625 | 0.625 | 0.625 | 0.625 | 0.625 | 0.625 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.625328 Full duration: 12.231184 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 3494992e-3e40-45d9-8c70-4c7578c20426 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.514 | 0.514 | 0.514 | 0.514 | 0.514 | 0.514 | 100.0% | 1 | | keystone_v3.delete_service | 0.108 | 0.108 | 0.108 | 0.108 | 0.108 | 0.108 | 100.0% | 1 | | total | 0.622 | 0.622 | 0.622 | 0.622 | 0.622 | 0.622 | 100.0% | 1 | | -> duration | 0.622 | 0.622 | 0.622 | 0.622 | 0.622 | 0.622 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.622396 Full duration: 12.787036 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 3494992e-3e40-45d9-8c70-4c7578c20426 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.77 | 0.77 | 0.77 | 0.77 | 0.77 | 0.77 | 100.0% | 1 | | keystone_v3.create_user | 0.494 | 0.494 | 0.494 | 0.494 | 0.494 | 0.494 | 100.0% | 1 | | -> keystone_v3.list_roles | 0.086 | 0.086 | 0.086 | 0.086 | 0.086 | 0.086 | 100.0% | 1 | | -> keystone_v3.add_role | 0.121 | 0.121 | 0.121 | 0.121 | 0.121 | 0.121 | 100.0% | 1 | | keystone_v3.create_role | 0.106 | 0.106 | 0.106 | 0.106 | 0.106 | 0.106 | 100.0% | 1 | | keystone_v3.get_project | 0.088 | 0.088 | 0.088 | 0.088 | 0.088 | 0.088 | 100.0% | 1 | | keystone_v3.get_user | 0.093 | 0.093 | 0.093 | 0.093 | 0.093 | 0.093 | 100.0% | 1 | | keystone_v3.get_role | 0.09 | 0.09 | 0.09 | 0.09 | 0.09 | 0.09 | 100.0% | 1 | | keystone_v3.list_services | 0.088 | 0.088 | 0.088 | 0.088 | 0.088 | 0.088 | 100.0% | 1 | | keystone_v3.get_services | 0.082 | 0.082 | 0.082 | 0.082 | 0.082 | 0.082 | 100.0% | 1 | | total | 1.9 | 1.9 | 1.9 | 1.9 | 1.9 | 1.9 | 100.0% | 1 | | -> duration | 1.9 | 1.9 | 1.9 | 1.9 | 1.9 | 1.9 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.900009 Full duration: 19.472381 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 3494992e-3e40-45d9-8c70-4c7578c20426 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.67 | 0.67 | 0.67 | 0.67 | 0.67 | 0.67 | 100.0% | 1 | | keystone_v3.update_project | 0.107 | 0.107 | 0.107 | 0.107 | 0.107 | 0.107 | 100.0% | 1 | | keystone_v3.delete_project | 0.159 | 0.159 | 0.159 | 0.159 | 0.159 | 0.159 | 100.0% | 1 | | total | 0.937 | 0.937 | 0.937 | 0.937 | 0.937 | 0.937 | 100.0% | 1 | | -> duration | 0.937 | 0.937 | 0.937 | 0.937 | 0.937 | 0.937 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.936826 Full duration: 12.619462 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task 3494992e-3e40-45d9-8c70-4c7578c20426 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.741 | 0.741 | 0.741 | 0.741 | 0.741 | 0.741 | 100.0% | 1 | | total | 0.844 | 0.844 | 0.844 | 0.844 | 0.844 | 0.844 | 100.0% | 1 | | -> duration | 0.844 | 0.844 | 0.844 | 0.844 | 0.844 | 0.844 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.844154 Full duration: 14.778226 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task 3494992e-3e40-45d9-8c70-4c7578c20426 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.665 | 0.665 | 0.665 | 0.665 | 0.665 | 0.665 | 100.0% | 1 | | total | 0.665 | 0.665 | 0.665 | 0.665 | 0.665 | 0.665 | 100.0% | 1 | | -> duration | 0.665 | 0.665 | 0.665 | 0.665 | 0.665 | 0.665 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.664756 Full duration: 14.671729 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task 3494992e-3e40-45d9-8c70-4c7578c20426 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.704 | 0.704 | 0.704 | 0.704 | 0.704 | 0.704 | 100.0% | 1 | | keystone_v3.list_users | 0.105 | 0.105 | 0.105 | 0.105 | 0.105 | 0.105 | 100.0% | 1 | | total | 0.902 | 0.902 | 0.902 | 0.902 | 0.902 | 0.902 | 100.0% | 1 | | -> duration | 0.902 | 0.902 | 0.902 | 0.902 | 0.902 | 0.902 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.901953 Full duration: 15.084047 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "users_per_tenant": 10 }, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task 3494992e-3e40-45d9-8c70-4c7578c20426 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.689 | 0.689 | 0.689 | 0.689 | 0.689 | 0.689 | 100.0% | 1 | | keystone_v3.create_users | 5.057 | 5.057 | 5.057 | 5.057 | 5.057 | 5.057 | 100.0% | 1 | | -> keystone_v3.create_user (x10) | 5.056 | 5.056 | 5.056 | 5.056 | 5.056 | 5.056 | 100.0% | 1 | | --> keystone_v3.list_roles (x10) | 0.838 | 0.838 | 0.838 | 0.838 | 0.838 | 0.838 | 100.0% | 1 | | --> keystone_v3.add_role (x10) | 1.275 | 1.275 | 1.275 | 1.275 | 1.275 | 1.275 | 100.0% | 1 | | total | 6.724 | 6.724 | 6.724 | 6.724 | 6.724 | 6.724 | 100.0% | 1 | | -> duration | 6.724 | 6.724 | 6.724 | 6.724 | 6.724 | 6.724 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.724246 Full duration: 22.947902 HINTS: * To plot HTML graphics with this data, run: rally task report 3494992e-3e40-45d9-8c70-4c7578c20426 --out output.html * To generate a JUnit report, run: rally task export 3494992e-3e40-45d9-8c70-4c7578c20426 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 3494992e-3e40-45d9-8c70-4c7578c20426 --json --out output.json 2018-05-07 19:30:39,727 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '3494992e-3e40-45d9-8c70-4c7578c20426'] 2018-05-07 19:30:40,799 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-05-07 19:30:40,800 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '3494992e-3e40-45d9-8c70-4c7578c20426', '--out', u'/home/opnfv/functest/results/rally/opnfv-keystone.html'] 2018-05-07 19:30:40,807 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2018-05-07 19:30:40,807 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2018-05-07 19:30:40,807 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-neutron.yaml 2018-05-07 19:30:40,807 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-05-07 19:30:40,824 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-05-07 19:30:40,825 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['neutron'], 'concurrency': 4, 'netid': '81b197a1-8a9e-4284-93fb-61e3f2721f5d', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-9e18599c-a795-40e3-9a2f-857e203b0e54', 'flavor_name': 'rally-tiny-9e18599c-a795-40e3-9a2f-857e203b0e54', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-9e18599c-a795-40e3-9a2f-857e203b0e54', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-05-07 19:35:58,884 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : b323b556-ac7b-4b8f-ba86-ed6f601a027d 2018-05-07 19:35:58,885 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'b323b556-ac7b-4b8f-ba86-ed6f601a027d'] 2018-05-07 19:35:59,988 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task b323b556-ac7b-4b8f-ba86-ed6f601a027d: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } } } -------------------------------------------------------------------------------- Task b323b556-ac7b-4b8f-ba86-ed6f601a027d has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.007 | 1.007 | 1.007 | 1.007 | 1.007 | 1.007 | 100.0% | 1 | | neutron.delete_network | 1.151 | 1.151 | 1.151 | 1.151 | 1.151 | 1.151 | 100.0% | 1 | | total | 2.158 | 2.158 | 2.158 | 2.158 | 2.158 | 2.158 | 100.0% | 1 | | -> duration | 2.158 | 2.158 | 2.158 | 2.158 | 2.158 | 2.158 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.158073 Full duration: 15.415016 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "port": -1 } } } } -------------------------------------------------------------------------------- Task b323b556-ac7b-4b8f-ba86-ed6f601a027d has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 1.47 | 1.47 | 1.47 | 1.47 | 1.47 | 1.47 | 100.0% | 1 | | neutron.delete_port | 0.883 | 0.883 | 0.883 | 0.883 | 0.883 | 0.883 | 100.0% | 1 | | total | 2.353 | 2.353 | 2.353 | 2.353 | 2.353 | 2.353 | 100.0% | 1 | | -> duration | 2.353 | 2.353 | 2.353 | 2.353 | 2.353 | 2.353 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.353391 Full duration: 30.915328 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "router_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1, "port": -1, "router": -1 } } } } -------------------------------------------------------------------------------- Task b323b556-ac7b-4b8f-ba86-ed6f601a027d has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.804 | 0.804 | 0.804 | 0.804 | 0.804 | 0.804 | 100.0% | 1 | | neutron.create_subnet | 0.724 | 0.724 | 0.724 | 0.724 | 0.724 | 0.724 | 100.0% | 1 | | neutron.create_router | 0.362 | 0.362 | 0.362 | 0.362 | 0.362 | 0.362 | 100.0% | 1 | | neutron.add_interface_router | 1.65 | 1.65 | 1.65 | 1.65 | 1.65 | 1.65 | 100.0% | 1 | | neutron.remove_interface_router | 1.24 | 1.24 | 1.24 | 1.24 | 1.24 | 1.24 | 100.0% | 1 | | neutron.delete_router | 0.458 | 0.458 | 0.458 | 0.458 | 0.458 | 0.458 | 100.0% | 1 | | total | 5.238 | 5.238 | 5.238 | 5.238 | 5.238 | 5.238 | 100.0% | 1 | | -> duration | 5.238 | 5.238 | 5.238 | 5.238 | 5.238 | 5.238 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.238387 Full duration: 38.89137 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1 } } } } -------------------------------------------------------------------------------- Task b323b556-ac7b-4b8f-ba86-ed6f601a027d has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet | 1.129 | 1.129 | 1.129 | 1.129 | 1.129 | 1.129 | 100.0% | 1 | | neutron.delete_subnet | 0.622 | 0.622 | 0.622 | 0.622 | 0.622 | 0.622 | 100.0% | 1 | | total | 1.751 | 1.751 | 1.751 | 1.751 | 1.751 | 1.751 | 100.0% | 1 | | -> duration | 1.751 | 1.751 | 1.751 | 1.751 | 1.751 | 1.751 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.750925 Full duration: 29.688839 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } } } -------------------------------------------------------------------------------- Task b323b556-ac7b-4b8f-ba86-ed6f601a027d has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.033 | 1.033 | 1.033 | 1.033 | 1.033 | 1.033 | 100.0% | 1 | | neutron.list_networks | 0.446 | 0.446 | 0.446 | 0.446 | 0.446 | 0.446 | 100.0% | 1 | | total | 1.479 | 1.479 | 1.479 | 1.479 | 1.479 | 1.479 | 100.0% | 1 | | -> duration | 1.479 | 1.479 | 1.479 | 1.479 | 1.479 | 1.479 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.478918 Full duration: 17.300228 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "port": -1 } } } } -------------------------------------------------------------------------------- Task b323b556-ac7b-4b8f-ba86-ed6f601a027d has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 1.426 | 1.426 | 1.426 | 1.426 | 1.426 | 1.426 | 100.0% | 1 | | neutron.list_ports | 0.263 | 0.263 | 0.263 | 0.263 | 0.263 | 0.263 | 100.0% | 1 | | total | 1.69 | 1.69 | 1.69 | 1.69 | 1.69 | 1.69 | 100.0% | 1 | | -> duration | 1.69 | 1.69 | 1.69 | 1.69 | 1.69 | 1.69 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.68969 Full duration: 27.915492 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "router_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } } } -------------------------------------------------------------------------------- Task b323b556-ac7b-4b8f-ba86-ed6f601a027d has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.986 | 0.986 | 0.986 | 0.986 | 0.986 | 0.986 | 100.0% | 1 | | neutron.create_subnet | 0.803 | 0.803 | 0.803 | 0.803 | 0.803 | 0.803 | 100.0% | 1 | | neutron.create_router | 0.314 | 0.314 | 0.314 | 0.314 | 0.314 | 0.314 | 100.0% | 1 | | neutron.add_interface_router | 1.464 | 1.464 | 1.464 | 1.464 | 1.464 | 1.464 | 100.0% | 1 | | neutron.list_routers | 0.238 | 0.238 | 0.238 | 0.238 | 0.238 | 0.238 | 100.0% | 1 | | total | 3.805 | 3.805 | 3.805 | 3.805 | 3.805 | 3.805 | 100.0% | 1 | | -> duration | 3.805 | 3.805 | 3.805 | 3.805 | 3.805 | 3.805 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.805099 Full duration: 43.006061 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1 } } } } -------------------------------------------------------------------------------- Task b323b556-ac7b-4b8f-ba86-ed6f601a027d has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.836 | 0.836 | 0.836 | 0.836 | 0.836 | 0.836 | 100.0% | 1 | | neutron.create_subnet | 0.781 | 0.781 | 0.781 | 0.781 | 0.781 | 0.781 | 100.0% | 1 | | neutron.list_subnets | 0.242 | 0.242 | 0.242 | 0.242 | 0.242 | 0.242 | 100.0% | 1 | | total | 1.86 | 1.86 | 1.86 | 1.86 | 1.86 | 1.86 | 100.0% | 1 | | -> duration | 1.86 | 1.86 | 1.86 | 1.86 | 1.86 | 1.86 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.85995 Full duration: 32.766729 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } } } -------------------------------------------------------------------------------- Task b323b556-ac7b-4b8f-ba86-ed6f601a027d has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.957 | 0.957 | 0.957 | 0.957 | 0.957 | 0.957 | 100.0% | 1 | | neutron.delete_security_group | 0.316 | 0.316 | 0.316 | 0.316 | 0.316 | 0.316 | 100.0% | 1 | | total | 1.273 | 1.273 | 1.273 | 1.273 | 1.273 | 1.273 | 100.0% | 1 | | -> duration | 1.273 | 1.273 | 1.273 | 1.273 | 1.273 | 1.273 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.272758 Full duration: 14.575072 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } } } -------------------------------------------------------------------------------- Task b323b556-ac7b-4b8f-ba86-ed6f601a027d has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.939 | 0.939 | 0.939 | 0.939 | 0.939 | 0.939 | 100.0% | 1 | | neutron.create_security_group_rule | 0.316 | 0.316 | 0.316 | 0.316 | 0.316 | 0.316 | 100.0% | 1 | | neutron.delete_security_group_rule | 0.242 | 0.242 | 0.242 | 0.242 | 0.242 | 0.242 | 100.0% | 1 | | neutron.delete_security_group | 0.302 | 0.302 | 0.302 | 0.302 | 0.302 | 0.302 | 100.0% | 1 | | total | 1.8 | 1.8 | 1.8 | 1.8 | 1.8 | 1.8 | 100.0% | 1 | | -> duration | 1.8 | 1.8 | 1.8 | 1.8 | 1.8 | 1.8 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.799867 Full duration: 15.268361 -------------------------------------------------------------------------------- test scenario NeutronNetworks.set_and_clear_router_gateway args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": { "router:external": true } }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "router": -1 } }, "roles": [ "admin" ] } } -------------------------------------------------------------------------------- Task b323b556-ac7b-4b8f-ba86-ed6f601a027d has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.024 | 1.024 | 1.024 | 1.024 | 1.024 | 1.024 | 100.0% | 1 | | neutron.create_router | 0.332 | 0.332 | 0.332 | 0.332 | 0.332 | 0.332 | 100.0% | 1 | | neutron.add_gateway_router | 1.43 | 1.43 | 1.43 | 1.43 | 1.43 | 1.43 | 100.0% | 1 | | neutron.remove_gateway_router | 0.602 | 0.602 | 0.602 | 0.602 | 0.602 | 0.602 | 100.0% | 1 | | total | 3.388 | 3.388 | 3.388 | 3.388 | 3.388 | 3.388 | 100.0% | 1 | | -> duration | 3.388 | 3.388 | 3.388 | 3.388 | 3.388 | 3.388 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.387954 Full duration: 24.140082 HINTS: * To plot HTML graphics with this data, run: rally task report b323b556-ac7b-4b8f-ba86-ed6f601a027d --out output.html * To generate a JUnit report, run: rally task export b323b556-ac7b-4b8f-ba86-ed6f601a027d --type junit --to output.xml * To get raw JSON output of task results, run: rally task report b323b556-ac7b-4b8f-ba86-ed6f601a027d --json --out output.json 2018-05-07 19:35:59,989 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'b323b556-ac7b-4b8f-ba86-ed6f601a027d'] 2018-05-07 19:36:01,148 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-05-07 19:36:01,149 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'b323b556-ac7b-4b8f-ba86-ed6f601a027d', '--out', u'/home/opnfv/functest/results/rally/opnfv-neutron.html'] 2018-05-07 19:36:01,158 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2018-05-07 19:36:01,158 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2018-05-07 19:36:01,159 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-nova.yaml 2018-05-07 19:36:01,159 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-05-07 19:36:01,182 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-05-07 19:36:01,182 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['nova'], 'concurrency': 4, 'netid': '81b197a1-8a9e-4284-93fb-61e3f2721f5d', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-9e18599c-a795-40e3-9a2f-857e203b0e54', 'flavor_name': 'rally-tiny-9e18599c-a795-40e3-9a2f-857e203b0e54', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-9e18599c-a795-40e3-9a2f-857e203b0e54', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-05-07 19:41:57,601 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : ef90a94c-0a13-4ab3-90e2-04d34ea9b1c3 2018-05-07 19:41:57,601 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'ef90a94c-0a13-4ab3-90e2-04d34ea9b1c3'] 2018-05-07 19:41:58,705 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task ef90a94c-0a13-4ab3-90e2-04d34ea9b1c3: finished -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_live_migrate_server args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "flavor": { "name": "rally-tiny-9e18599c-a795-40e3-9a2f-857e203b0e54" }, "image": { "name": "Cirros-0.4.0-9e18599c-a795-40e3-9a2f-857e203b0e54" }, "block_migration": false, "nics": [ { "net-id": "81b197a1-8a9e-4284-93fb-61e3f2721f5d" } ] }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task ef90a94c-0a13-4ab3-90e2-04d34ea9b1c3 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 9.872 | 9.872 | 9.872 | 9.872 | 9.872 | 9.872 | 100.0% | 1 | | nova.find_host_to_migrate | 1.579 | 1.579 | 1.579 | 1.579 | 1.579 | 1.579 | 100.0% | 1 | | nova.live_migrate | 12.044 | 12.044 | 12.044 | 12.044 | 12.044 | 12.044 | 100.0% | 1 | | nova.delete_server | 2.976 | 2.976 | 2.976 | 2.976 | 2.976 | 2.976 | 100.0% | 1 | | total | 26.471 | 26.471 | 26.471 | 26.471 | 26.471 | 26.471 | 100.0% | 1 | | -> duration | 25.471 | 25.471 | 25.471 | 25.471 | 25.471 | 25.471 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 25.471325 Full duration: 36.299722 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_attach_created_volume_and_live_migrate args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "flavor": { "name": "rally-tiny-9e18599c-a795-40e3-9a2f-857e203b0e54" }, "image": { "name": "Cirros-0.4.0-9e18599c-a795-40e3-9a2f-857e203b0e54" }, "size": 10, "block_migration": false, "boot_server_kwargs": { "nics": [ { "net-id": "81b197a1-8a9e-4284-93fb-61e3f2721f5d" } ] } }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task ef90a94c-0a13-4ab3-90e2-04d34ea9b1c3 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 9.68 | 9.68 | 9.68 | 9.68 | 9.68 | 9.68 | 100.0% | 1 | | cinder_v2.create_volume | 2.759 | 2.759 | 2.759 | 2.759 | 2.759 | 2.759 | 100.0% | 1 | | nova.attach_volume | 4.151 | 4.151 | 4.151 | 4.151 | 4.151 | 4.151 | 100.0% | 1 | | nova.find_host_to_migrate | 1.397 | 1.397 | 1.397 | 1.397 | 1.397 | 1.397 | 100.0% | 1 | | nova.live_migrate | 11.41 | 11.41 | 11.41 | 11.41 | 11.41 | 11.41 | 100.0% | 1 | | nova.detach_volume | 3.849 | 3.849 | 3.849 | 3.849 | 3.849 | 3.849 | 100.0% | 1 | | cinder_v2.delete_volume | 2.526 | 2.526 | 2.526 | 2.526 | 2.526 | 2.526 | 100.0% | 1 | | nova.delete_server | 4.941 | 4.941 | 4.941 | 4.941 | 4.941 | 4.941 | 100.0% | 1 | | total | 40.713 | 40.713 | 40.713 | 40.713 | 40.713 | 40.713 | 100.0% | 1 | | -> duration | 39.713 | 39.713 | 39.713 | 39.713 | 39.713 | 39.713 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 39.712714 Full duration: 52.471493 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_from_volume_and_live_migrate args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "flavor": { "name": "rally-tiny-9e18599c-a795-40e3-9a2f-857e203b0e54" }, "image": { "name": "Cirros-0.4.0-9e18599c-a795-40e3-9a2f-857e203b0e54" }, "block_migration": false, "volume_size": 10, "force_delete": false, "nics": [ { "net-id": "81b197a1-8a9e-4284-93fb-61e3f2721f5d" } ] }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task ef90a94c-0a13-4ab3-90e2-04d34ea9b1c3 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 8.53 | 8.53 | 8.53 | 8.53 | 8.53 | 8.53 | 100.0% | 1 | | nova.boot_server | 9.092 | 9.092 | 9.092 | 9.092 | 9.092 | 9.092 | 100.0% | 1 | | nova.find_host_to_migrate | 1.381 | 1.381 | 1.381 | 1.381 | 1.381 | 1.381 | 100.0% | 1 | | nova.live_migrate | 17.262 | 17.262 | 17.262 | 17.262 | 17.262 | 17.262 | 100.0% | 1 | | nova.delete_server | 5.779 | 5.779 | 5.779 | 5.779 | 5.779 | 5.779 | 100.0% | 1 | | total | 42.044 | 42.044 | 42.044 | 42.044 | 42.044 | 42.044 | 100.0% | 1 | | -> duration | 41.044 | 41.044 | 41.044 | 41.044 | 41.044 | 41.044 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 41.044485 Full duration: 53.943522 -------------------------------------------------------------------------------- test scenario NovaKeypair.boot_and_delete_server_with_keypair args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "flavor": { "name": "rally-tiny-9e18599c-a795-40e3-9a2f-857e203b0e54" }, "image": { "name": "Cirros-0.4.0-9e18599c-a795-40e3-9a2f-857e203b0e54" }, "server_kwargs": { "nics": [ { "net-id": "81b197a1-8a9e-4284-93fb-61e3f2721f5d" } ] } }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "key_pairs": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } } } -------------------------------------------------------------------------------- Task ef90a94c-0a13-4ab3-90e2-04d34ea9b1c3 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 0.736 | 0.736 | 0.736 | 0.736 | 0.736 | 0.736 | 100.0% | 1 | | nova.boot_server | 8.632 | 8.632 | 8.632 | 8.632 | 8.632 | 8.632 | 100.0% | 1 | | nova.delete_server | 2.853 | 2.853 | 2.853 | 2.853 | 2.853 | 2.853 | 100.0% | 1 | | nova.delete_keypair | 0.052 | 0.052 | 0.052 | 0.052 | 0.052 | 0.052 | 100.0% | 1 | | total | 12.274 | 12.274 | 12.274 | 12.274 | 12.274 | 12.274 | 100.0% | 1 | | -> duration | 11.274 | 11.274 | 11.274 | 11.274 | 11.274 | 11.274 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 11.274499 Full duration: 41.25005 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_from_volume_and_delete args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "flavor": { "name": "rally-tiny-9e18599c-a795-40e3-9a2f-857e203b0e54" }, "image": { "name": "Cirros-0.4.0-9e18599c-a795-40e3-9a2f-857e203b0e54" }, "volume_size": 5, "nics": [ { "net-id": "81b197a1-8a9e-4284-93fb-61e3f2721f5d" } ] }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 }, "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } } } -------------------------------------------------------------------------------- Task ef90a94c-0a13-4ab3-90e2-04d34ea9b1c3 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 8.803 | 8.803 | 8.803 | 8.803 | 8.803 | 8.803 | 100.0% | 1 | | nova.boot_server | 7.13 | 7.13 | 7.13 | 7.13 | 7.13 | 7.13 | 100.0% | 1 | | nova.delete_server | 2.964 | 2.964 | 2.964 | 2.964 | 2.964 | 2.964 | 100.0% | 1 | | total | 18.897 | 18.897 | 18.897 | 18.897 | 18.897 | 18.897 | 100.0% | 1 | | -> duration | 17.897 | 17.897 | 17.897 | 17.897 | 17.897 | 17.897 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 17.897309 Full duration: 48.493849 -------------------------------------------------------------------------------- test scenario NovaServers.pause_and_unpause_server args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "flavor": { "name": "rally-tiny-9e18599c-a795-40e3-9a2f-857e203b0e54" }, "image": { "name": "Cirros-0.4.0-9e18599c-a795-40e3-9a2f-857e203b0e54" }, "force_delete": false, "nics": [ { "net-id": "81b197a1-8a9e-4284-93fb-61e3f2721f5d" } ] }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } } } -------------------------------------------------------------------------------- Task ef90a94c-0a13-4ab3-90e2-04d34ea9b1c3 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 12.915868 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_migrate_server args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "flavor": { "name": "rally-tiny-9e18599c-a795-40e3-9a2f-857e203b0e54" }, "image": { "name": "Cirros-0.4.0-9e18599c-a795-40e3-9a2f-857e203b0e54" }, "nics": [ { "net-id": "81b197a1-8a9e-4284-93fb-61e3f2721f5d" } ] }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task ef90a94c-0a13-4ab3-90e2-04d34ea9b1c3 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 9.553 | 9.553 | 9.553 | 9.553 | 9.553 | 9.553 | 100.0% | 1 | | nova.migrate | 31.529 | 31.529 | 31.529 | 31.529 | 31.529 | 31.529 | 100.0% | 1 | | nova.resize_confirm | 3.418 | 3.418 | 3.418 | 3.418 | 3.418 | 3.418 | 100.0% | 1 | | nova.delete_server | 2.641 | 2.641 | 2.641 | 2.641 | 2.641 | 2.641 | 100.0% | 1 | | total | 47.141 | 47.141 | 47.141 | 47.141 | 47.141 | 47.141 | 100.0% | 1 | | -> duration | 46.141 | 46.141 | 46.141 | 46.141 | 46.141 | 46.141 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 46.141351 Full duration: 57.140374 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_and_list_interfaces args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "flavor": { "name": "rally-tiny-9e18599c-a795-40e3-9a2f-857e203b0e54" }, "image": { "name": "Cirros-0.4.0-9e18599c-a795-40e3-9a2f-857e203b0e54" }, "auto_assign_nic": true }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {} } } -------------------------------------------------------------------------------- Task ef90a94c-0a13-4ab3-90e2-04d34ea9b1c3 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 9.340788 -------------------------------------------------------------------------------- test scenario NovaServerGroups.create_and_delete_server_group args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "policies": [ "affinity" ] }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task ef90a94c-0a13-4ab3-90e2-04d34ea9b1c3 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_server_group | 0.668 | 0.668 | 0.668 | 0.668 | 0.668 | 0.668 | 100.0% | 1 | | nova.delete_server_group | 0.081 | 0.081 | 0.081 | 0.081 | 0.081 | 0.081 | 100.0% | 1 | | total | 0.748 | 0.748 | 0.748 | 0.748 | 0.748 | 0.748 | 100.0% | 1 | | -> duration | 0.748 | 0.748 | 0.748 | 0.748 | 0.748 | 0.748 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.748418 Full duration: 10.034736 HINTS: * To plot HTML graphics with this data, run: rally task report ef90a94c-0a13-4ab3-90e2-04d34ea9b1c3 --out output.html * To generate a JUnit report, run: rally task export ef90a94c-0a13-4ab3-90e2-04d34ea9b1c3 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report ef90a94c-0a13-4ab3-90e2-04d34ea9b1c3 --json --out output.json 2018-05-07 19:41:58,705 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'ef90a94c-0a13-4ab3-90e2-04d34ea9b1c3'] 2018-05-07 19:41:59,734 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-05-07 19:41:59,734 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'ef90a94c-0a13-4ab3-90e2-04d34ea9b1c3', '--out', u'/home/opnfv/functest/results/rally/opnfv-nova.html'] 2018-05-07 19:41:59,743 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" OK. 2018-05-07 19:41:59,743 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2018-05-07 19:41:59,744 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-quotas.yaml 2018-05-07 19:41:59,744 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-05-07 19:41:59,759 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-05-07 19:41:59,759 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['quotas'], 'concurrency': 4, 'netid': '81b197a1-8a9e-4284-93fb-61e3f2721f5d', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-9e18599c-a795-40e3-9a2f-857e203b0e54', 'flavor_name': 'rally-tiny-9e18599c-a795-40e3-9a2f-857e203b0e54', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-9e18599c-a795-40e3-9a2f-857e203b0e54', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-05-07 19:42:54,831 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : a19aba1f-c600-4ce7-a083-6cc97ce95218 2018-05-07 19:42:54,832 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'a19aba1f-c600-4ce7-a083-6cc97ce95218'] 2018-05-07 19:42:55,773 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task a19aba1f-c600-4ce7-a083-6cc97ce95218: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task a19aba1f-c600-4ce7-a083-6cc97ce95218 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.694 | 0.694 | 0.694 | 0.694 | 0.694 | 0.694 | 100.0% | 1 | | quotas.delete_quotas | 0.182 | 0.182 | 0.182 | 0.182 | 0.182 | 0.182 | 100.0% | 1 | | total | 0.876 | 0.876 | 0.876 | 0.876 | 0.876 | 0.876 | 100.0% | 1 | | -> duration | 0.876 | 0.876 | 0.876 | 0.876 | 0.876 | 0.876 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.875761 Full duration: 8.633695 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task a19aba1f-c600-4ce7-a083-6cc97ce95218 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.741 | 0.741 | 0.741 | 0.741 | 0.741 | 0.741 | 100.0% | 1 | | total | 0.741 | 0.741 | 0.741 | 0.741 | 0.741 | 0.741 | 100.0% | 1 | | -> duration | 0.741 | 0.741 | 0.741 | 0.741 | 0.741 | 0.741 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.740938 Full duration: 8.787854 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task a19aba1f-c600-4ce7-a083-6cc97ce95218 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.671 | 0.671 | 0.671 | 0.671 | 0.671 | 0.671 | 100.0% | 1 | | total | 1.069 | 1.069 | 1.069 | 1.069 | 1.069 | 1.069 | 100.0% | 1 | | -> duration | 1.069 | 1.069 | 1.069 | 1.069 | 1.069 | 1.069 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.068726 Full duration: 9.257025 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task a19aba1f-c600-4ce7-a083-6cc97ce95218 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.461 | 1.461 | 1.461 | 1.461 | 1.461 | 1.461 | 100.0% | 1 | | total | 1.461 | 1.461 | 1.461 | 1.461 | 1.461 | 1.461 | 100.0% | 1 | | -> duration | 1.461 | 1.461 | 1.461 | 1.461 | 1.461 | 1.461 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.461042 Full duration: 10.567694 HINTS: * To plot HTML graphics with this data, run: rally task report a19aba1f-c600-4ce7-a083-6cc97ce95218 --out output.html * To generate a JUnit report, run: rally task export a19aba1f-c600-4ce7-a083-6cc97ce95218 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report a19aba1f-c600-4ce7-a083-6cc97ce95218 --json --out output.json 2018-05-07 19:42:55,774 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'a19aba1f-c600-4ce7-a083-6cc97ce95218'] 2018-05-07 19:42:56,777 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-05-07 19:42:56,777 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'a19aba1f-c600-4ce7-a083-6cc97ce95218', '--out', u'/home/opnfv/functest/results/rally/opnfv-quotas.html'] 2018-05-07 19:42:56,785 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2018-05-07 19:42:56,789 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:46 | 6 | 100.00% | | glance | 01:19 | 4 | 100.00% | | cinder | 02:50 | 10 | 100.00% | | heat | 01:01 | 4 | 100.00% | | keystone | 02:48 | 11 | 100.00% | | neutron | 04:49 | 11 | 100.00% | | nova | 05:21 | 7 | 100.00% | | quotas | 00:37 | 4 | 100.00% | | | | | | | TOTAL: | 00:19:34 | 57 | 100.00% | +----------------+------------+----------------+-----------+ 2018-05-07 19:42:56,789 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_sanity' success_rate is 100.00% 2018-05-07 19:43:06,286 - xtesting.energy.energy - DEBUG - Restoring previous scenario (default/default) 2018-05-07 19:43:06,286 - xtesting.energy.energy - DEBUG - Submitting scenario (default/default) 2018-05-07 19:43:06,838 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-05-07 19:43:06,838 - xtesting.ci.run_tests - INFO - Test result: +----------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +----------------------+------------------+------------------+----------------+ | rally_sanity | functest | 23:37 | PASS | +----------------------+------------------+------------------+----------------+ 2018-05-07 19:43:06,842 - xtesting.ci.run_tests - INFO - Running test case 'refstack_defcore'... 2018-05-07 19:43:06,943 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-05-07 19:43:09,308 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-05-07 19:43:08.998 11134 INFO rally.deployment.engine [-] Deployment c69c85e1-b6e5-48d3-8521-5b2ea7eb0c56 | Starting: Destroy cloud and free allocated resources. 2018-05-07 19:43:09.090 11134 INFO rally.deployment.engine [-] Deployment c69c85e1-b6e5-48d3-8521-5b2ea7eb0c56 | Completed: Destroy cloud and free allocated resources. 2018-05-07 19:43:09.112 11134 INFO rally.api [-] Deleting deployment-specific data for verifier 'opnfv-tempest' (UUID=ea2b22ba-0483-432d-b4af-83b7faa7e049). 2018-05-07 19:43:09.117 11134 INFO rally.api [-] Deployment-specific data has been successfully deleted! 2018-05-07 19:43:11,788 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-05-07 19:43:11.484 11137 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=9ae59cef-48c8-4de0-b6b9-aa11e3d0e5b0) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | 9ae59cef-48c8-4de0-b6b9-aa11e3d0e5b0 | 2018-05-07T19:43:11 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: 9ae59cef-48c8-4de0-b6b9-aa11e3d0e5b0 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-05-07 19:43:15,060 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | key-manager | Available | | __unknown__ | placement | Available | | __unknown__ | policy | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+----------------+-----------+ 2018-05-07 19:43:15,060 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-05-07 19:43:17,444 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify delete-verifier --id opnfv-tempest --force 2018-05-07 19:43:17.189 11143 INFO rally.api [-] Deleting verifier 'opnfv-tempest' (UUID=ea2b22ba-0483-432d-b4af-83b7faa7e049). 2018-05-07 19:43:17.311 11143 INFO rally.api [-] Verifier has been successfully deleted! 2018-05-07 19:43:20,918 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide 2018-05-07 19:43:19.468 11146 INFO rally.api [-] Creating verifier 'opnfv-tempest'. 2018-05-07 19:43:19.647 11146 INFO rally.verification.manager [-] Cloning verifier repo from /src/tempest. 2018-05-07 19:43:20.712 11146 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=673ec27a-aa78-4891-979f-5c33aa0cc1c8) has been successfully created! Using verifier 'opnfv-tempest' (UUID=673ec27a-aa78-4891-979f-5c33aa0cc1c8) as the default verifier for the future CLI operations. 2018-05-07 19:43:23,817 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-05-07 19:43:27,791 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating two images for Tempest suite 2018-05-07 19:43:34,774 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-05-07 19:43:40,508 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-05-07 19:43:38.922 11165 INFO rally.api [-] Configuring verifier 'opnfv-tempest' (UUID=673ec27a-aa78-4891-979f-5c33aa0cc1c8) for deployment 'opnfv-rally' (UUID=9ae59cef-48c8-4de0-b6b9-aa11e3d0e5b0). 2018-05-07 19:43:40.348 11165 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=673ec27a-aa78-4891-979f-5c33aa0cc1c8) has been successfully configured for deployment 'opnfv-rally' (UUID=9ae59cef-48c8-4de0-b6b9-aa11e3d0e5b0)! 2018-05-07 19:43:40,508 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-05-07 19:43:40,508 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-05-07 19:43:40,511 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-05-07 19:43:42,922 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', u'/home/opnfv/functest/results/refstack/tempest-list.txt']'. 2018-05-07 19:43:45,066 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:43:45.065 11177 INFO rally.api [-] Starting verification (UUID=c4121193-1bae-42f8-a116-6cc63728983d) for deployment 'opnfv-rally' (UUID=9ae59cef-48c8-4de0-b6b9-aa11e3d0e5b0) by verifier 'opnfv-tempest' (UUID=673ec27a-aa78-4891-979f-5c33aa0cc1c8). 2018-05-07 19:43:45,067 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Verification UUID: c4121193-1bae-42f8-a116-6cc63728983d 2018-05-07 19:43:55,201 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:43:55.201 11177 INFO opnfv-tempest [-] {12} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.010s] 2018-05-07 19:43:55,411 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:43:55.411 11177 INFO opnfv-tempest [-] {4} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.225s] 2018-05-07 19:43:55,463 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:43:55.462 11177 INFO opnfv-tempest [-] {8} tempest.api.compute.servers.test_availability_zone.AZV2TestJSON.test_get_availability_zone_list_with_non_admin_user ... success [0.254s] 2018-05-07 19:43:55,487 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:43:55.486 11177 INFO opnfv-tempest [-] {4} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_with_detail ... success [0.075s] 2018-05-07 19:43:55,572 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:43:55.572 11177 INFO opnfv-tempest [-] {14} tempest.api.identity.v3.test_tokens.TokensV3Test.test_create_token ... success [0.326s] 2018-05-07 19:43:56,033 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:43:56.033 11177 INFO opnfv-tempest [-] {6} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_delete_non_existing_tag ... success [0.884s] 2018-05-07 19:43:56,253 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:43:56.253 11177 INFO opnfv-tempest [-] {6} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_update_tags_for_non_existing_image ... success [0.219s] 2018-05-07 19:43:56,509 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:43:56.509 11177 INFO opnfv-tempest [-] {9} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [1.296s] 2018-05-07 19:44:01,360 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:01.360 11177 INFO opnfv-tempest [-] {9} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [4.850s] 2018-05-07 19:44:01,734 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:01.734 11177 INFO opnfv-tempest [-] {13} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_reserve_unreserve_volume ... success [1.795s] 2018-05-07 19:44:02,205 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:02.204 11177 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_additional_default_security_group_fails ... success [0.199s] 2018-05-07 19:44:03,310 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:03.309 11177 INFO opnfv-tempest [-] {13} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_bootable ... success [1.574s] 2018-05-07 19:44:03,993 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:03.993 11177 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.948s] 2018-05-07 19:44:04,076 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:04.076 11177 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.082s] 2018-05-07 19:44:04,149 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:04.148 11177 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.072s] 2018-05-07 19:44:04,519 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:04.518 11177 INFO opnfv-tempest [-] {13} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_readonly_update ... success [1.209s] 2018-05-07 19:44:05,426 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:05.426 11177 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password ... success [10.405s] 2018-05-07 19:44:06,583 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:06.583 11177 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_duplicate_security_group_rule_fails ... success [4.377s] 2018-05-07 19:44:08,264 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:08.263 11177 INFO opnfv-tempest [-] {14} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [3.653s] 2018-05-07 19:44:09,297 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:09.296 11177 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_ethertype ... success [2.713s] 2018-05-07 19:44:10,033 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:10.033 11177 INFO opnfv-tempest [-] {10} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON ... fail 2018-05-07 19:44:11,149 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:11.148 11177 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_with_nonexistent_volume_id ... success [0.207s] 2018-05-07 19:44:11,164 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:11.164 11177 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_image_null_id ... success [0.152s] 2018-05-07 19:44:11,317 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:11.317 11177 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_non_existing_image ... success [0.153s] 2018-05-07 19:44:11,325 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:11.324 11177 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_without_passing_volume_id ... success [0.176s] 2018-05-07 19:44:12,587 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:12.586 11177 INFO opnfv-tempest [-] {15} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON ... fail 2018-05-07 19:44:12,873 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:12.873 11177 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_protocol ... success [3.576s] 2018-05-07 19:44:13,300 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:13.300 11177 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_delete_deleted_image ... success [1.981s] 2018-05-07 19:44:13,308 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:13.308 11177 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_image_null_id ... success [0.008s] 2018-05-07 19:44:13,485 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:13.484 11177 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_non_existent_image ... success [0.176s] 2018-05-07 19:44:13,921 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:13.920 11177 INFO opnfv-tempest [-] {8} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_crud_volume_metadata ... success [4.422s] 2018-05-07 19:44:17,383 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:17.382 11177 INFO opnfv-tempest [-] {8} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_update_show_volume_metadata_item ... success [3.461s] 2018-05-07 19:44:17,664 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:17.664 11177 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_remote_ip_prefix ... success [4.789s] 2018-05-07 19:44:20,351 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:20.350 11177 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_invalid_size ... success [0.157s] 2018-05-07 19:44:20,576 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:20.575 11177 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_snapshot_id ... success [0.225s] 2018-05-07 19:44:20,817 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:20.817 11177 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_source_volid ... success [0.240s] 2018-05-07 19:44:21,014 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:21.014 11177 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_volume_type ... success [0.197s] 2018-05-07 19:44:21,176 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:21.176 11177 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_negative ... success [0.161s] 2018-05-07 19:44:21,271 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:21.271 11177 INFO opnfv-tempest [-] {6} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_crud_snapshot_metadata ... success [3.947s] 2018-05-07 19:44:21,333 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:21.333 11177 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_zero ... success [0.157s] 2018-05-07 19:44:21,557 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:21.557 11177 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_without_passing_size ... success [0.223s] 2018-05-07 19:44:21,747 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:21.747 11177 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_invalid_volume_id ... success [0.189s] 2018-05-07 19:44:21,870 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:21.869 11177 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_active_server ... success [26.874s] 2018-05-07 19:44:21,921 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:21.921 11177 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_volume_without_passing_volume_id ... success [0.174s] 2018-05-07 19:44:22,118 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:22.118 11177 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id ... success [0.196s] 2018-05-07 19:44:22,288 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:22.287 11177 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id ... success [0.169s] 2018-05-07 19:44:22,486 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:22.485 11177 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_invalid_status ... success [0.197s] 2018-05-07 19:44:22,529 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:22.529 11177 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_nonexistent_name ... success [0.044s] 2018-05-07 19:44:22,713 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:22.713 11177 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_invalid_status ... success [0.183s] 2018-05-07 19:44:22,891 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:22.891 11177 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_nonexistent_name ... success [0.177s] 2018-05-07 19:44:23,661 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:23.660 11177 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_reserve_volume_with_negative_volume_status ... success [0.768s] 2018-05-07 19:44:23,704 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:23.703 11177 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_reserve_volume_with_nonexistent_volume_id ... success [0.042s] 2018-05-07 19:44:23,750 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:23.749 11177 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_unreserve_volume_with_nonexistent_volume_id ... success [0.045s] 2018-05-07 19:44:23,760 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:23.760 11177 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_invalid_ports ... success [6.094s] 2018-05-07 19:44:23,764 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:23.763 11177 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_empty_volume_id ... success [0.012s] 2018-05-07 19:44:23,800 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:23.800 11177 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_invalid_volume_id ... success [0.036s] 2018-05-07 19:44:24,100 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:24.099 11177 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_nonexistent_volume_id ... success [0.298s] 2018-05-07 19:44:24,134 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:24.133 11177 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_delete_nonexistent_volume_id ... success [0.034s] 2018-05-07 19:44:24,167 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:24.166 11177 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_get_nonexistent_volume_id ... success [0.032s] 2018-05-07 19:44:24,317 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:24.317 11177 INFO opnfv-tempest [-] {6} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_update_show_snapshot_metadata_item ... success [3.043s] 2018-05-07 19:44:24,563 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:24.562 11177 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action ... success [0.062s] 2018-05-07 19:44:27,333 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:27.332 11177 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_remote_groupid ... success [3.571s] 2018-05-07 19:44:28,633 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:28.633 11177 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON ... fail 2018-05-07 19:44:28,715 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:28.714 11177 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_security_group ... success [1.383s] 2018-05-07 19:44:28,886 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:28.886 11177 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_delete_non_existent_security_group ... success [0.171s] 2018-05-07 19:44:28,905 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:28.904 11177 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group ... success [0.018s] 2018-05-07 19:44:28,922 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:28.922 11177 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group_rule ... success [0.017s] 2018-05-07 19:44:31,252 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:31.251 11177 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions ... success [6.687s] 2018-05-07 19:44:34,432 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:34.432 11177 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor ... success [0.358s] 2018-05-07 19:44:34,694 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:34.693 11177 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image ... success [0.260s] 2018-05-07 19:44:34,918 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:34.917 11177 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name ... success [0.224s] 2018-05-07 19:44:35,675 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:35.674 11177 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status ... success [0.755s] 2018-05-07 19:44:35,972 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:35.972 11177 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results ... success [0.298s] 2018-05-07 19:44:36,061 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:36.059 11177 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_active_status ... success [0.084s] 2018-05-07 19:44:36,142 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:36.142 11177 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor ... success [0.084s] 2018-05-07 19:44:36,223 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:36.223 11177 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image ... success [0.080s] 2018-05-07 19:44:36,300 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:36.300 11177 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit ... success [0.077s] 2018-05-07 19:44:36,364 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:36.364 11177 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name ... success [0.064s] 2018-05-07 19:44:36,514 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:36.513 11177 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard ... success [0.149s] 2018-05-07 19:44:37,248 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:37.248 11177 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair ... success [31.812s] 2018-05-07 19:44:37,435 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:37.435 11177 INFO opnfv-tempest [-] {15} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [20.589s] 2018-05-07 19:44:44,483 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:44.482 11177 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item ... success [0.886s] 2018-05-07 19:44:44,555 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:44.555 11177 INFO opnfv-tempest [-] {3} tempest.api.image.v2.test_images_tags.ImagesTagsTest.test_update_delete_tags_for_image ... success [2.751s] 2018-05-07 19:44:44,916 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:44.916 11177 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item ... success [0.433s] 2018-05-07 19:44:46,164 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:46.163 11177 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata ... success [1.246s] 2018-05-07 19:44:46,744 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:46.744 11177 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata ... success [0.579s] 2018-05-07 19:44:47,368 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:47.368 11177 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item ... success [0.624s] 2018-05-07 19:44:47,975 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:47.974 11177 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name ... success [1.398s] 2018-05-07 19:44:49,108 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:49.107 11177 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata ... success [1.738s] 2018-05-07 19:44:49,338 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:49.338 11177 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit ... success [1.363s] 2018-05-07 19:44:50,882 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:50.881 11177 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 ... success [1.542s] 2018-05-07 19:44:52,005 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:52.005 11177 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date ... success [0.079s] 2018-05-07 19:44:52,021 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:52.020 11177 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date ... success [0.015s] 2018-05-07 19:44:52,173 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:52.173 11177 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count ... success [0.151s] 2018-05-07 19:44:52,185 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:52.185 11177 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value ... success [0.011s] 2018-05-07 19:44:52,196 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:52.196 11177 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string ... success [0.011s] 2018-05-07 19:44:52,227 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:52.227 11177 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor ... success [0.030s] 2018-05-07 19:44:52,291 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:52.290 11177 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image ... success [0.063s] 2018-05-07 19:44:52,363 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:52.363 11177 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name ... success [0.072s] 2018-05-07 19:44:52,677 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:52.677 11177 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted ... success [0.313s] 2018-05-07 19:44:52,695 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:52.694 11177 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing ... success [0.017s] 2018-05-07 19:44:52,771 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:52.770 11177 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server ... success [0.075s] 2018-05-07 19:44:52,901 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:52.901 11177 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor ... success [2.019s] 2018-05-07 19:44:54,337 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:54.336 11177 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image ... success [1.434s] 2018-05-07 19:44:54,403 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:54.402 11177 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.190s] 2018-05-07 19:44:54,580 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:54.579 11177 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_by_name ... success [0.176s] 2018-05-07 19:44:54,628 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:54.628 11177 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_by_name ... success [0.048s] 2018-05-07 19:44:55,389 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:55.389 11177 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_pagination ... success [0.760s] 2018-05-07 19:44:55,662 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:55.662 11177 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_with_multiple_params ... success [0.272s] 2018-05-07 19:44:55,828 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:55.828 11177 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid ... success [1.491s] 2018-05-07 19:44:56,063 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:56.062 11177 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_pagination ... success [0.400s] 2018-05-07 19:44:56,260 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:56.260 11177 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_param_display_name_and_status ... success [0.197s] 2018-05-07 19:44:56,309 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:56.308 11177 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_display_name_and_status ... success [0.048s] 2018-05-07 19:44:56,366 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:56.365 11177 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_metadata ... success [0.057s] 2018-05-07 19:44:56,450 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:56.450 11177 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_details ... success [0.084s] 2018-05-07 19:44:56,491 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:56.491 11177 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_param_metadata ... success [0.040s] 2018-05-07 19:44:56,532 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:56.532 11177 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit ... success [0.705s] 2018-05-07 19:44:56,717 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:56.717 11177 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_availability_zone ... success [0.225s] 2018-05-07 19:44:56,975 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:56.975 11177 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_status ... success [0.257s] 2018-05-07 19:44:57,032 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:57.031 11177 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_availability_zone ... success [0.057s] 2018-05-07 19:44:57,231 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:57.230 11177 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_status ... success [0.198s] 2018-05-07 19:44:57,420 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:57.419 11177 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id ... success [0.886s] 2018-05-07 19:44:57,823 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:57.822 11177 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server ... success [0.402s] 2018-05-07 19:44:59,071 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:44:59.070 11177 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address ... success [1.246s] 2018-05-07 19:45:00,137 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:00.137 11177 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server ... success [1.067s] 2018-05-07 19:45:00,827 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:00.826 11177 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_deleted_server ... success [0.689s] 2018-05-07 19:45:01,093 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:01.092 11177 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server ... success [0.266s] 2018-05-07 19:45:02,003 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:02.003 11177 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_bulk_port ... success [5.564s] 2018-05-07 19:45:02,615 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:02.614 11177 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank ... success [1.520s] 2018-05-07 19:45:03,012 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:03.011 11177 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server ... success [0.397s] 2018-05-07 19:45:03,550 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:03.550 11177 INFO opnfv-tempest [-] {15} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_as_clone ... success [26.108s] 2018-05-07 19:45:03,554 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:03.554 11177 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [2.641s] 2018-05-07 19:45:03,833 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:03.833 11177 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server ... success [0.821s] 2018-05-07 19:45:04,368 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:04.367 11177 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 ... success [0.533s] 2018-05-07 19:45:04,714 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:04.714 11177 INFO opnfv-tempest [-] {7} tempest.api.volume.test_extensions.ExtensionsTestJSON.test_list_extensions ... success [0.279s] 2018-05-07 19:45:04,991 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:04.991 11177 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name ... success [0.624s] 2018-05-07 19:45:06,181 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:06.181 11177 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_additional_args ... success [2.626s] 2018-05-07 19:45:09,111 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:09.111 11177 INFO opnfv-tempest [-] {5} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image ... success [49.276s] 2018-05-07 19:45:10,556 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:10.556 11177 INFO opnfv-tempest [-] {5} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name ... success [1.449s] 2018-05-07 19:45:10,590 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:10.589 11177 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [8.586s] 2018-05-07 19:45:11,759 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:11.759 11177 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_all_attributes ... success [6.913s] 2018-05-07 19:45:11,864 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:11.864 11177 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name ... success [34.610s] 2018-05-07 19:45:13,779 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:13.778 11177 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [3.187s] 2018-05-07 19:45:13,988 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:13.988 11177 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.210s] 2018-05-07 19:45:15,522 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:15.522 11177 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports_fields ... success [1.533s] 2018-05-07 19:45:15,736 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:15.735 11177 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.213s] 2018-05-07 19:45:15,872 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:15.872 11177 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_icmp_type_code ... success [9.687s] 2018-05-07 19:45:15,924 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:15.923 11177 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port_fields ... success [0.187s] 2018-05-07 19:45:17,106 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:17.105 11177 INFO opnfv-tempest [-] {13} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_upload ... success [72.578s] 2018-05-07 19:45:17,751 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:17.751 11177 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_protocol_integer_value ... success [1.881s] 2018-05-07 19:45:20,825 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:20.824 11177 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_allocation_pools ... success [9.064s] 2018-05-07 19:45:21,105 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:21.104 11177 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_group_id ... success [3.351s] 2018-05-07 19:45:22,919 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:22.919 11177 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_ip_prefix ... success [1.813s] 2018-05-07 19:45:25,068 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:25.067 11177 INFO opnfv-tempest [-] {15} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [21.517s] 2018-05-07 19:45:25,542 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:25.542 11177 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_dhcp_enabled ... success [4.716s] 2018-05-07 19:45:26,239 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:26.239 11177 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [3.317s] 2018-05-07 19:45:26,285 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:26.285 11177 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.049s] 2018-05-07 19:45:26,614 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:26.614 11177 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address ... success [14.752s] 2018-05-07 19:45:31,720 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:31.719 11177 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw ... success [6.177s] 2018-05-07 19:45:34,763 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:34.762 11177 INFO opnfv-tempest [-] {13} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_details_with_params ... success [0.539s] 2018-05-07 19:45:35,136 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:35.136 11177 INFO opnfv-tempest [-] {13} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_with_params ... success [0.374s] 2018-05-07 19:45:36,335 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:36.334 11177 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw_and_allocation_pools ... success [4.614s] 2018-05-07 19:45:39,859 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:39.859 11177 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_host_routes_and_dns_nameservers ... success [3.524s] 2018-05-07 19:45:40,398 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:40.398 11177 INFO opnfv-tempest [-] {5} tempest.api.compute.servers.test_create_server.ServersTestManualDisk ... fail 2018-05-07 19:45:42,895 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:42.895 11177 INFO opnfv-tempest [-] {5} tempest.api.volume.test_availability_zone.AvailabilityZoneTestJSON.test_get_availability_zone_list ... success [0.170s] 2018-05-07 19:45:44,321 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:44.320 11177 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_without_gateway ... success [4.460s] 2018-05-07 19:45:49,133 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:49.133 11177 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [4.812s] 2018-05-07 19:45:53,055 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:53.055 11177 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_delete_network_with_subnet ... success [3.920s] 2018-05-07 19:45:53,332 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:53.331 11177 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.276s] 2018-05-07 19:45:53,504 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:53.503 11177 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks_fields ... success [0.172s] 2018-05-07 19:45:53,565 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:53.565 11177 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.061s] 2018-05-07 19:45:53,630 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:53.630 11177 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets_fields ... success [0.064s] 2018-05-07 19:45:53,888 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:53.888 11177 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.257s] 2018-05-07 19:45:54,156 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:54.156 11177 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network_fields ... success [0.267s] 2018-05-07 19:45:54,416 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:54.416 11177 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.260s] 2018-05-07 19:45:54,472 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:54.471 11177 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet_fields ... success [0.055s] 2018-05-07 19:45:59,186 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:45:59.186 11177 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_update_subnet_gw_dns_host_routes_dhcp ... success [4.713s] 2018-05-07 19:46:12,963 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:46:12.962 11177 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_snapshot_create_get_list_update_delete ... success [4.835s] 2018-05-07 19:46:20,041 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:46:20.040 11177 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_volume_from_snapshot ... success [7.076s] 2018-05-07 19:46:25,520 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:46:25.520 11177 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name ... success [58.890s] 2018-05-07 19:46:29,825 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:46:29.824 11177 INFO opnfv-tempest [-] {2} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas ... success [0.265s] 2018-05-07 19:46:30,266 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:46:30.265 11177 INFO opnfv-tempest [-] {2} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas ... success [0.440s] 2018-05-07 19:46:44,831 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:46:44.830 11177 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_image_schema ... success [0.547s] 2018-05-07 19:46:44,839 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:46:44.839 11177 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_images_schema ... success [0.008s] 2018-05-07 19:46:45,027 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:46:45.026 11177 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_container_format ... success [0.187s] 2018-05-07 19:46:45,216 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:46:45.216 11177 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_disk_format ... success [0.189s] 2018-05-07 19:46:45,402 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:46:45.401 11177 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_limit ... success [0.185s] 2018-05-07 19:46:45,615 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:46:45.615 11177 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_min_max_size ... success [0.212s] 2018-05-07 19:46:45,967 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:46:45.966 11177 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_size ... success [0.351s] 2018-05-07 19:46:46,017 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:46:46.017 11177 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_status ... success [0.050s] 2018-05-07 19:46:46,060 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:46:46.060 11177 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_visibility ... success [0.043s] 2018-05-07 19:46:46,647 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:46:46.646 11177 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_no_params ... success [0.585s] 2018-05-07 19:46:59,893 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', 'c4121193-1bae-42f8-a116-6cc63728983d']'. 2018-05-07 19:47:00,921 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2018-05-07 19:47:00,922 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2018-05-07 19:47:00,922 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-05-07 19:47:00,922 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | c4121193-1bae-42f8-a116-6cc63728983d | 2018-05-07 19:47:00,922 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | failed | 2018-05-07 19:47:00,922 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2018-05-07 19:43:45 | 2018-05-07 19:47:00,922 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2018-05-07 19:46:59 | 2018-05-07 19:47:00,922 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 0:03:14 | 2018-05-07 19:47:00,923 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | load_list: (value is too long, use 'detailed' flag to display it) | 2018-05-07 19:47:00,923 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2018-05-07 19:47:00,923 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: 673ec27a-aa78-4891-979f-5c33aa0cc1c8) | 2018-05-07 19:47:00,923 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2018-05-07 19:47:00,923 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: 9ae59cef-48c8-4de0-b6b9-aa11e3d0e5b0) | 2018-05-07 19:47:00,923 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 204 | 2018-05-07 19:47:00,923 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 173.844 | 2018-05-07 19:47:00,923 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 188 | 2018-05-07 19:47:00,923 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 0 | 2018-05-07 19:47:00,923 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2018-05-07 19:47:00,924 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2018-05-07 19:47:00,924 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 16 | 2018-05-07 19:47:00,924 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-05-07 19:47:00,924 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +--------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2018-05-07 19:47:01,018 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest refstack_defcore success_rate is 92.1568627451% 2018-05-07 19:47:08,969 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-05-07 19:47:08,969 - xtesting.ci.run_tests - INFO - Test result: +--------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------------+------------------+------------------+----------------+ | refstack_defcore | functest | 03:45 | FAIL | +--------------------------+------------------+------------------+----------------+ 2018-05-07 19:47:08,973 - xtesting.ci.run_tests - ERROR - The test case 'refstack_defcore' failed. 2018-05-07 19:47:08,973 - xtesting.ci.run_tests - INFO - Running test case 'patrole'... 2018-05-07 19:47:09,069 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-05-07 19:47:11,468 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-05-07 19:47:11.123 11267 INFO rally.deployment.engine [-] Deployment 9ae59cef-48c8-4de0-b6b9-aa11e3d0e5b0 | Starting: Destroy cloud and free allocated resources. 2018-05-07 19:47:11.192 11267 INFO rally.deployment.engine [-] Deployment 9ae59cef-48c8-4de0-b6b9-aa11e3d0e5b0 | Completed: Destroy cloud and free allocated resources. 2018-05-07 19:47:11.219 11267 INFO rally.api [-] Deleting all verifications created by verifier 'opnfv-tempest' (UUID=673ec27a-aa78-4891-979f-5c33aa0cc1c8) for deployment 'opnfv-rally'. 2018-05-07 19:47:11.233 11267 INFO rally.api [-] Deleting verification (UUID=c4121193-1bae-42f8-a116-6cc63728983d). 2018-05-07 19:47:11.283 11267 INFO rally.api [-] Verification has been successfully deleted! 2018-05-07 19:47:11.283 11267 INFO rally.api [-] Deleting deployment-specific data for verifier 'opnfv-tempest' (UUID=673ec27a-aa78-4891-979f-5c33aa0cc1c8). 2018-05-07 19:47:11.290 11267 INFO rally.api [-] Deployment-specific data has been successfully deleted! 2018-05-07 19:47:13,767 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-05-07 19:47:13.531 11270 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=58f031f2-93fd-4b81-98e2-3a2a53090eba) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | 58f031f2-93fd-4b81-98e2-3a2a53090eba | 2018-05-07T19:47:13 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: 58f031f2-93fd-4b81-98e2-3a2a53090eba ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-05-07 19:47:16,911 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | key-manager | Available | | __unknown__ | placement | Available | | __unknown__ | policy | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+----------------+-----------+ 2018-05-07 19:47:16,912 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-05-07 19:47:19,211 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify delete-verifier --id opnfv-tempest --force 2018-05-07 19:47:18.946 11276 INFO rally.api [-] Deleting verifier 'opnfv-tempest' (UUID=673ec27a-aa78-4891-979f-5c33aa0cc1c8). 2018-05-07 19:47:19.069 11276 INFO rally.api [-] Verifier has been successfully deleted! 2018-05-07 19:47:22,734 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide 2018-05-07 19:47:21.392 11279 INFO rally.api [-] Creating verifier 'opnfv-tempest'. 2018-05-07 19:47:21.540 11279 INFO rally.verification.manager [-] Cloning verifier repo from /src/tempest. 2018-05-07 19:47:22.575 11279 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=229005f9-95c1-40f7-a830-ca24582ed5b6) has been successfully created! Using verifier 'opnfv-tempest' (UUID=229005f9-95c1-40f7-a830-ca24582ed5b6) as the default verifier for the future CLI operations. 2018-05-07 19:47:25,706 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-05-07 19:47:28,082 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating two images for Tempest suite 2018-05-07 19:47:35,173 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-05-07 19:47:40,551 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-05-07 19:47:39.338 11298 INFO rally.api [-] Configuring verifier 'opnfv-tempest' (UUID=229005f9-95c1-40f7-a830-ca24582ed5b6) for deployment 'opnfv-rally' (UUID=58f031f2-93fd-4b81-98e2-3a2a53090eba). 2018-05-07 19:47:40.370 11298 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=229005f9-95c1-40f7-a830-ca24582ed5b6) has been successfully configured for deployment 'opnfv-rally' (UUID=58f031f2-93fd-4b81-98e2-3a2a53090eba)! 2018-05-07 19:47:40,551 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-05-07 19:47:40,551 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-05-07 19:47:40,553 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-05-07 19:47:40,566 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Generating test case list... 2018-05-07 19:47:43,736 - functest.opnfv_tests.openstack.tempest.tempest - INFO - (cd /root/.rally/verification/verifier-229005f9-95c1-40f7-a830-ca24582ed5b6/repo; testr list-tests '(?!.*test_networks_multiprovider_rbac)(?=patrole_tempest_plugin.tests.api.(image|network|volume))' >/home/opnfv/functest/results/patrole/tempest-list.txt 2>/dev/null) 2018-05-07 19:47:43,737 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', u'/home/opnfv/functest/results/patrole/tempest-list.txt']'. 2018-05-07 19:47:45,790 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 19:47:45.789 11307 INFO rally.api [-] Starting verification (UUID=9fdc6cba-9317-4051-b440-029445ab5549) for deployment 'opnfv-rally' (UUID=58f031f2-93fd-4b81-98e2-3a2a53090eba) by verifier 'opnfv-tempest' (UUID=229005f9-95c1-40f7-a830-ca24582ed5b6). 2018-05-07 19:47:45,790 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Verification UUID: 9fdc6cba-9317-4051-b440-029445ab5549 2018-05-07 19:50:31,880 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', '9fdc6cba-9317-4051-b440-029445ab5549']'. 2018-05-07 19:50:32,921 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2018-05-07 19:50:32,921 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2018-05-07 19:50:32,921 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-05-07 19:50:32,921 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | 9fdc6cba-9317-4051-b440-029445ab5549 | 2018-05-07 19:50:32,921 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | finished | 2018-05-07 19:50:32,922 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2018-05-07 19:47:45 | 2018-05-07 19:50:32,922 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2018-05-07 19:50:31 | 2018-05-07 19:50:32,922 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 0:02:46 | 2018-05-07 19:50:32,922 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | load_list: (value is too long, use 'detailed' flag to display it) | 2018-05-07 19:50:32,922 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2018-05-07 19:50:32,922 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: 229005f9-95c1-40f7-a830-ca24582ed5b6) | 2018-05-07 19:50:32,922 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2018-05-07 19:50:32,922 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: 58f031f2-93fd-4b81-98e2-3a2a53090eba) | 2018-05-07 19:50:32,922 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 287 | 2018-05-07 19:50:32,922 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 156.158 | 2018-05-07 19:50:32,922 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 124 | 2018-05-07 19:50:32,923 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 163 | 2018-05-07 19:50:32,923 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2018-05-07 19:50:32,923 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2018-05-07 19:50:32,923 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 0 | 2018-05-07 19:50:32,923 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-05-07 19:50:32,923 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2018-05-07 19:50:33,069 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest patrole success_rate is 100.0% 2018-05-07 19:50:39,487 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-05-07 19:50:39,488 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | patrole | functest | 03:14 | PASS | +-------------------+------------------+------------------+----------------+ 2018-05-07 19:50:39,492 - xtesting.ci.run_tests - INFO - Running test case 'odl'... 2018-05-07 19:50:59,297 - xtesting.core.robotframework - INFO - ============================================================================== Basic & Neutron ============================================================================== Basic & Neutron.Basic ============================================================================== Basic & Neutron.Basic.Restconf Modules :: Test suite to verify Restconf is OK. ============================================================================== Get Controller Modules :: Get the restconf modules, check 200 stat... | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Basic.Restconf Modules :: Test suite to verify Res... | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Basic & Neutron.Basic | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Basic & Neutron.Neutron :: Test suite for Neutron Plugin ============================================================================== Basic & Neutron.Neutron.Reachability ============================================================================== Get the complete list of networks :: Get the complete list of netw... | PASS | ------------------------------------------------------------------------------ Get the complete list of subnets :: Get the complete list of subnets | PASS | ------------------------------------------------------------------------------ Get the complete list of ports :: Get the complete list of ports | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Reachability | PASS | 3 critical tests, 3 passed, 0 failed 3 tests total, 3 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Networks :: Checking Network created in OpenStack a... ============================================================================== Check OpenStack Networks :: Checking OpenStack Neutron for known n... | PASS | ------------------------------------------------------------------------------ Check OpenDaylight Networks :: Checking OpenDaylight Neutron API f... | PASS | ------------------------------------------------------------------------------ Create Network :: Create new network in OpenStack | PASS | ------------------------------------------------------------------------------ Check Network :: Check network created in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Networks :: Checking Network created in Op... | PASS | 4 critical tests, 4 passed, 0 failed 4 tests total, 4 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Subnets :: Checking Subnets created in OpenStack ar... ============================================================================== Check OpenStack Subnets :: Checking OpenStack Neutron for known su... | PASS | ------------------------------------------------------------------------------ Check OpenDaylight subnets :: Checking OpenDaylight Neutron API fo... | PASS | ------------------------------------------------------------------------------ Create New subnet :: Create new subnet in OpenStack | PASS | ------------------------------------------------------------------------------ Check New subnet :: Check new subnet created in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Subnets :: Checking Subnets created in Ope... | PASS | 4 critical tests, 4 passed, 0 failed 4 tests total, 4 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Ports :: Checking Port created in OpenStack are pus... ============================================================================== Check OpenStack ports :: Checking OpenStack Neutron for known ports | PASS | ------------------------------------------------------------------------------ Check OpenDaylight ports :: Checking OpenDaylight Neutron API for ... | PASS | ------------------------------------------------------------------------------ Create New Port :: Create new port in OpenStack | PASS | ------------------------------------------------------------------------------ Check New Port :: Check new port created in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Ports :: Checking Port created in OpenStac... | PASS | 4 critical tests, 4 passed, 0 failed 4 tests total, 4 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Delete Ports :: Checking Port deleted in OpenStack ... ============================================================================== Delete New Port :: Delete previously created port in OpenStack | PASS | ------------------------------------------------------------------------------ Check Port Deleted :: Check port deleted in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Delete Ports :: Checking Port deleted in O... | PASS | 2 critical tests, 2 passed, 0 failed 2 tests total, 2 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Delete Subnets :: Checking Subnets deleted in OpenS... ============================================================================== Delete New subnet :: Delete previously created subnet in OpenStack | PASS | ------------------------------------------------------------------------------ Check New subnet deleted :: Check subnet deleted in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Delete Subnets :: Checking Subnets deleted... | PASS | 2 critical tests, 2 passed, 0 failed 2 tests total, 2 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Delete Networks :: Checking Network deleted in Open... ============================================================================== Delete Network :: Delete network in OpenStack | PASS | ------------------------------------------------------------------------------ Check Network deleted :: Check network deleted in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Delete Networks :: Checking Network delete... | PASS | 2 critical tests, 2 passed, 0 failed 2 tests total, 2 passed, 0 failed ============================================================================== Basic & Neutron.Neutron :: Test suite for Neutron Plugin | PASS | 21 critical tests, 21 passed, 0 failed 21 tests total, 21 passed, 0 failed ============================================================================== Basic & Neutron | PASS | 22 critical tests, 22 passed, 0 failed 22 tests total, 22 passed, 0 failed ============================================================================== Output: /home/opnfv/functest/results/odl/output.xml 2018-05-07 19:50:59,297 - xtesting.core.robotframework - INFO - Results were successfully generated 2018-05-07 19:50:59,326 - xtesting.core.robotframework - INFO - Results were successfully parsed 2018-05-07 19:50:59,487 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-05-07 19:50:59,487 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | odl | functest | 00:19 | PASS | +-------------------+------------------+------------------+----------------+ 2018-05-07 19:50:59,491 - xtesting.ci.run_tests - INFO - Running test case 'snaps_smoke'... 2018-05-07 19:51:00,483 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-05-07 20:31:38,732 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-05-07 20:31:38,732 - xtesting.ci.run_tests - INFO - Test result: +---------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +---------------------+------------------+------------------+----------------+ | snaps_smoke | functest | 40:38 | FAIL | +---------------------+------------------+------------------+----------------+ 2018-05-07 20:31:38,736 - xtesting.ci.run_tests - ERROR - The test case 'snaps_smoke' failed. 2018-05-07 20:31:38,736 - xtesting.ci.run_tests - INFO - Running test case 'neutron_trunk'... 2018-05-07 20:31:38,825 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-05-07 20:31:41,358 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-05-07 20:31:40.909 11397 INFO rally.deployment.engine [-] Deployment 58f031f2-93fd-4b81-98e2-3a2a53090eba | Starting: Destroy cloud and free allocated resources. 2018-05-07 20:31:41.002 11397 INFO rally.deployment.engine [-] Deployment 58f031f2-93fd-4b81-98e2-3a2a53090eba | Completed: Destroy cloud and free allocated resources. 2018-05-07 20:31:41.064 11397 INFO rally.api [-] Deleting all verifications created by verifier 'opnfv-tempest' (UUID=229005f9-95c1-40f7-a830-ca24582ed5b6) for deployment 'opnfv-rally'. 2018-05-07 20:31:41.097 11397 INFO rally.api [-] Deleting verification (UUID=9fdc6cba-9317-4051-b440-029445ab5549). 2018-05-07 20:31:41.145 11397 INFO rally.api [-] Verification has been successfully deleted! 2018-05-07 20:31:41.145 11397 INFO rally.api [-] Deleting deployment-specific data for verifier 'opnfv-tempest' (UUID=229005f9-95c1-40f7-a830-ca24582ed5b6). 2018-05-07 20:31:41.154 11397 INFO rally.api [-] Deployment-specific data has been successfully deleted! 2018-05-07 20:31:43,776 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-05-07 20:31:43.462 11400 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=6af56e34-9ddf-4d91-b6ac-a5f51660fc24) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | 6af56e34-9ddf-4d91-b6ac-a5f51660fc24 | 2018-05-07T20:31:43 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: 6af56e34-9ddf-4d91-b6ac-a5f51660fc24 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-05-07 20:31:46,966 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | key-manager | Available | | __unknown__ | placement | Available | | __unknown__ | policy | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+----------------+-----------+ 2018-05-07 20:31:46,967 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-05-07 20:31:49,424 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify delete-verifier --id opnfv-tempest --force 2018-05-07 20:31:49.128 11406 INFO rally.api [-] Deleting verifier 'opnfv-tempest' (UUID=229005f9-95c1-40f7-a830-ca24582ed5b6). 2018-05-07 20:31:49.265 11406 INFO rally.api [-] Verifier has been successfully deleted! 2018-05-07 20:31:52,924 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide 2018-05-07 20:31:51.544 11409 INFO rally.api [-] Creating verifier 'opnfv-tempest'. 2018-05-07 20:31:51.667 11409 INFO rally.verification.manager [-] Cloning verifier repo from /src/tempest. 2018-05-07 20:31:52.756 11409 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=7a9fd8ae-60fc-411f-9484-395839f72ce6) has been successfully created! Using verifier 'opnfv-tempest' (UUID=7a9fd8ae-60fc-411f-9484-395839f72ce6) as the default verifier for the future CLI operations. 2018-05-07 20:32:04,942 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-05-07 20:32:10,261 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-05-07 20:32:09.228 11428 INFO rally.api [-] Configuring verifier 'opnfv-tempest' (UUID=7a9fd8ae-60fc-411f-9484-395839f72ce6) for deployment 'opnfv-rally' (UUID=6af56e34-9ddf-4d91-b6ac-a5f51660fc24). 2018-05-07 20:32:10.093 11428 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=7a9fd8ae-60fc-411f-9484-395839f72ce6) has been successfully configured for deployment 'opnfv-rally' (UUID=6af56e34-9ddf-4d91-b6ac-a5f51660fc24)! 2018-05-07 20:32:13,155 - functest.opnfv_tests.openstack.tempest.tempest - INFO - (cd /root/.rally/verification/verifier-7a9fd8ae-60fc-411f-9484-395839f72ce6/repo; testr list-tests 'neutron.tests.tempest.(api|scenario).test_trunk' >/home/opnfv/functest/results/neutron_trunk/test_list.txt 2>/dev/null) 2018-05-07 20:32:13,157 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', u'/home/opnfv/functest/results/neutron_trunk/test_list.txt']'. 2018-05-07 20:32:15,352 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-07 20:32:15.350 11437 INFO rally.api [-] Starting verification (UUID=74924f7a-8b1a-4adf-912b-c14bf4d15c47) for deployment 'opnfv-rally' (UUID=6af56e34-9ddf-4d91-b6ac-a5f51660fc24) by verifier 'opnfv-tempest' (UUID=7a9fd8ae-60fc-411f-9484-395839f72ce6). 2018-05-07 20:34:07,841 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', '74924f7a-8b1a-4adf-912b-c14bf4d15c47']'. 2018-05-07 20:34:08,785 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2018-05-07 20:34:08,785 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2018-05-07 20:34:08,786 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-05-07 20:34:08,786 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | 74924f7a-8b1a-4adf-912b-c14bf4d15c47 | 2018-05-07 20:34:08,786 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | failed | 2018-05-07 20:34:08,786 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2018-05-07 20:32:15 | 2018-05-07 20:34:08,786 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2018-05-07 20:34:07 | 2018-05-07 20:34:08,786 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 0:01:52 | 2018-05-07 20:34:08,786 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | load_list: (value is too long, use 'detailed' flag to display it) | 2018-05-07 20:34:08,786 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2018-05-07 20:34:08,786 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: 7a9fd8ae-60fc-411f-9484-395839f72ce6) | 2018-05-07 20:34:08,786 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2018-05-07 20:34:08,787 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: 6af56e34-9ddf-4d91-b6ac-a5f51660fc24) | 2018-05-07 20:34:08,787 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 52 | 2018-05-07 20:34:08,787 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 100.808 | 2018-05-07 20:34:08,787 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 42 | 2018-05-07 20:34:08,787 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 8 | 2018-05-07 20:34:08,787 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2018-05-07 20:34:08,787 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2018-05-07 20:34:08,787 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 2 | 2018-05-07 20:34:08,787 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-05-07 20:34:08,787 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------------------------------------------------------------------+ 2018-05-07 20:34:08,813 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest neutron_trunk success_rate is 95.4545454545% 2018-05-07 20:34:15,864 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-05-07 20:34:15,864 - xtesting.ci.run_tests - INFO - Test result: +-----------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-----------------------+------------------+------------------+----------------+ | neutron_trunk | functest | 02:20 | FAIL | +-----------------------+------------------+------------------+----------------+ 2018-05-07 20:34:15,869 - xtesting.ci.run_tests - ERROR - The test case 'neutron_trunk' failed. 2018-05-07 20:34:15,873 - xtesting.ci.run_tests - INFO - Xtesting report: +------------------------------+------------------+---------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +------------------------------+------------------+---------------+------------------+----------------+ | vping_ssh | functest | smoke | 00:57 | PASS | | vping_userdata | functest | smoke | 01:36 | PASS | | tempest_smoke_serial | functest | smoke | 18:35 | PASS | | rally_sanity | functest | smoke | 23:37 | PASS | | refstack_defcore | functest | smoke | 03:45 | FAIL | | patrole | functest | smoke | 03:14 | PASS | | odl | functest | smoke | 00:19 | PASS | | snaps_smoke | functest | smoke | 40:38 | FAIL | | neutron_trunk | functest | smoke | 02:20 | FAIL | +------------------------------+------------------+---------------+------------------+----------------+ 2018-05-07 20:34:15,881 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR 2018-05-07 20:34:39,944 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-apex-baremetal-daily-fraser-99 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-odl-bgpvpn-ha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod1 | +--------------------------------------+----------------------------------------------------------+ 2018-05-07 20:34:39,948 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Clear any old environment that may conflict. for key in $( set | awk '{FS="="} /^OS_/ {print $1}' ); do unset $key ; done export OS_USERNAME=admin export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_BAREMETAL_API_VERSION=1.34 export NOVA_VERSION=1.1 export OS_PROJECT_NAME=admin export OS_PASSWORD=DUKhnEARxVjvNnv2jqXFFVaqx export OS_NO_CACHE=True export COMPUTE_API_VERSION=1.1 export no_proxy=,172.30.9.28,192.30.9.8 export OS_VOLUME_API_VERSION=3 export OS_CLOUDNAME=overcloud export OS_AUTH_URL=http://172.30.9.28:5000/v3 export IRONIC_API_VERSION=1.34 export OS_IDENTITY_API_VERSION=3 export OS_IMAGE_API_VERSION=2 export OS_AUTH_TYPE=password export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available" # Add OS_CLOUDNAME to PS1 if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then export PS1=${PS1:-""} export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1 export CLOUDPROMPT_ENABLED=1 fi export SDN_CONTROLLER_IP=192.30.9.8 export OS_REGION_NAME=regionOne 2018-05-07 20:34:39,948 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-05-07 20:34:39,949 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +------------------+---------------+--------------------------+-------------------------------------------+------------------------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +------------------+---------------+--------------------------+-------------------------------------------+------------------------------------+ | features | 2 | (daily)|(weekly) | Test suites from feature projects | doctor-notification bgpvpn | | | | | integrated in functest | | +------------------+---------------+--------------------------+-------------------------------------------+------------------------------------+ 2018-05-07 20:34:39,950 - xtesting.ci.run_tests - INFO - Running tier 'features' 2018-05-07 20:34:39,950 - xtesting.ci.run_tests - INFO - Running test case 'doctor-notification'... 2018-05-07 20:38:08,724 - xtesting.core.feature - INFO - Test result is stored in '/var/lib/xtesting/results/doctor-notification.log' 2018-05-07 20:38:08,890 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-05-07 20:38:08,890 - xtesting.ci.run_tests - INFO - Test result: +-----------------------------+-----------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-----------------------------+-----------------+------------------+----------------+ | doctor-notification | doctor | 03:29 | PASS | +-----------------------------+-----------------+------------------+----------------+ 2018-05-07 20:38:08,894 - xtesting.ci.run_tests - INFO - Running test case 'bgpvpn'... 2018-05-07 20:57:14,113 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-05-07 20:57:18,676 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-05-07 20:57:18.362 151 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=24ffbbc5-36f2-4135-9323-d25f9999793b) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | 24ffbbc5-36f2-4135-9323-d25f9999793b | 2018-05-07T20:57:18 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: 24ffbbc5-36f2-4135-9323-d25f9999793b ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-05-07 20:57:21,975 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | key-manager | Available | | __unknown__ | placement | Available | | __unknown__ | policy | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+----------------+-----------+ 2018-05-07 20:57:21,975 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-05-07 20:57:27,411 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide 2018-05-07 20:57:25.898 160 INFO rally.api [-] Creating verifier 'opnfv-tempest'. 2018-05-07 20:57:26.045 160 INFO rally.verification.manager [-] Cloning verifier repo from /src/tempest. 2018-05-07 20:57:27.224 160 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=8defe129-d042-45f6-8750-a90777442b39) has been successfully created! Using verifier 'opnfv-tempest' (UUID=8defe129-d042-45f6-8750-a90777442b39) as the default verifier for the future CLI operations. 2018-05-07 20:57:33,392 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-05-07 20:57:32.342 179 INFO rally.api [-] Configuring verifier 'opnfv-tempest' (UUID=8defe129-d042-45f6-8750-a90777442b39) for deployment 'opnfv-rally' (UUID=24ffbbc5-36f2-4135-9323-d25f9999793b). 2018-05-07 20:57:33.224 179 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=8defe129-d042-45f6-8750-a90777442b39) has been successfully configured for deployment 'opnfv-rally' (UUID=24ffbbc5-36f2-4135-9323-d25f9999793b)! 2018-05-07 20:57:33,392 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-05-07 21:02:28,390 - functest.utils.functest_utils - DEBUG - Executing command: 'rm -rf /tmp/sdnvpn-logs/;mkdir -p /tmp/sdnvpn-logs/' 2018-05-07 21:02:32,800 - functest.utils.functest_utils - DEBUG - Executing command: 'mkdir -p /tmp/sdnvpn-logs/' 2018-05-07 21:02:32,815 - functest.utils.functest_utils - DEBUG - Executing command: 'cd /tmp/sdnvpn-logs/; tar -xzvf /tmp/log_output-overcloud-controller-2.tar.gz --strip-components=1' 2018-05-07 21:02:39,160 - functest.utils.functest_utils - DEBUG - Executing command: 'mkdir -p /tmp/sdnvpn-logs/' 2018-05-07 21:02:39,175 - functest.utils.functest_utils - DEBUG - Executing command: 'cd /tmp/sdnvpn-logs/; tar -xzvf /tmp/log_output-overcloud-controller-0.tar.gz --strip-components=1' 2018-05-07 21:02:45,167 - functest.utils.functest_utils - DEBUG - Executing command: 'mkdir -p /tmp/sdnvpn-logs/' 2018-05-07 21:02:45,183 - functest.utils.functest_utils - DEBUG - Executing command: 'cd /tmp/sdnvpn-logs/; tar -xzvf /tmp/log_output-overcloud-controller-1.tar.gz --strip-components=1' 2018-05-07 21:02:45,755 - functest.utils.functest_utils - DEBUG - Executing command: 'mkdir -p /tmp/sdnvpn-logs/' 2018-05-07 21:02:45,769 - functest.utils.functest_utils - DEBUG - Executing command: 'cd /tmp/sdnvpn-logs/; tar -xzvf /tmp/log_output-overcloud-novacompute-0.tar.gz --strip-components=1' 2018-05-07 21:02:46,076 - functest.utils.functest_utils - DEBUG - Executing command: 'mkdir -p /tmp/sdnvpn-logs/' 2018-05-07 21:02:46,090 - functest.utils.functest_utils - DEBUG - Executing command: 'cd /tmp/sdnvpn-logs/; tar -xzvf /tmp/log_output-overcloud-novacompute-1.tar.gz --strip-components=1' 2018-05-07 21:02:46,115 - functest.utils.functest_utils - DEBUG - Executing command: 'cd /home/opnfv/functest/results;tar czvf sdnvpn-logs-overall.tar.gz /tmp/sdnvpn-logs/' 2018-05-07 21:02:47,878 - xtesting.core.feature - INFO - Test result is stored in '/var/lib/xtesting/results/bgpvpn.log' 2018-05-07 21:02:48,043 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-05-07 21:02:48,044 - xtesting.ci.run_tests - INFO - Test result: +-------------------+-----------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+-----------------+------------------+----------------+ | bgpvpn | sdnvpn | 24:39 | FAIL | +-------------------+-----------------+------------------+----------------+ 2018-05-07 21:02:48,048 - xtesting.ci.run_tests - ERROR - The test case 'bgpvpn' failed. 2018-05-07 21:02:48,049 - xtesting.ci.run_tests - INFO - Xtesting report: +-----------------------------+------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +-----------------------------+------------------------+------------------+------------------+----------------+ | doctor-notification | doctor | features | 03:29 | PASS | | bgpvpn | sdnvpn | features | 24:39 | FAIL | | functest-odl-sfc | sfc | features | 00:00 | SKIP | | barometercollectd | barometer | features | 00:00 | SKIP | | fds | fastdatastacks | features | 00:00 | SKIP | +-----------------------------+------------------------+------------------+------------------+----------------+ 2018-05-07 21:02:48,053 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR 2018-05-07 21:04:33,522 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-apex-baremetal-daily-fraser-99 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-odl-bgpvpn-ha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod1 | +--------------------------------------+----------------------------------------------------------+ 2018-05-07 21:04:33,525 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Clear any old environment that may conflict. for key in $( set | awk '{FS="="} /^OS_/ {print $1}' ); do unset $key ; done export OS_USERNAME=admin export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_BAREMETAL_API_VERSION=1.34 export NOVA_VERSION=1.1 export OS_PROJECT_NAME=admin export OS_PASSWORD=DUKhnEARxVjvNnv2jqXFFVaqx export OS_NO_CACHE=True export COMPUTE_API_VERSION=1.1 export no_proxy=,172.30.9.28,192.30.9.8 export OS_VOLUME_API_VERSION=3 export OS_CLOUDNAME=overcloud export OS_AUTH_URL=http://172.30.9.28:5000/v3 export IRONIC_API_VERSION=1.34 export OS_IDENTITY_API_VERSION=3 export OS_IMAGE_API_VERSION=2 export OS_AUTH_TYPE=password export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available" # Add OS_CLOUDNAME to PS1 if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then export PS1=${PS1:-""} export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1 export CLOUDPROMPT_ENABLED=1 fi export SDN_CONTROLLER_IP=192.30.9.8 export OS_REGION_NAME=regionOne 2018-05-07 21:04:33,525 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-05-07 21:04:33,525 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------+---------------+-----------------+---------------------+-------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------+---------------+-----------------+---------------------+-------------------+ +---------------+---------------+-----------------+---------------------+-------------------+ 2018-05-07 21:04:33,526 - xtesting.ci.run_tests - INFO - Xtesting report: +----------------------+------------------+--------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +----------------------+------------------+--------------+------------------+----------------+ | cloudify_ims | functest | vnf | 00:00 | SKIP | | vyos_vrouter | functest | vnf | 00:00 | SKIP | | juju_epc | functest | vnf | 00:00 | SKIP | +----------------------+------------------+--------------+------------------+----------------+ 2018-05-07 21:04:33,527 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK 2018-05-07 21:04:45,158 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-apex-baremetal-daily-fraser-99 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-odl-bgpvpn-ha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod1 | +--------------------------------------+----------------------------------------------------------+ 2018-05-07 21:04:45,163 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Clear any old environment that may conflict. for key in $( set | awk '{FS="="} /^OS_/ {print $1}' ); do unset $key ; done export OS_USERNAME=admin export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_BAREMETAL_API_VERSION=1.34 export NOVA_VERSION=1.1 export OS_PROJECT_NAME=admin export OS_PASSWORD=DUKhnEARxVjvNnv2jqXFFVaqx export OS_NO_CACHE=True export COMPUTE_API_VERSION=1.1 export no_proxy=,172.30.9.28,192.30.9.8 export OS_VOLUME_API_VERSION=3 export OS_CLOUDNAME=overcloud export OS_AUTH_URL=http://172.30.9.28:5000/v3 export IRONIC_API_VERSION=1.34 export OS_IDENTITY_API_VERSION=3 export OS_IMAGE_API_VERSION=2 export OS_AUTH_TYPE=password export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available" # Add OS_CLOUDNAME to PS1 if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then export PS1=${PS1:-""} export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1 export CLOUDPROMPT_ENABLED=1 fi export SDN_CONTROLLER_IP=192.30.9.8 export OS_REGION_NAME=regionOne 2018-05-07 21:04:45,163 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-05-07 21:04:45,164 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------+---------------+-----------------+---------------------+-------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------+---------------+-----------------+---------------------+-------------------+ +---------------+---------------+-----------------+---------------------+-------------------+ 2018-05-07 21:04:45,165 - xtesting.ci.run_tests - INFO - Xtesting report: +-----------------------+-----------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +-----------------------+-----------------+------------------+------------------+----------------+ | parser-basics | parser | features | 00:00 | SKIP | +-----------------------+-----------------+------------------+------------------+----------------+ 2018-05-07 21:04:45,166 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK