2018-03-22 23:12:29,086 - functest.ci.check_deployment - DEBUG - 172.30.9.24:5000 is reachable! 2018-03-22 23:12:29,086 - functest.ci.check_deployment - INFO - Connectivity to OS_AUTH_URL http://172.30.9.24:5000/v3 ...OK 2018-03-22 23:12:29,517 - functest.ci.check_deployment - INFO - Got token ...OK 2018-03-22 23:12:29,960 - functest.ci.check_deployment - DEBUG - 172.30.9.24:5000 is reachable! 2018-03-22 23:12:29,960 - functest.ci.check_deployment - INFO - Connectivity to the public endpoint http://172.30.9.24:5000 ...OK 2018-03-22 23:12:30,318 - functest.ci.check_deployment - DEBUG - 172.30.9.24:8774 is reachable! 2018-03-22 23:12:30,319 - functest.ci.check_deployment - INFO - Connectivity to endpoint 'compute' http://172.30.9.24:8774/v2.1 ...OK 2018-03-22 23:12:30,679 - functest.ci.check_deployment - DEBUG - 172.30.9.24:9696 is reachable! 2018-03-22 23:12:30,679 - functest.ci.check_deployment - INFO - Connectivity to endpoint 'network' http://172.30.9.24:9696 ...OK 2018-03-22 23:12:31,042 - functest.ci.check_deployment - DEBUG - 172.30.9.24:9292 is reachable! 2018-03-22 23:12:31,042 - functest.ci.check_deployment - INFO - Connectivity to endpoint 'image' http://172.30.9.24:9292 ...OK 2018-03-22 23:12:32,258 - functest.ci.check_deployment - INFO - Nova service ...OK 2018-03-22 23:12:33,159 - functest.ci.check_deployment - INFO - Neutron service ...OK 2018-03-22 23:12:33,200 - functest.ci.check_deployment - INFO - Glance service ...OK 2018-03-22 23:12:33,846 - functest.ci.check_deployment - INFO - External network found: external 2018-03-22 23:12:36,417 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-apex-baremetal-daily-master-42 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-nosdn-bar-noha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod1 | +--------------------------------------+----------------------------------------------------------+ 2018-03-22 23:12:36,422 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Clear any old environment that may conflict. for key in $( set | awk '{FS="="} /^OS_/ {print $1}' ); do unset $key ; done export OS_USERNAME=admin export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_BAREMETAL_API_VERSION=1.34 export NOVA_VERSION=1.1 export OS_PROJECT_NAME=admin export OS_PASSWORD=2yF32GEZxKYmC83RxVhafnVGD export OS_NO_CACHE=True export COMPUTE_API_VERSION=1.1 export no_proxy=,172.30.9.24,192.30.9.6 export OS_VOLUME_API_VERSION=3 export OS_CLOUDNAME=overcloud export OS_AUTH_URL=http://172.30.9.24:5000/v3 export IRONIC_API_VERSION=1.34 export OS_IDENTITY_API_VERSION=3 export OS_IMAGE_API_VERSION=2 export OS_AUTH_TYPE=password export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available" # Add OS_CLOUDNAME to PS1 if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then export PS1=${PS1:-""} export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1 export CLOUDPROMPT_ENABLED=1 fi export OS_REGION_NAME=regionOne 2018-03-22 23:12:36,422 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-03-22 23:12:36,423 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------------+---------------+--------------------------+-------------------------------------------------+------------------------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------------+---------------+--------------------------+-------------------------------------------------+------------------------------------+ | healthcheck | 0 | (daily)|(weekly) | First tier to be executed to verify the | connection_check api_check | | | | | basic operations in the VIM. | snaps_health_check | +---------------------+---------------+--------------------------+-------------------------------------------------+------------------------------------+ 2018-03-22 23:12:36,425 - xtesting.ci.run_tests - INFO - Running tier 'healthcheck' 2018-03-22 23:12:36,425 - xtesting.ci.run_tests - INFO - Running test case 'connection_check'... 2018-03-22 23:12:38,561 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-03-22 23:12:49,646 - xtesting.core.unit - DEBUG - test_glance_connect_fail (snaps.openstack.utils.tests.glance_utils_tests.GlanceSmokeTests) ... ok test_glance_connect_success (snaps.openstack.utils.tests.glance_utils_tests.GlanceSmokeTests) ... ok test_keystone_connect_fail (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneSmokeTests) ... ok test_keystone_connect_success (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneSmokeTests) ... ok test_neutron_connect_fail (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_neutron_connect_success (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_retrieve_ext_network_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_nova_connect_fail (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_nova_connect_success (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_nova_get_hypervisor_hosts (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_heat_connect_fail (snaps.openstack.utils.tests.heat_utils_tests.HeatSmokeTests) ... ok test_heat_connect_success (snaps.openstack.utils.tests.heat_utils_tests.HeatSmokeTests) ... ok test_cinder_connect_fail (snaps.openstack.utils.tests.cinder_utils_tests.CinderSmokeTests) ... ok test_cinder_connect_success (snaps.openstack.utils.tests.cinder_utils_tests.CinderSmokeTests) ... ok ---------------------------------------------------------------------- Ran 14 tests in 11.074s OK 2018-03-22 23:12:49,765 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-22 23:12:49,765 - xtesting.ci.run_tests - INFO - Test result: +--------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------------+------------------+------------------+----------------+ | connection_check | functest | 00:11 | PASS | +--------------------------+------------------+------------------+----------------+ 2018-03-22 23:12:49,769 - xtesting.ci.run_tests - INFO - Running test case 'api_check'... 2018-03-22 23:12:51,132 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-03-22 23:24:29,056 - xtesting.core.unit - DEBUG - test_create_project_minimal (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_create_user_minimal (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_fail_without_proper_credentials (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_fail_without_proper_service (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_success (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_with_each_interface (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_grant_user_role_to_project (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_create_admin_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_delete_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_user_2x (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_delete_project (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_2x (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_bad_domain (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_quota_override (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_update_quotas (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_sec_grp_one_user (snaps.openstack.tests.create_project_tests.CreateProjectUserTests) ... ok test_create_project_sec_grp_two_users (snaps.openstack.tests.create_project_tests.CreateProjectUserTests) ... ok test_create_image_minimal_file (snaps.openstack.utils.tests.glance_utils_tests.GlanceUtilsTests) ... ok test_create_image_minimal_url (snaps.openstack.utils.tests.glance_utils_tests.GlanceUtilsTests) ... ok test_create_network (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_network_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_network_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_empty_cidr (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_null_cidr (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_add_interface_router (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_missing_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_null_router (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_null_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_invalid_ip (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_invalid_ip_to_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_ip (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_network_object (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_router_simple (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_router_with_public_interface (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_delete_simple_sec_grp (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_no_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_no_rules (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_one_rule (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_get_sec_grp_by_id (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_floating_ips (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsFloatingIpTests) ... ok test_create_delete_keypair (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_key_from_file (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_keypair (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_delete_flavor (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsFlavorTests) ... ok test_create_flavor (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsFlavorTests) ... ok test_create_instance (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceTests) ... ok test_add_remove_volume (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_attach_volume_nowait (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_detach_volume_nowait (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_create_clean_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_delete_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor_all_settings (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor_existing (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateSimpleStackTests) ... ok test_create_stack_x2 (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateSimpleStackTests) ... ok test_get_settings_from_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateComplexStackTests) ... ok test_create_flavor_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsFlavorTests) ... ok test_create_keypair_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsKeypairTests) ... ok test_create_security_group_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsSecurityGroupTests) ... ok test_create_delete_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_back (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_both (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_front (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_delete_volume (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTests) ... ok test_create_simple_volume (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTests) ... ok test_create_delete_volume_type (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsSimpleVolumeTypeTests) ... ok test_create_simple_volume_type (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsSimpleVolumeTypeTests) ... ok test_create_bad_key_size (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_delete_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_simple_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_with_all_attrs (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_with_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_invalid_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_qos_and_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok ---------------------------------------------------------------------- Ran 84 tests in 697.873s OK 2018-03-22 23:24:29,178 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-22 23:24:29,178 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | api_check | functest | 11:38 | PASS | +-------------------+------------------+------------------+----------------+ 2018-03-22 23:24:29,182 - xtesting.ci.run_tests - INFO - Running test case 'snaps_health_check'... 2018-03-22 23:24:30,126 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-03-22 23:25:07,820 - xtesting.core.unit - DEBUG - test_check_vm_ip_dhcp (snaps.openstack.tests.create_instance_tests.SimpleHealthCheck) ... ok ---------------------------------------------------------------------- Ran 1 test in 37.693s OK 2018-03-22 23:25:07,932 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-22 23:25:07,932 - xtesting.ci.run_tests - INFO - Test result: +----------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +----------------------------+------------------+------------------+----------------+ | snaps_health_check | functest | 00:38 | PASS | +----------------------------+------------------+------------------+----------------+ 2018-03-22 23:25:07,936 - xtesting.ci.run_tests - INFO - Xtesting report: +----------------------------+------------------+---------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +----------------------------+------------------+---------------------+------------------+----------------+ | connection_check | functest | healthcheck | 00:11 | PASS | | api_check | functest | healthcheck | 11:38 | PASS | | snaps_health_check | functest | healthcheck | 00:38 | PASS | +----------------------------+------------------+---------------------+------------------+----------------+ 2018-03-22 23:25:07,939 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK 2018-03-22 23:25:31,236 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-apex-baremetal-daily-master-42 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-nosdn-bar-noha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod1 | +--------------------------------------+----------------------------------------------------------+ 2018-03-22 23:25:31,240 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Clear any old environment that may conflict. for key in $( set | awk '{FS="="} /^OS_/ {print $1}' ); do unset $key ; done export OS_USERNAME=admin export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_BAREMETAL_API_VERSION=1.34 export NOVA_VERSION=1.1 export OS_PROJECT_NAME=admin export OS_PASSWORD=2yF32GEZxKYmC83RxVhafnVGD export OS_NO_CACHE=True export COMPUTE_API_VERSION=1.1 export no_proxy=,172.30.9.24,192.30.9.6 export OS_VOLUME_API_VERSION=3 export OS_CLOUDNAME=overcloud export OS_AUTH_URL=http://172.30.9.24:5000/v3 export IRONIC_API_VERSION=1.34 export OS_IDENTITY_API_VERSION=3 export OS_IMAGE_API_VERSION=2 export OS_AUTH_TYPE=password export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available" # Add OS_CLOUDNAME to PS1 if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then export PS1=${PS1:-""} export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1 export CLOUDPROMPT_ENABLED=1 fi export OS_REGION_NAME=regionOne 2018-03-22 23:25:31,240 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-03-22 23:25:31,241 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------+---------------+--------------------------+------------------------------------------+----------------------------------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------+---------------+--------------------------+------------------------------------------+----------------------------------------------+ | smoke | 1 | (daily)|(weekly) | Set of basic Functional tests to | vping_ssh vping_userdata | | | | | validate the OPNFV scenarios. | tempest_smoke_serial rally_sanity | | | | | | refstack_defcore patrole snaps_smoke | | | | | | neutron_trunk | +---------------+---------------+--------------------------+------------------------------------------+----------------------------------------------+ 2018-03-22 23:25:31,243 - xtesting.ci.run_tests - INFO - Running tier 'smoke' 2018-03-22 23:25:31,243 - xtesting.ci.run_tests - INFO - Running test case 'vping_ssh'... 2018-03-22 23:25:32,253 - xtesting.energy.energy - INFO - API recorder available at : http://energy.opnfv.fr/resources/recorders/environment/lf-pod1 2018-03-22 23:25:32,254 - xtesting.energy.energy - DEBUG - Getting current scenario 2018-03-22 23:25:32,793 - xtesting.energy.energy - DEBUG - Starting recording 2018-03-22 23:25:32,793 - xtesting.energy.energy - DEBUG - Submitting scenario (vping_ssh/running) 2018-03-22 23:25:33,188 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin virtual environment setup 2018-03-22 23:25:33,188 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing Start Time:'2018-03-22 23:25:33' 2018-03-22 23:25:33,189 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating image with name: 'functest-vping--712be4c4-fcfc-48a3-a1eb-fe8aec3cf920' 2018-03-22 23:25:36,602 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating network with name: 'vping-net-712be4c4-fcfc-48a3-a1eb-fe8aec3cf920' 2018-03-22 23:25:39,710 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating router with name: 'vping-router-712be4c4-fcfc-48a3-a1eb-fe8aec3cf920' 2018-03-22 23:25:46,232 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating flavor with name: 'vping-flavor-712be4c4-fcfc-48a3-a1eb-fe8aec3cf920' 2018-03-22 23:25:47,895 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating keypair with name: 'vPing-keypair-712be4c4-fcfc-48a3-a1eb-fe8aec3cf920' 2018-03-22 23:25:48,736 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 1 instance with name: 'opnfv-vping-1-712be4c4-fcfc-48a3-a1eb-fe8aec3cf920' 2018-03-22 23:25:53,993 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Security group with name: 'vPing-sg-712be4c4-fcfc-48a3-a1eb-fe8aec3cf920' 2018-03-22 23:25:57,792 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 2 instance with name: 'opnfv-vping-2-712be4c4-fcfc-48a3-a1eb-fe8aec3cf920' 2018-03-22 23:26:45,843 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin test execution 2018-03-22 23:26:55,988 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Trying to transfer ping.sh 2018-03-22 23:26:56,136 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Waiting for ping... 2018-03-22 23:26:57,143 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing detected! 2018-03-22 23:27:19,404 - xtesting.energy.energy - DEBUG - Restoring previous scenario (refstack_defcore/running) 2018-03-22 23:27:19,404 - xtesting.energy.energy - DEBUG - Submitting scenario (refstack_defcore/running) 2018-03-22 23:27:19,909 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-22 23:27:19,909 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | vping_ssh | functest | 01:24 | PASS | +-------------------+------------------+------------------+----------------+ 2018-03-22 23:27:19,913 - xtesting.ci.run_tests - INFO - Running test case 'vping_userdata'... 2018-03-22 23:27:20,015 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin virtual environment setup 2018-03-22 23:27:20,016 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing Start Time:'2018-03-22 23:27:20' 2018-03-22 23:27:20,016 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating image with name: 'functest-vping--4cb6e72b-d602-4f51-8502-d7d025029b51' 2018-03-22 23:27:24,848 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating network with name: 'vping-net-4cb6e72b-d602-4f51-8502-d7d025029b51' 2018-03-22 23:27:26,776 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating router with name: 'vping-router-4cb6e72b-d602-4f51-8502-d7d025029b51' 2018-03-22 23:27:32,605 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating flavor with name: 'vping-flavor-4cb6e72b-d602-4f51-8502-d7d025029b51' 2018-03-22 23:27:33,308 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 1 instance with name: 'opnfv-vping-1-4cb6e72b-d602-4f51-8502-d7d025029b51' 2018-03-22 23:27:38,151 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 2 instance with name: 'opnfv-vping-2-4cb6e72b-d602-4f51-8502-d7d025029b51' 2018-03-22 23:27:43,248 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin test execution 2018-03-22 23:27:54,815 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Waiting for ping... 2018-03-22 23:27:57,180 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing detected! 2018-03-22 23:28:26,203 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-22 23:28:26,203 - xtesting.ci.run_tests - INFO - Test result: +------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +------------------------+------------------+------------------+----------------+ | vping_userdata | functest | 00:37 | PASS | +------------------------+------------------+------------------+----------------+ 2018-03-22 23:28:26,207 - xtesting.ci.run_tests - INFO - Running test case 'tempest_smoke_serial'... 2018-03-22 23:28:26,336 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-03-22 23:28:32,056 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-03-22 23:28:31.783 18 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=e68b26cd-f045-401d-95f2-e057b359462a) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | e68b26cd-f045-401d-95f2-e057b359462a | 2018-03-22T23:28:31 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: e68b26cd-f045-401d-95f2-e057b359462a ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-03-22 23:28:35,288 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | key-manager | Available | | __unknown__ | placement | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+----------------+-----------+ 2018-03-22 23:28:35,289 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-03-22 23:28:41,770 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide 2018-03-22 23:28:39.569 27 INFO rally.api [-] Creating verifier 'opnfv-tempest'. 2018-03-22 23:28:39.731 27 INFO rally.verification.manager [-] Cloning verifier repo from /src/tempest. 2018-03-22 23:28:41.527 27 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=441ba0af-51b2-4c9c-89bd-bbeebe0d8a46) has been successfully created! Using verifier 'opnfv-tempest' (UUID=441ba0af-51b2-4c9c-89bd-bbeebe0d8a46) as the default verifier for the future CLI operations. 2018-03-22 23:28:44,753 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-03-22 23:28:47,305 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating two images for Tempest suite 2018-03-22 23:28:53,773 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-03-22 23:28:58,477 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-03-22 23:28:57.681 46 INFO rally.api [-] Configuring verifier 'opnfv-tempest' (UUID=441ba0af-51b2-4c9c-89bd-bbeebe0d8a46) for deployment 'opnfv-rally' (UUID=e68b26cd-f045-401d-95f2-e057b359462a). 2018-03-22 23:28:58.345 46 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=441ba0af-51b2-4c9c-89bd-bbeebe0d8a46) has been successfully configured for deployment 'opnfv-rally' (UUID=e68b26cd-f045-401d-95f2-e057b359462a)! 2018-03-22 23:28:58,477 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-03-22 23:28:58,478 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-03-22 23:28:58,480 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-03-22 23:28:58,483 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Generating test case list... 2018-03-22 23:29:01,723 - functest.opnfv_tests.openstack.tempest.tempest - INFO - (cd /root/.rally/verification/verifier-441ba0af-51b2-4c9c-89bd-bbeebe0d8a46/repo; testr list-tests '^tempest\.(api|scenario).*\[.*\bsmoke\b.*\]$' >/home/opnfv/functest/results/tempest/test_list.txt 2>/dev/null) 2018-03-22 23:29:01,723 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Applying tempest blacklist... 2018-03-22 23:29:01,724 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Tempest blacklist file does not exist. 2018-03-22 23:29:01,724 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', u'/home/opnfv/functest/results/tempest/test_list.txt', '--concurrency', '1']'. 2018-03-22 23:29:03,765 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:29:03.764 55 INFO rally.api [-] Starting verification (UUID=2ffecd51-d884-4005-bb0f-1dea17abe925) for deployment 'opnfv-rally' (UUID=e68b26cd-f045-401d-95f2-e057b359462a) by verifier 'opnfv-tempest' (UUID=441ba0af-51b2-4c9c-89bd-bbeebe0d8a46). 2018-03-22 23:29:03,765 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Verification UUID: 2ffecd51-d884-4005-bb0f-1dea17abe925 2018-03-22 23:29:10,464 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:29:10.463 55 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor ... success [0.181s] 2018-03-22 23:29:10,522 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:29:10.521 55 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.059s] 2018-03-22 23:29:17,849 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:29:17.849 55 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create ... success [1.005s] 2018-03-22 23:29:19,571 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:29:19.571 55 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list ... success [1.720s] 2018-03-22 23:29:28,681 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:29:28.681 55 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete ... success [2.769s] 2018-03-22 23:29:47,880 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:29:47.880 55 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip ... success [13.181s] 2018-03-22 23:30:24,620 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:30:24.620 55 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_list_servers ... success [0.066s] 2018-03-22 23:30:24,621 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:30:24.621 55 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_verify_server_details ... success [0.001s] 2018-03-22 23:30:53,383 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:30:53.383 55 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers ... success [0.080s] 2018-03-22 23:30:53,384 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:30:53.384 55 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details ... success [0.002s] 2018-03-22 23:31:23,463 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:31:23.463 55 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers ... success [0.072s] 2018-03-22 23:31:23,465 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:31:23.465 55 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details ... success [0.002s] 2018-03-22 23:32:16,944 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:32:16.944 55 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard ... success [24.087s] 2018-03-22 23:32:39,961 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:32:39.960 55 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses ... success [0.049s] 2018-03-22 23:32:40,066 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:32:40.066 55 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network ... success [0.106s] 2018-03-22 23:32:50,754 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:32:50.754 55 INFO opnfv-tempest [-] {0} tempest.api.compute.test_versions.TestVersions.test_get_version_details ... success [0.636s] 2018-03-22 23:32:50,763 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:32:50.763 55 INFO opnfv-tempest [-] {0} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.010s] 2018-03-22 23:32:52,609 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:32:52.609 55 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v2.test_services.ServicesTestJSON ... skip: Identity api v2 is not enabled 2018-03-22 23:32:52,610 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:32:52.609 55 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v2.test_users.UsersTestJSON ... skip: Identity api v2 is not enabled 2018-03-22 23:32:56,494 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:32:56.493 55 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete ... success [0.368s] 2018-03-22 23:33:02,210 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:33:02.210 55 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists ... success [0.098s] 2018-03-22 23:33:09,166 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:33:09.165 55 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain ... success [0.663s] 2018-03-22 23:33:17,527 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:33:17.527 55 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint ... success [0.490s] 2018-03-22 23:33:26,665 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:33:26.664 55 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete ... success [3.228s] 2018-03-22 23:33:32,591 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:33:32.590 55 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy ... success [0.385s] 2018-03-22 23:33:38,215 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:33:38.215 55 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id ... success [0.156s] 2018-03-22 23:33:45,294 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:33:45.294 55 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_show_list ... success [0.435s] 2018-03-22 23:33:53,401 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:33:53.401 55 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service ... success [0.441s] 2018-03-22 23:34:01,139 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:34:01.139 55 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all ... success [3.175s] 2018-03-22 23:34:03,130 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:34:03.129 55 INFO opnfv-tempest [-] {0} tempest.api.identity.v2.test_api_discovery.TestApiDiscovery ... skip: Identity api v2 is not enabled 2018-03-22 23:34:06,231 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:34:06.230 55 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.073s] 2018-03-22 23:34:06,303 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:34:06.303 55 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.072s] 2018-03-22 23:34:06,375 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:34:06.375 55 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.072s] 2018-03-22 23:34:06,382 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:34:06.381 55 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_list_api_versions ... success [0.006s] 2018-03-22 23:34:10,062 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:34:10.061 55 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [0.698s] 2018-03-22 23:34:12,049 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:34:12.048 55 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file ... success [1.986s] 2018-03-22 23:34:15,028 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:34:15.027 55 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [2.978s] 2018-03-22 23:34:25,029 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:34:25.028 55 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_versions.VersionsTest.test_list_versions ... success [0.009s] 2018-03-22 23:34:29,956 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:34:29.955 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions ... success [1.884s] 2018-03-22 23:34:43,589 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:34:43.589 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address ... success [2.482s] 2018-03-22 23:34:47,783 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:34:47.783 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip ... success [4.193s] 2018-03-22 23:34:59,411 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:34:59.411 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_network ... success [3.035s] 2018-03-22 23:35:02,236 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:35:02.236 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_port ... success [2.824s] 2018-03-22 23:35:07,240 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:35:07.239 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_subnet ... success [5.002s] 2018-03-22 23:35:17,502 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:35:17.501 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_network ... success [3.156s] 2018-03-22 23:35:20,153 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:35:20.153 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_port ... success [2.651s] 2018-03-22 23:35:24,814 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:35:24.813 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_subnet ... success [4.659s] 2018-03-22 23:35:39,023 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:35:39.023 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_update_delete_network_subnet ... success [3.562s] 2018-03-22 23:35:39,298 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:35:39.297 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_external_network_visibility ... success [0.275s] 2018-03-22 23:35:39,411 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:35:39.411 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_networks ... success [0.113s] 2018-03-22 23:35:39,465 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:35:39.465 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_subnets ... success [0.053s] 2018-03-22 23:35:39,565 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:35:39.565 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_network ... success [0.100s] 2018-03-22 23:35:39,618 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:35:39.618 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_subnet ... success [0.052s] 2018-03-22 23:35:51,009 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:35:51.008 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [3.727s] 2018-03-22 23:35:51,353 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:35:51.352 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_external_network_visibility ... success [0.344s] 2018-03-22 23:35:51,466 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:35:51.466 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.113s] 2018-03-22 23:35:51,517 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:35:51.517 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.051s] 2018-03-22 23:35:51,615 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:35:51.615 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.097s] 2018-03-22 23:35:51,685 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:35:51.685 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.069s] 2018-03-22 23:36:02,244 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:36:02.244 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools ... success [3.329s] 2018-03-22 23:36:07,317 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:36:07.317 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups ... success [5.072s] 2018-03-22 23:36:08,836 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:36:08.836 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port ... success [1.518s] 2018-03-22 23:36:08,891 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:36:08.890 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports ... success [0.054s] 2018-03-22 23:36:09,094 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:36:09.093 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port ... success [0.202s] 2018-03-22 23:36:20,180 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:36:20.179 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [3.187s] 2018-03-22 23:36:24,888 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:36:24.888 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups ... success [4.708s] 2018-03-22 23:36:26,281 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:36:26.281 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [1.392s] 2018-03-22 23:36:26,483 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:36:26.483 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.202s] 2018-03-22 23:36:26,540 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:36:26.539 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.055s] 2018-03-22 23:36:41,396 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:36:41.395 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces ... success [9.879s] 2018-03-22 23:36:47,534 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:36:47.534 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id ... success [6.138s] 2018-03-22 23:36:51,871 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:36:51.871 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id ... success [4.335s] 2018-03-22 23:36:55,443 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:36:55.443 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router ... success [3.573s] 2018-03-22 23:37:15,429 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:37:15.429 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces ... success [9.026s] 2018-03-22 23:37:21,450 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:37:21.450 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id ... success [6.021s] 2018-03-22 23:37:26,767 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:37:26.767 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id ... success [5.317s] 2018-03-22 23:37:30,182 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:37:30.181 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router ... success [3.413s] 2018-03-22 23:37:42,355 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:37:42.355 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group ... success [1.696s] 2018-03-22 23:37:43,662 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:37:43.662 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule ... success [1.305s] 2018-03-22 23:37:43,856 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:37:43.856 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups ... success [0.196s] 2018-03-22 23:37:49,228 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:37:49.228 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.070s] 2018-03-22 23:37:50,801 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:37:50.800 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [1.570s] 2018-03-22 23:37:50,842 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:37:50.842 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.043s] 2018-03-22 23:37:55,133 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:37:55.133 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [0.783s] 2018-03-22 23:37:58,309 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:37:58.309 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_versions.NetworksApiDiscovery.test_api_version_resources ... success [0.007s] 2018-03-22 23:37:59,864 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:37:59.864 55 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_quotas.AccountQuotasTest ... skip: AccountQuotasTest skipped as swift is not available 2018-03-22 23:37:59,866 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:37:59.866 55 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_services.AccountTest ... skip: AccountTest skipped as swift is not available 2018-03-22 23:37:59,868 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:37:59.868 55 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest ... skip: ContainerQuotasTest skipped as swift is not available 2018-03-22 23:37:59,869 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:37:59.869 55 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_services.ContainerTest ... skip: ContainerTest skipped as swift is not available 2018-03-22 23:37:59,870 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:37:59.869 55 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_object_services.ObjectTest ... skip: ObjectTest skipped as swift is not available 2018-03-22 23:38:01,743 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:38:01.743 55 INFO opnfv-tempest [-] {0} tempest.api.volume.test_versions.VersionsTest.test_list_versions ... success [0.013s] 2018-03-22 23:38:19,088 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:38:19.088 55 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_attach_detach_volume_to_instance ... success [11.170s] 2018-03-22 23:38:32,154 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:38:32.153 55 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [8.114s] 2018-03-22 23:38:49,089 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:38:49.088 55 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [16.931s] 2018-03-22 23:38:58,844 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:38:58.843 55 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.041s] 2018-03-22 23:40:18,129 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:40:18.128 55 INFO opnfv-tempest [-] {0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops ... success [71.287s] 2018-03-22 23:40:58,131 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:40:58.131 55 INFO opnfv-tempest [-] {0} tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basic_ops ... success [31.343s] 2018-03-22 23:41:43,169 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-22 23:41:43.169 55 INFO opnfv-tempest [-] {0} tempest.scenario.test_server_multinode.TestServerMultinode.test_schedule_to_all_nodes ... success [26.848s] 2018-03-22 23:41:55,554 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', '2ffecd51-d884-4005-bb0f-1dea17abe925']'. 2018-03-22 23:41:56,540 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2018-03-22 23:41:56,540 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2018-03-22 23:41:56,540 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-03-22 23:41:56,541 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | 2ffecd51-d884-4005-bb0f-1dea17abe925 | 2018-03-22 23:41:56,541 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | finished | 2018-03-22 23:41:56,541 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2018-03-22 23:29:03 | 2018-03-22 23:41:56,541 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2018-03-22 23:41:55 | 2018-03-22 23:41:56,541 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 0:12:52 | 2018-03-22 23:41:56,541 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | concurrency: 1 | 2018-03-22 23:41:56,541 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | | load_list: (value is too long, use 'detailed' flag to display it) | 2018-03-22 23:41:56,541 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2018-03-22 23:41:56,541 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: 441ba0af-51b2-4c9c-89bd-bbeebe0d8a46) | 2018-03-22 23:41:56,541 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2018-03-22 23:41:56,542 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: e68b26cd-f045-401d-95f2-e057b359462a) | 2018-03-22 23:41:56,542 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 109 | 2018-03-22 23:41:56,542 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 755.151 | 2018-03-22 23:41:56,542 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 90 | 2018-03-22 23:41:56,542 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 19 | 2018-03-22 23:41:56,542 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2018-03-22 23:41:56,542 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2018-03-22 23:41:56,542 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 0 | 2018-03-22 23:41:56,542 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-03-22 23:41:56,543 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------------------------------------------------------------------+ 2018-03-22 23:41:56,647 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest tempest_smoke_serial success_rate is 100.0% 2018-03-22 23:42:04,998 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-22 23:42:04,999 - xtesting.ci.run_tests - INFO - Test result: +------------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +------------------------------+------------------+------------------+----------------+ | tempest_smoke_serial | functest | 13:20 | PASS | +------------------------------+------------------+------------------+----------------+ 2018-03-22 23:42:05,003 - xtesting.ci.run_tests - INFO - Running test case 'rally_sanity'... 2018-03-22 23:42:05,110 - xtesting.energy.energy - DEBUG - Getting current scenario 2018-03-22 23:42:05,592 - xtesting.energy.energy - DEBUG - Starting recording 2018-03-22 23:42:05,592 - xtesting.energy.energy - DEBUG - Submitting scenario (rally_sanity/running) 2018-03-22 23:42:05,987 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-03-22 23:42:08,491 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-03-22 23:42:08.073 115 INFO rally.deployment.engine [-] Deployment e68b26cd-f045-401d-95f2-e057b359462a | Starting: Destroy cloud and free allocated resources. 2018-03-22 23:42:08.152 115 INFO rally.deployment.engine [-] Deployment e68b26cd-f045-401d-95f2-e057b359462a | Completed: Destroy cloud and free allocated resources. 2018-03-22 23:42:08.190 115 INFO rally.api [-] Deleting all verifications created by verifier 'opnfv-tempest' (UUID=441ba0af-51b2-4c9c-89bd-bbeebe0d8a46) for deployment 'opnfv-rally'. 2018-03-22 23:42:08.208 115 INFO rally.api [-] Deleting verification (UUID=2ffecd51-d884-4005-bb0f-1dea17abe925). 2018-03-22 23:42:08.248 115 INFO rally.api [-] Verification has been successfully deleted! 2018-03-22 23:42:08.249 115 INFO rally.api [-] Deleting deployment-specific data for verifier 'opnfv-tempest' (UUID=441ba0af-51b2-4c9c-89bd-bbeebe0d8a46). 2018-03-22 23:42:08.261 115 INFO rally.api [-] Deployment-specific data has been successfully deleted! 2018-03-22 23:42:10,932 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-03-22 23:42:10.670 118 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=ce4a2159-ce4b-4036-aaf0-3c116d7dc365) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | ce4a2159-ce4b-4036-aaf0-3c116d7dc365 | 2018-03-22T23:42:10 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: ce4a2159-ce4b-4036-aaf0-3c116d7dc365 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-03-22 23:42:14,119 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | key-manager | Available | | __unknown__ | placement | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+----------------+-----------+ 2018-03-22 23:42:14,119 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating the test name... 2018-03-22 23:42:15,345 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating image 'Cirros-0.4.0-73e660e8-f74c-4690-a45e-8af372465289'... 2018-03-22 23:42:20,261 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating network 'rally-net-73e660e8-f74c-4690-a45e-8af372465289'... 2018-03-22 23:42:21,892 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating router 'rally-router-73e660e8-f74c-4690-a45e-8af372465289'... 2018-03-22 23:42:27,461 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating flavor 'rally-tiny-73e660e8-f74c-4690-a45e-8af372465289'... 2018-03-22 23:42:28,148 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating flavor 'rally-mini-73e660e8-f74c-4690-a45e-8af372465289'... 2018-03-22 23:42:28,784 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2018-03-22 23:42:28,784 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-authenticate.yaml 2018-03-22 23:42:28,785 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-03-22 23:42:28,829 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-03-22 23:42:28,834 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['authenticate'], 'concurrency': 4, 'netid': '95522f80-f743-4ff3-a08a-62c9d0dc0fc1', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-73e660e8-f74c-4690-a45e-8af372465289', 'flavor_name': 'rally-tiny-73e660e8-f74c-4690-a45e-8af372465289', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-73e660e8-f74c-4690-a45e-8af372465289', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-03-22 23:43:28,903 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 4af7be2b-1b3c-4e27-98da-1a316013c143 2018-03-22 23:43:28,903 - functest.opnfv_tests.openstack.rally.rally - DEBUG - /home/opnfv/functest/results/rally does not exist, we create it. 2018-03-22 23:43:28,905 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '4af7be2b-1b3c-4e27-98da-1a316013c143'] 2018-03-22 23:43:29,839 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 4af7be2b-1b3c-4e27-98da-1a316013c143: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 4af7be2b-1b3c-4e27-98da-1a316013c143 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 0.506 | 0.506 | 0.506 | 0.506 | 0.506 | 0.506 | 100.0% | 1 | | total | 0.506 | 0.506 | 0.506 | 0.506 | 0.506 | 0.506 | 100.0% | 1 | | -> duration | 0.506 | 0.506 | 0.506 | 0.506 | 0.506 | 0.506 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.506039 Full duration: 7.659861 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 4af7be2b-1b3c-4e27-98da-1a316013c143 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.321 | 0.321 | 0.321 | 0.321 | 0.321 | 0.321 | 100.0% | 1 | | total | 0.759 | 0.759 | 0.759 | 0.759 | 0.759 | 0.759 | 100.0% | 1 | | -> duration | 0.759 | 0.759 | 0.759 | 0.759 | 0.759 | 0.759 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.759003 Full duration: 7.360364 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 4af7be2b-1b3c-4e27-98da-1a316013c143 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.206 | 0.206 | 0.206 | 0.206 | 0.206 | 0.206 | 100.0% | 1 | | total | 0.61 | 0.61 | 0.61 | 0.61 | 0.61 | 0.61 | 100.0% | 1 | | -> duration | 0.61 | 0.61 | 0.61 | 0.61 | 0.61 | 0.61 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.610155 Full duration: 6.931491 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 4af7be2b-1b3c-4e27-98da-1a316013c143 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.333 | 0.333 | 0.333 | 0.333 | 0.333 | 0.333 | 100.0% | 1 | | total | 0.748 | 0.748 | 0.748 | 0.748 | 0.748 | 0.748 | 100.0% | 1 | | -> duration | 0.748 | 0.748 | 0.748 | 0.748 | 0.748 | 0.748 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.748196 Full duration: 6.819161 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 4af7be2b-1b3c-4e27-98da-1a316013c143 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.359 | 0.359 | 0.359 | 0.359 | 0.359 | 0.359 | 100.0% | 1 | | total | 0.751 | 0.751 | 0.751 | 0.751 | 0.751 | 0.751 | 100.0% | 1 | | -> duration | 0.751 | 0.751 | 0.751 | 0.751 | 0.751 | 0.751 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.750687 Full duration: 8.005501 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 4af7be2b-1b3c-4e27-98da-1a316013c143 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.206 | 0.206 | 0.206 | 0.206 | 0.206 | 0.206 | 100.0% | 1 | | total | 0.707 | 0.707 | 0.707 | 0.707 | 0.707 | 0.707 | 100.0% | 1 | | -> duration | 0.707 | 0.707 | 0.707 | 0.707 | 0.707 | 0.707 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.70698 Full duration: 6.910744 HINTS: * To plot HTML graphics with this data, run: rally task report 4af7be2b-1b3c-4e27-98da-1a316013c143 --out output.html * To generate a JUnit report, run: rally task export 4af7be2b-1b3c-4e27-98da-1a316013c143 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 4af7be2b-1b3c-4e27-98da-1a316013c143 --json --out output.json 2018-03-22 23:43:29,839 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '4af7be2b-1b3c-4e27-98da-1a316013c143'] 2018-03-22 23:43:30,841 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-03-22 23:43:30,841 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '4af7be2b-1b3c-4e27-98da-1a316013c143', '--out', u'/home/opnfv/functest/results/rally/opnfv-authenticate.html'] 2018-03-22 23:43:30,849 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2018-03-22 23:43:30,849 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2018-03-22 23:43:30,850 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-glance.yaml 2018-03-22 23:43:30,850 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-03-22 23:43:30,891 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-03-22 23:43:30,902 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['glance'], 'concurrency': 4, 'netid': '95522f80-f743-4ff3-a08a-62c9d0dc0fc1', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-73e660e8-f74c-4690-a45e-8af372465289', 'flavor_name': 'rally-tiny-73e660e8-f74c-4690-a45e-8af372465289', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-73e660e8-f74c-4690-a45e-8af372465289', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-03-22 23:45:17,013 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 25acf065-1258-4dd6-8722-c4c37e8fdb01 2018-03-22 23:45:17,014 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '25acf065-1258-4dd6-8722-c4c37e8fdb01'] 2018-03-22 23:45:18,062 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 25acf065-1258-4dd6-8722-c4c37e8fdb01: finished -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 25acf065-1258-4dd6-8722-c4c37e8fdb01 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 4.51 | 4.51 | 4.51 | 4.51 | 4.51 | 4.51 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.045 | 0.045 | 0.045 | 0.045 | 0.045 | 0.045 | 100.0% | 1 | | -> glance_v2.upload_data | 2.135 | 2.135 | 2.135 | 2.135 | 2.135 | 2.135 | 100.0% | 1 | | glance_v2.delete_image | 1.642 | 1.642 | 1.642 | 1.642 | 1.642 | 1.642 | 100.0% | 1 | | total | 6.152 | 6.152 | 6.152 | 6.152 | 6.152 | 6.152 | 100.0% | 1 | | -> duration | 6.152 | 6.152 | 6.152 | 6.152 | 6.152 | 6.152 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.15249 Full duration: 13.714411 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 25acf065-1258-4dd6-8722-c4c37e8fdb01 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 5.311 | 5.311 | 5.311 | 5.311 | 5.311 | 5.311 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.044 | 0.044 | 0.044 | 0.044 | 0.044 | 0.044 | 100.0% | 1 | | -> glance_v2.upload_data | 3.027 | 3.027 | 3.027 | 3.027 | 3.027 | 3.027 | 100.0% | 1 | | glance_v2.list_images | 0.616 | 0.616 | 0.616 | 0.616 | 0.616 | 0.616 | 100.0% | 1 | | total | 5.927 | 5.927 | 5.927 | 5.927 | 5.927 | 5.927 | 100.0% | 1 | | -> duration | 5.927 | 5.927 | 5.927 | 5.927 | 5.927 | 5.927 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.926963 Full duration: 17.650127 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 25acf065-1258-4dd6-8722-c4c37e8fdb01 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.185 | 0.185 | 0.185 | 0.185 | 0.185 | 0.185 | 100.0% | 1 | | total | 0.186 | 0.186 | 0.186 | 0.186 | 0.186 | 0.186 | 100.0% | 1 | | -> duration | 0.186 | 0.186 | 0.186 | 0.186 | 0.186 | 0.186 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.18555 Full duration: 7.642801 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": { "name": "rally-tiny-73e660e8-f74c-4690-a45e-8af372465289" }, "number_instances": 2, "nics": [ { "net-id": "95522f80-f743-4ff3-a08a-62c9d0dc0fc1" } ] }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } } } -------------------------------------------------------------------------------- Task 25acf065-1258-4dd6-8722-c4c37e8fdb01 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 5.27 | 5.27 | 5.27 | 5.27 | 5.27 | 5.27 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.042 | 0.042 | 0.042 | 0.042 | 0.042 | 0.042 | 100.0% | 1 | | -> glance_v2.upload_data | 2.992 | 2.992 | 2.992 | 2.992 | 2.992 | 2.992 | 100.0% | 1 | | nova.boot_servers | 16.103 | 16.103 | 16.103 | 16.103 | 16.103 | 16.103 | 100.0% | 1 | | total | 21.374 | 21.374 | 21.374 | 21.374 | 21.374 | 21.374 | 100.0% | 1 | | -> duration | 20.374 | 20.374 | 20.374 | 20.374 | 20.374 | 20.374 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 20.374279 Full duration: 51.304953 HINTS: * To plot HTML graphics with this data, run: rally task report 25acf065-1258-4dd6-8722-c4c37e8fdb01 --out output.html * To generate a JUnit report, run: rally task export 25acf065-1258-4dd6-8722-c4c37e8fdb01 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 25acf065-1258-4dd6-8722-c4c37e8fdb01 --json --out output.json 2018-03-22 23:45:18,063 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '25acf065-1258-4dd6-8722-c4c37e8fdb01'] 2018-03-22 23:45:18,916 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-03-22 23:45:18,917 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '25acf065-1258-4dd6-8722-c4c37e8fdb01', '--out', u'/home/opnfv/functest/results/rally/opnfv-glance.html'] 2018-03-22 23:45:18,925 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" OK. 2018-03-22 23:45:18,925 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "ceilometer" ... 2018-03-22 23:45:18,926 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-ceilometer.yaml 2018-03-22 23:45:18,926 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-03-22 23:45:18,967 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-03-22 23:45:18,973 - functest.opnfv_tests.openstack.rally.rally - INFO - No tests for scenario "ceilometer" 2018-03-22 23:45:18,973 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2018-03-22 23:45:18,973 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-cinder.yaml 2018-03-22 23:45:18,973 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-03-22 23:45:19,006 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-03-22 23:45:19,011 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['cinder'], 'concurrency': 4, 'netid': '95522f80-f743-4ff3-a08a-62c9d0dc0fc1', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-73e660e8-f74c-4690-a45e-8af372465289', 'flavor_name': 'rally-tiny-73e660e8-f74c-4690-a45e-8af372465289', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-73e660e8-f74c-4690-a45e-8af372465289', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-03-22 23:48:36,224 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : e04d26f0-9da5-42a4-95d6-037776a52852 2018-03-22 23:48:36,224 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'e04d26f0-9da5-42a4-95d6-037776a52852'] 2018-03-22 23:48:37,327 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task e04d26f0-9da5-42a4-95d6-037776a52852: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "force": false }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task e04d26f0-9da5-42a4-95d6-037776a52852 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_snapshot | 5.453 | 5.453 | 5.453 | 5.453 | 5.453 | 5.453 | 100.0% | 1 | | cinder_v2.delete_snapshot | 2.504 | 2.504 | 2.504 | 2.504 | 2.504 | 2.504 | 100.0% | 1 | | total | 7.958 | 7.958 | 7.958 | 7.958 | 7.958 | 7.958 | 100.0% | 1 | | -> duration | 7.958 | 7.958 | 7.958 | 7.958 | 7.958 | 7.958 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.957567 Full duration: 25.030001 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "size": { "max": 1, "min": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task e04d26f0-9da5-42a4-95d6-037776a52852 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.465 | 3.465 | 3.465 | 3.465 | 3.465 | 3.465 | 100.0% | 1 | | cinder_v2.delete_volume | 2.508 | 2.508 | 2.508 | 2.508 | 2.508 | 2.508 | 100.0% | 1 | | total | 5.973 | 5.973 | 5.973 | 5.973 | 5.973 | 5.973 | 100.0% | 1 | | -> duration | 5.973 | 5.973 | 5.973 | 5.973 | 5.973 | 5.973 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.972807 Full duration: 15.780719 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "image": { "name": "Cirros-0.4.0-73e660e8-f74c-4690-a45e-8af372465289" }, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task e04d26f0-9da5-42a4-95d6-037776a52852 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 9.966 | 9.966 | 9.966 | 9.966 | 9.966 | 9.966 | 100.0% | 1 | | cinder_v2.delete_volume | 2.416 | 2.416 | 2.416 | 2.416 | 2.416 | 2.416 | 100.0% | 1 | | total | 12.382 | 12.382 | 12.382 | 12.382 | 12.382 | 12.382 | 100.0% | 1 | | -> duration | 12.382 | 12.382 | 12.382 | 12.382 | 12.382 | 12.382 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.382282 Full duration: 22.762219 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task e04d26f0-9da5-42a4-95d6-037776a52852 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.615 | 3.615 | 3.615 | 3.615 | 3.615 | 3.615 | 100.0% | 1 | | cinder_v2.delete_volume | 2.99 | 2.99 | 2.99 | 2.99 | 2.99 | 2.99 | 100.0% | 1 | | total | 6.606 | 6.606 | 6.606 | 6.606 | 6.606 | 6.606 | 100.0% | 1 | | -> duration | 6.606 | 6.606 | 6.606 | 6.606 | 6.606 | 6.606 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.60589 Full duration: 16.064339 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "new_size": 2, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task e04d26f0-9da5-42a4-95d6-037776a52852 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.154 | 3.154 | 3.154 | 3.154 | 3.154 | 3.154 | 100.0% | 1 | | cinder_v2.extend_volume | 2.495 | 2.495 | 2.495 | 2.495 | 2.495 | 2.495 | 100.0% | 1 | | cinder_v2.delete_volume | 2.18 | 2.18 | 2.18 | 2.18 | 2.18 | 2.18 | 100.0% | 1 | | total | 7.83 | 7.83 | 7.83 | 7.83 | 7.83 | 7.83 | 100.0% | 1 | | -> duration | 7.83 | 7.83 | 7.83 | 7.83 | 7.83 | 7.83 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.829924 Full duration: 17.52452 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task e04d26f0-9da5-42a4-95d6-037776a52852 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 5.452 | 5.452 | 5.452 | 5.452 | 5.452 | 5.452 | 100.0% | 1 | | cinder_v2.delete_volume | 2.468 | 2.468 | 2.468 | 2.468 | 2.468 | 2.468 | 100.0% | 1 | | total | 7.92 | 7.92 | 7.92 | 7.92 | 7.92 | 7.92 | 100.0% | 1 | | -> duration | 7.92 | 7.92 | 7.92 | 7.92 | 7.92 | 7.92 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.920053 Full duration: 24.717142 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task e04d26f0-9da5-42a4-95d6-037776a52852 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_qos | 0.586 | 0.586 | 0.586 | 0.586 | 0.586 | 0.586 | 100.0% | 1 | | cinder_v2.list_qos | 0.157 | 0.157 | 0.157 | 0.157 | 0.157 | 0.157 | 100.0% | 1 | | total | 0.743 | 0.743 | 0.743 | 0.743 | 0.743 | 0.743 | 100.0% | 1 | | -> duration | 0.743 | 0.743 | 0.743 | 0.743 | 0.743 | 0.743 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.742978 Full duration: 11.583823 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "consumer": "back-end", "write_iops_sec": "10", "read_iops_sec": "1000", "set_consumer": "both", "set_write_iops_sec": "11", "set_read_iops_sec": "1001" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task e04d26f0-9da5-42a4-95d6-037776a52852 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_qos | 0.572 | 0.572 | 0.572 | 0.572 | 0.572 | 0.572 | 100.0% | 1 | | cinder_v2.set_qos | 0.18 | 0.18 | 0.18 | 0.18 | 0.18 | 0.18 | 100.0% | 1 | | total | 0.752 | 0.752 | 0.752 | 0.752 | 0.752 | 0.752 | 100.0% | 1 | | -> duration | 0.752 | 0.752 | 0.752 | 0.752 | 0.752 | 0.752 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.752038 Full duration: 12.300174 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "description": "rally tests creating types" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task e04d26f0-9da5-42a4-95d6-037776a52852 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.615 | 0.615 | 0.615 | 0.615 | 0.615 | 0.615 | 100.0% | 1 | | cinder_v2.list_types | 0.161 | 0.161 | 0.161 | 0.161 | 0.161 | 0.161 | 100.0% | 1 | | total | 0.776 | 0.776 | 0.776 | 0.776 | 0.776 | 0.776 | 100.0% | 1 | | -> duration | 0.776 | 0.776 | 0.776 | 0.776 | 0.776 | 0.776 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.776048 Full duration: 12.144839 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "description": "rally tests creating types", "provider": "LuksEncryptor", "cipher": "aes-xts-plain64", "key_size": 512, "control_location": "front-end" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task e04d26f0-9da5-42a4-95d6-037776a52852 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.613 | 0.613 | 0.613 | 0.613 | 0.613 | 0.613 | 100.0% | 1 | | cinder_v2.create_encryption_type | 0.184 | 0.184 | 0.184 | 0.184 | 0.184 | 0.184 | 100.0% | 1 | | total | 0.797 | 0.797 | 0.797 | 0.797 | 0.797 | 0.797 | 100.0% | 1 | | -> duration | 0.797 | 0.797 | 0.797 | 0.797 | 0.797 | 0.797 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.796736 Full duration: 11.491827 HINTS: * To plot HTML graphics with this data, run: rally task report e04d26f0-9da5-42a4-95d6-037776a52852 --out output.html * To generate a JUnit report, run: rally task export e04d26f0-9da5-42a4-95d6-037776a52852 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report e04d26f0-9da5-42a4-95d6-037776a52852 --json --out output.json 2018-03-22 23:48:37,327 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'e04d26f0-9da5-42a4-95d6-037776a52852'] 2018-03-22 23:48:38,325 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-03-22 23:48:38,325 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'e04d26f0-9da5-42a4-95d6-037776a52852', '--out', u'/home/opnfv/functest/results/rally/opnfv-cinder.html'] 2018-03-22 23:48:38,332 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2018-03-22 23:48:38,333 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2018-03-22 23:48:38,333 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-heat.yaml 2018-03-22 23:48:38,333 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-03-22 23:48:38,381 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-03-22 23:48:38,395 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['heat'], 'concurrency': 4, 'netid': '95522f80-f743-4ff3-a08a-62c9d0dc0fc1', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-73e660e8-f74c-4690-a45e-8af372465289', 'flavor_name': 'rally-tiny-73e660e8-f74c-4690-a45e-8af372465289', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-73e660e8-f74c-4690-a45e-8af372465289', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-03-22 23:50:03,704 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : b689d2ce-0316-4d9b-9497-0fd613acb361 2018-03-22 23:50:03,705 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'b689d2ce-0316-4d9b-9497-0fd613acb361'] 2018-03-22 23:50:04,708 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task b689d2ce-0316-4d9b-9497-0fd613acb361: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task b689d2ce-0316-4d9b-9497-0fd613acb361 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 4.806 | 4.806 | 4.806 | 4.806 | 4.806 | 4.806 | 100.0% | 1 | | heat.update_stack | 2.668 | 2.668 | 2.668 | 2.668 | 2.668 | 2.668 | 100.0% | 1 | | heat.delete_stack | 3.58 | 3.58 | 3.58 | 3.58 | 3.58 | 3.58 | 100.0% | 1 | | total | 11.054 | 11.054 | 11.054 | 11.054 | 11.054 | 11.054 | 100.0% | 1 | | -> duration | 7.054 | 7.054 | 7.054 | 7.054 | 7.054 | 7.054 | 100.0% | 1 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.054176 Full duration: 21.075895 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task b689d2ce-0316-4d9b-9497-0fd613acb361 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 5.108 | 5.108 | 5.108 | 5.108 | 5.108 | 5.108 | 100.0% | 1 | | heat.check_stack | 0.524 | 0.524 | 0.524 | 0.524 | 0.524 | 0.524 | 100.0% | 1 | | heat.delete_stack | 2.499 | 2.499 | 2.499 | 2.499 | 2.499 | 2.499 | 100.0% | 1 | | total | 8.13 | 8.13 | 8.13 | 8.13 | 8.13 | 8.13 | 100.0% | 1 | | -> duration | 6.13 | 6.13 | 6.13 | 6.13 | 6.13 | 6.13 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.13037 Full duration: 16.595095 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task b689d2ce-0316-4d9b-9497-0fd613acb361 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 4.506 | 4.506 | 4.506 | 4.506 | 4.506 | 4.506 | 100.0% | 1 | | heat.suspend_stack | 2.118 | 2.118 | 2.118 | 2.118 | 2.118 | 2.118 | 100.0% | 1 | | heat.resume_stack | 0.405 | 0.405 | 0.405 | 0.405 | 0.405 | 0.405 | 100.0% | 1 | | heat.delete_stack | 2.499 | 2.499 | 2.499 | 2.499 | 2.499 | 2.499 | 100.0% | 1 | | total | 9.528 | 9.528 | 9.528 | 9.528 | 9.528 | 9.528 | 100.0% | 1 | | -> duration | 7.528 | 7.528 | 7.528 | 7.528 | 7.528 | 7.528 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.528207 Full duration: 18.729039 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task b689d2ce-0316-4d9b-9497-0fd613acb361 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 0.555 | 0.555 | 0.555 | 0.555 | 0.555 | 0.555 | 100.0% | 1 | | total | 0.555 | 0.555 | 0.555 | 0.555 | 0.555 | 0.555 | 100.0% | 1 | | -> duration | 0.555 | 0.555 | 0.555 | 0.555 | 0.555 | 0.555 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.555425 Full duration: 8.567648 HINTS: * To plot HTML graphics with this data, run: rally task report b689d2ce-0316-4d9b-9497-0fd613acb361 --out output.html * To generate a JUnit report, run: rally task export b689d2ce-0316-4d9b-9497-0fd613acb361 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report b689d2ce-0316-4d9b-9497-0fd613acb361 --json --out output.json 2018-03-22 23:50:04,709 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'b689d2ce-0316-4d9b-9497-0fd613acb361'] 2018-03-22 23:50:05,795 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-03-22 23:50:05,796 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'b689d2ce-0316-4d9b-9497-0fd613acb361', '--out', u'/home/opnfv/functest/results/rally/opnfv-heat.html'] 2018-03-22 23:50:05,803 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2018-03-22 23:50:05,803 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2018-03-22 23:50:05,803 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-keystone.yaml 2018-03-22 23:50:05,804 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-03-22 23:50:05,842 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-03-22 23:50:05,846 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['keystone'], 'concurrency': 4, 'netid': '95522f80-f743-4ff3-a08a-62c9d0dc0fc1', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-73e660e8-f74c-4690-a45e-8af372465289', 'flavor_name': 'rally-tiny-73e660e8-f74c-4690-a45e-8af372465289', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-73e660e8-f74c-4690-a45e-8af372465289', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-03-22 23:53:17,270 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : a3304743-6165-4500-b58a-9ccde9cb3ea4 2018-03-22 23:53:17,271 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'a3304743-6165-4500-b58a-9ccde9cb3ea4'] 2018-03-22 23:53:18,317 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task a3304743-6165-4500-b58a-9ccde9cb3ea4: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task a3304743-6165-4500-b58a-9ccde9cb3ea4 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.477 | 0.477 | 0.477 | 0.477 | 0.477 | 0.477 | 100.0% | 1 | | keystone_v3.add_role | 0.11 | 0.11 | 0.11 | 0.11 | 0.11 | 0.11 | 100.0% | 1 | | keystone_v3.revoke_role | 0.114 | 0.114 | 0.114 | 0.114 | 0.114 | 0.114 | 100.0% | 1 | | total | 0.702 | 0.702 | 0.702 | 0.702 | 0.702 | 0.702 | 100.0% | 1 | | -> duration | 0.702 | 0.702 | 0.702 | 0.702 | 0.702 | 0.702 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.701599 Full duration: 13.605704 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task a3304743-6165-4500-b58a-9ccde9cb3ea4 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.481 | 0.481 | 0.481 | 0.481 | 0.481 | 0.481 | 100.0% | 1 | | keystone_v3.add_role | 0.111 | 0.111 | 0.111 | 0.111 | 0.111 | 0.111 | 100.0% | 1 | | keystone_v3.list_roles | 0.101 | 0.101 | 0.101 | 0.101 | 0.101 | 0.101 | 100.0% | 1 | | total | 0.693 | 0.693 | 0.693 | 0.693 | 0.693 | 0.693 | 100.0% | 1 | | -> duration | 0.693 | 0.693 | 0.693 | 0.693 | 0.693 | 0.693 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.693428 Full duration: 14.29029 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task a3304743-6165-4500-b58a-9ccde9cb3ea4 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 1.097 | 1.097 | 1.097 | 1.097 | 1.097 | 1.097 | 100.0% | 1 | | keystone_v3.list_projects | 0.101 | 0.101 | 0.101 | 0.101 | 0.101 | 0.101 | 100.0% | 1 | | total | 1.198 | 1.198 | 1.198 | 1.198 | 1.198 | 1.198 | 100.0% | 1 | | -> duration | 1.198 | 1.198 | 1.198 | 1.198 | 1.198 | 1.198 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.197923 Full duration: 14.433458 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task a3304743-6165-4500-b58a-9ccde9cb3ea4 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.474 | 0.474 | 0.474 | 0.474 | 0.474 | 0.474 | 100.0% | 1 | | keystone_v3.delete_role | 0.113 | 0.113 | 0.113 | 0.113 | 0.113 | 0.113 | 100.0% | 1 | | total | 0.587 | 0.587 | 0.587 | 0.587 | 0.587 | 0.587 | 100.0% | 1 | | -> duration | 0.587 | 0.587 | 0.587 | 0.587 | 0.587 | 0.587 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.587447 Full duration: 11.877947 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task a3304743-6165-4500-b58a-9ccde9cb3ea4 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.478 | 0.478 | 0.478 | 0.478 | 0.478 | 0.478 | 100.0% | 1 | | keystone_v3.delete_service | 0.393 | 0.393 | 0.393 | 0.393 | 0.393 | 0.393 | 100.0% | 1 | | total | 0.871 | 0.871 | 0.871 | 0.871 | 0.871 | 0.871 | 100.0% | 1 | | -> duration | 0.871 | 0.871 | 0.871 | 0.871 | 0.871 | 0.871 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.871036 Full duration: 12.095169 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task a3304743-6165-4500-b58a-9ccde9cb3ea4 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.647 | 0.647 | 0.647 | 0.647 | 0.647 | 0.647 | 100.0% | 1 | | keystone_v3.create_user | 0.466 | 0.466 | 0.466 | 0.466 | 0.466 | 0.466 | 100.0% | 1 | | -> keystone_v3.list_roles | 0.078 | 0.078 | 0.078 | 0.078 | 0.078 | 0.078 | 100.0% | 1 | | -> keystone_v3.add_role | 0.125 | 0.125 | 0.125 | 0.125 | 0.125 | 0.125 | 100.0% | 1 | | keystone_v3.create_role | 0.092 | 0.092 | 0.092 | 0.092 | 0.092 | 0.092 | 100.0% | 1 | | keystone_v3.get_project | 0.077 | 0.077 | 0.077 | 0.077 | 0.077 | 0.077 | 100.0% | 1 | | keystone_v3.get_user | 0.085 | 0.085 | 0.085 | 0.085 | 0.085 | 0.085 | 100.0% | 1 | | keystone_v3.get_role | 0.151 | 0.151 | 0.151 | 0.151 | 0.151 | 0.151 | 100.0% | 1 | | keystone_v3.list_services | 0.08 | 0.08 | 0.08 | 0.08 | 0.08 | 0.08 | 100.0% | 1 | | keystone_v3.get_services | 0.074 | 0.074 | 0.074 | 0.074 | 0.074 | 0.074 | 100.0% | 1 | | total | 1.76 | 1.76 | 1.76 | 1.76 | 1.76 | 1.76 | 100.0% | 1 | | -> duration | 1.76 | 1.76 | 1.76 | 1.76 | 1.76 | 1.76 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.760006 Full duration: 19.641015 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task a3304743-6165-4500-b58a-9ccde9cb3ea4 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.631 | 0.631 | 0.631 | 0.631 | 0.631 | 0.631 | 100.0% | 1 | | keystone_v3.update_project | 0.095 | 0.095 | 0.095 | 0.095 | 0.095 | 0.095 | 100.0% | 1 | | keystone_v3.delete_project | 0.273 | 0.273 | 0.273 | 0.273 | 0.273 | 0.273 | 100.0% | 1 | | total | 0.999 | 0.999 | 0.999 | 0.999 | 0.999 | 0.999 | 100.0% | 1 | | -> duration | 0.999 | 0.999 | 0.999 | 0.999 | 0.999 | 0.999 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.99899 Full duration: 12.673047 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task a3304743-6165-4500-b58a-9ccde9cb3ea4 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.65 | 0.65 | 0.65 | 0.65 | 0.65 | 0.65 | 100.0% | 1 | | total | 0.738 | 0.738 | 0.738 | 0.738 | 0.738 | 0.738 | 100.0% | 1 | | -> duration | 0.738 | 0.738 | 0.738 | 0.738 | 0.738 | 0.738 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.738115 Full duration: 15.097693 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task a3304743-6165-4500-b58a-9ccde9cb3ea4 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.984 | 0.984 | 0.984 | 0.984 | 0.984 | 0.984 | 100.0% | 1 | | total | 0.984 | 0.984 | 0.984 | 0.984 | 0.984 | 0.984 | 100.0% | 1 | | -> duration | 0.984 | 0.984 | 0.984 | 0.984 | 0.984 | 0.984 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.984227 Full duration: 14.022702 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task a3304743-6165-4500-b58a-9ccde9cb3ea4 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.626 | 0.626 | 0.626 | 0.626 | 0.626 | 0.626 | 100.0% | 1 | | keystone_v3.list_users | 0.088 | 0.088 | 0.088 | 0.088 | 0.088 | 0.088 | 100.0% | 1 | | total | 0.809 | 0.809 | 0.809 | 0.809 | 0.809 | 0.809 | 100.0% | 1 | | -> duration | 0.809 | 0.809 | 0.809 | 0.809 | 0.809 | 0.809 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.809127 Full duration: 14.258401 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "users_per_tenant": 10 }, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task a3304743-6165-4500-b58a-9ccde9cb3ea4 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.619 | 0.619 | 0.619 | 0.619 | 0.619 | 0.619 | 100.0% | 1 | | keystone_v3.create_users | 4.534 | 4.534 | 4.534 | 4.534 | 4.534 | 4.534 | 100.0% | 1 | | -> keystone_v3.create_user (x10) | 4.534 | 4.534 | 4.534 | 4.534 | 4.534 | 4.534 | 100.0% | 1 | | --> keystone_v3.list_roles (x10) | 0.752 | 0.752 | 0.752 | 0.752 | 0.752 | 0.752 | 100.0% | 1 | | --> keystone_v3.add_role (x10) | 1.279 | 1.279 | 1.279 | 1.279 | 1.279 | 1.279 | 100.0% | 1 | | total | 6.126 | 6.126 | 6.126 | 6.126 | 6.126 | 6.126 | 100.0% | 1 | | -> duration | 6.126 | 6.126 | 6.126 | 6.126 | 6.126 | 6.126 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.125718 Full duration: 23.870192 HINTS: * To plot HTML graphics with this data, run: rally task report a3304743-6165-4500-b58a-9ccde9cb3ea4 --out output.html * To generate a JUnit report, run: rally task export a3304743-6165-4500-b58a-9ccde9cb3ea4 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report a3304743-6165-4500-b58a-9ccde9cb3ea4 --json --out output.json 2018-03-22 23:53:18,317 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'a3304743-6165-4500-b58a-9ccde9cb3ea4'] 2018-03-22 23:53:19,273 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-03-22 23:53:19,274 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'a3304743-6165-4500-b58a-9ccde9cb3ea4', '--out', u'/home/opnfv/functest/results/rally/opnfv-keystone.html'] 2018-03-22 23:53:19,282 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2018-03-22 23:53:19,282 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2018-03-22 23:53:19,283 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-neutron.yaml 2018-03-22 23:53:19,283 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-03-22 23:53:19,323 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-03-22 23:53:19,340 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['neutron'], 'concurrency': 4, 'netid': '95522f80-f743-4ff3-a08a-62c9d0dc0fc1', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-73e660e8-f74c-4690-a45e-8af372465289', 'flavor_name': 'rally-tiny-73e660e8-f74c-4690-a45e-8af372465289', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-73e660e8-f74c-4690-a45e-8af372465289', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-03-22 23:58:16,428 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 018b1dc1-2a44-4409-a63b-9dba0369d310 2018-03-22 23:58:16,428 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '018b1dc1-2a44-4409-a63b-9dba0369d310'] 2018-03-22 23:58:17,345 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 018b1dc1-2a44-4409-a63b-9dba0369d310: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } } } -------------------------------------------------------------------------------- Task 018b1dc1-2a44-4409-a63b-9dba0369d310 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.464 | 1.464 | 1.464 | 1.464 | 1.464 | 1.464 | 100.0% | 1 | | neutron.delete_network | 0.548 | 0.548 | 0.548 | 0.548 | 0.548 | 0.548 | 100.0% | 1 | | total | 2.012 | 2.012 | 2.012 | 2.012 | 2.012 | 2.012 | 100.0% | 1 | | -> duration | 2.012 | 2.012 | 2.012 | 2.012 | 2.012 | 2.012 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.011813 Full duration: 14.453628 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "port": -1 } } } } -------------------------------------------------------------------------------- Task 018b1dc1-2a44-4409-a63b-9dba0369d310 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 1.304 | 1.304 | 1.304 | 1.304 | 1.304 | 1.304 | 100.0% | 1 | | neutron.delete_port | 0.597 | 0.597 | 0.597 | 0.597 | 0.597 | 0.597 | 100.0% | 1 | | total | 1.901 | 1.901 | 1.901 | 1.901 | 1.901 | 1.901 | 100.0% | 1 | | -> duration | 1.901 | 1.901 | 1.901 | 1.901 | 1.901 | 1.901 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.901152 Full duration: 26.221094 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "router_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1, "port": -1, "router": -1 } } } } -------------------------------------------------------------------------------- Task 018b1dc1-2a44-4409-a63b-9dba0369d310 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.694 | 1.694 | 1.694 | 1.694 | 1.694 | 1.694 | 100.0% | 1 | | neutron.create_subnet | 0.719 | 0.719 | 0.719 | 0.719 | 0.719 | 0.719 | 100.0% | 1 | | neutron.create_router | 0.108 | 0.108 | 0.108 | 0.108 | 0.108 | 0.108 | 100.0% | 1 | | neutron.add_interface_router | 1.566 | 1.566 | 1.566 | 1.566 | 1.566 | 1.566 | 100.0% | 1 | | neutron.remove_interface_router | 1.439 | 1.439 | 1.439 | 1.439 | 1.439 | 1.439 | 100.0% | 1 | | neutron.delete_router | 0.333 | 0.333 | 0.333 | 0.333 | 0.333 | 0.333 | 100.0% | 1 | | total | 5.86 | 5.86 | 5.86 | 5.86 | 5.86 | 5.86 | 100.0% | 1 | | -> duration | 5.86 | 5.86 | 5.86 | 5.86 | 5.86 | 5.86 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.860279 Full duration: 35.124822 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1 } } } } -------------------------------------------------------------------------------- Task 018b1dc1-2a44-4409-a63b-9dba0369d310 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet | 1.52 | 1.52 | 1.52 | 1.52 | 1.52 | 1.52 | 100.0% | 1 | | neutron.delete_subnet | 0.473 | 0.473 | 0.473 | 0.473 | 0.473 | 0.473 | 100.0% | 1 | | total | 1.993 | 1.993 | 1.993 | 1.993 | 1.993 | 1.993 | 100.0% | 1 | | -> duration | 1.993 | 1.993 | 1.993 | 1.993 | 1.993 | 1.993 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.993028 Full duration: 27.538204 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } } } -------------------------------------------------------------------------------- Task 018b1dc1-2a44-4409-a63b-9dba0369d310 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.734 | 1.734 | 1.734 | 1.734 | 1.734 | 1.734 | 100.0% | 1 | | neutron.list_networks | 0.27 | 0.27 | 0.27 | 0.27 | 0.27 | 0.27 | 100.0% | 1 | | total | 2.005 | 2.005 | 2.005 | 2.005 | 2.005 | 2.005 | 100.0% | 1 | | -> duration | 2.005 | 2.005 | 2.005 | 2.005 | 2.005 | 2.005 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.004722 Full duration: 16.955854 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "port": -1 } } } } -------------------------------------------------------------------------------- Task 018b1dc1-2a44-4409-a63b-9dba0369d310 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 2.604 | 2.604 | 2.604 | 2.604 | 2.604 | 2.604 | 100.0% | 1 | | neutron.list_ports | 0.156 | 0.156 | 0.156 | 0.156 | 0.156 | 0.156 | 100.0% | 1 | | total | 2.76 | 2.76 | 2.76 | 2.76 | 2.76 | 2.76 | 100.0% | 1 | | -> duration | 2.76 | 2.76 | 2.76 | 2.76 | 2.76 | 2.76 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.760119 Full duration: 27.132657 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "router_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } } } -------------------------------------------------------------------------------- Task 018b1dc1-2a44-4409-a63b-9dba0369d310 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.734 | 0.734 | 0.734 | 0.734 | 0.734 | 0.734 | 100.0% | 1 | | neutron.create_subnet | 0.606 | 0.606 | 0.606 | 0.606 | 0.606 | 0.606 | 100.0% | 1 | | neutron.create_router | 0.157 | 0.157 | 0.157 | 0.157 | 0.157 | 0.157 | 100.0% | 1 | | neutron.add_interface_router | 2.258 | 2.258 | 2.258 | 2.258 | 2.258 | 2.258 | 100.0% | 1 | | neutron.list_routers | 0.087 | 0.087 | 0.087 | 0.087 | 0.087 | 0.087 | 100.0% | 1 | | total | 3.844 | 3.844 | 3.844 | 3.844 | 3.844 | 3.844 | 100.0% | 1 | | -> duration | 3.844 | 3.844 | 3.844 | 3.844 | 3.844 | 3.844 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.843748 Full duration: 37.666107 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1 } } } } -------------------------------------------------------------------------------- Task 018b1dc1-2a44-4409-a63b-9dba0369d310 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.176 | 1.176 | 1.176 | 1.176 | 1.176 | 1.176 | 100.0% | 1 | | neutron.create_subnet | 0.599 | 0.599 | 0.599 | 0.599 | 0.599 | 0.599 | 100.0% | 1 | | neutron.list_subnets | 0.084 | 0.084 | 0.084 | 0.084 | 0.084 | 0.084 | 100.0% | 1 | | total | 1.859 | 1.859 | 1.859 | 1.859 | 1.859 | 1.859 | 100.0% | 1 | | -> duration | 1.859 | 1.859 | 1.859 | 1.859 | 1.859 | 1.859 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.859034 Full duration: 33.847808 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } } } -------------------------------------------------------------------------------- Task 018b1dc1-2a44-4409-a63b-9dba0369d310 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.82 | 0.82 | 0.82 | 0.82 | 0.82 | 0.82 | 100.0% | 1 | | neutron.delete_security_group | 0.102 | 0.102 | 0.102 | 0.102 | 0.102 | 0.102 | 100.0% | 1 | | total | 0.923 | 0.923 | 0.923 | 0.923 | 0.923 | 0.923 | 100.0% | 1 | | -> duration | 0.923 | 0.923 | 0.923 | 0.923 | 0.923 | 0.923 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.922902 Full duration: 13.278441 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } } } -------------------------------------------------------------------------------- Task 018b1dc1-2a44-4409-a63b-9dba0369d310 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.414 | 1.414 | 1.414 | 1.414 | 1.414 | 1.414 | 100.0% | 1 | | neutron.create_security_group_rule | 0.159 | 0.159 | 0.159 | 0.159 | 0.159 | 0.159 | 100.0% | 1 | | neutron.delete_security_group_rule | 0.086 | 0.086 | 0.086 | 0.086 | 0.086 | 0.086 | 100.0% | 1 | | neutron.delete_security_group | 0.138 | 0.138 | 0.138 | 0.138 | 0.138 | 0.138 | 100.0% | 1 | | total | 1.798 | 1.798 | 1.798 | 1.798 | 1.798 | 1.798 | 100.0% | 1 | | -> duration | 1.798 | 1.798 | 1.798 | 1.798 | 1.798 | 1.798 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.79791 Full duration: 16.022185 -------------------------------------------------------------------------------- test scenario NeutronNetworks.set_and_clear_router_gateway args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": { "router:external": true } }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "router": -1 } }, "roles": [ "admin" ] } } -------------------------------------------------------------------------------- Task 018b1dc1-2a44-4409-a63b-9dba0369d310 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.985 | 0.985 | 0.985 | 0.985 | 0.985 | 0.985 | 100.0% | 1 | | neutron.create_router | 0.129 | 0.129 | 0.129 | 0.129 | 0.129 | 0.129 | 100.0% | 1 | | neutron.add_gateway_router | 1.452 | 1.452 | 1.452 | 1.452 | 1.452 | 1.452 | 100.0% | 1 | | neutron.remove_gateway_router | 1.132 | 1.132 | 1.132 | 1.132 | 1.132 | 1.132 | 100.0% | 1 | | total | 3.698 | 3.698 | 3.698 | 3.698 | 3.698 | 3.698 | 100.0% | 1 | | -> duration | 3.698 | 3.698 | 3.698 | 3.698 | 3.698 | 3.698 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.698456 Full duration: 23.720064 HINTS: * To plot HTML graphics with this data, run: rally task report 018b1dc1-2a44-4409-a63b-9dba0369d310 --out output.html * To generate a JUnit report, run: rally task export 018b1dc1-2a44-4409-a63b-9dba0369d310 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 018b1dc1-2a44-4409-a63b-9dba0369d310 --json --out output.json 2018-03-22 23:58:17,345 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '018b1dc1-2a44-4409-a63b-9dba0369d310'] 2018-03-22 23:58:18,374 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-03-22 23:58:18,374 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '018b1dc1-2a44-4409-a63b-9dba0369d310', '--out', u'/home/opnfv/functest/results/rally/opnfv-neutron.html'] 2018-03-22 23:58:18,381 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2018-03-22 23:58:18,381 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2018-03-22 23:58:18,381 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-nova.yaml 2018-03-22 23:58:18,381 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-03-22 23:58:18,401 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-03-22 23:58:18,404 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['nova'], 'concurrency': 4, 'netid': '95522f80-f743-4ff3-a08a-62c9d0dc0fc1', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-73e660e8-f74c-4690-a45e-8af372465289', 'flavor_name': 'rally-tiny-73e660e8-f74c-4690-a45e-8af372465289', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-73e660e8-f74c-4690-a45e-8af372465289', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-03-23 00:01:25,219 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 56a25ab4-460c-4054-b7ae-458ba5774323 2018-03-23 00:01:25,220 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '56a25ab4-460c-4054-b7ae-458ba5774323'] 2018-03-23 00:01:26,189 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 56a25ab4-460c-4054-b7ae-458ba5774323: aborted -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_live_migrate_server args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "flavor": { "name": "rally-tiny-73e660e8-f74c-4690-a45e-8af372465289" }, "image": { "name": "Cirros-0.4.0-73e660e8-f74c-4690-a45e-8af372465289" }, "block_migration": false, "nics": [ { "net-id": "95522f80-f743-4ff3-a08a-62c9d0dc0fc1" } ] }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 56a25ab4-460c-4054-b7ae-458ba5774323 has 1 error(s) -------------------------------------------------------------------------------- RallyException: Live Migration failed: Migration complete but instance did not change host: overcloud-novacompute-1.opnfvlf.org Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python2.7/site-packages/rally/plugins/openstack/scenarios/nova/servers.py", line 722, in run block_migration, disk_over_commit) File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 87, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally/plugins/openstack/scenarios/nova/utils.py", line 770, in _live_migrate "but instance did not change host: %s" % host_pre_migrate) RallyException: Live Migration failed: Migration complete but instance did not change host: overcloud-novacompute-1.opnfvlf.org -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 12.649 | 12.649 | 12.649 | 12.649 | 12.649 | 12.649 | 100.0% | 1 | | nova.find_host_to_migrate | 0.915 | 0.915 | 0.915 | 0.915 | 0.915 | 0.915 | 100.0% | 1 | | nova.live_migrate | 134.285 | 134.285 | 134.285 | 134.285 | 134.285 | 134.285 | 0.0% | 1 | | total | 147.849 | 147.849 | 147.849 | 147.849 | 147.849 | 147.849 | 0.0% | 1 | | -> duration | 146.849 | 146.849 | 146.849 | 146.849 | 146.849 | 146.849 | 0.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 0.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 146.849173 Full duration: 166.083209 HINTS: * To plot HTML graphics with this data, run: rally task report 56a25ab4-460c-4054-b7ae-458ba5774323 --out output.html * To generate a JUnit report, run: rally task export 56a25ab4-460c-4054-b7ae-458ba5774323 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 56a25ab4-460c-4054-b7ae-458ba5774323 --json --out output.json 2018-03-23 00:01:26,189 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '56a25ab4-460c-4054-b7ae-458ba5774323'] 2018-03-23 00:01:27,228 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-03-23 00:01:27,228 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '56a25ab4-460c-4054-b7ae-458ba5774323', '--out', u'/home/opnfv/functest/results/rally/opnfv-nova.html'] 2018-03-23 00:01:27,236 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" Failed. 2018-03-23 00:01:27,236 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2018-03-23 00:01:27,237 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-quotas.yaml 2018-03-23 00:01:27,237 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-03-23 00:01:27,278 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-03-23 00:01:27,280 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['quotas'], 'concurrency': 4, 'netid': '95522f80-f743-4ff3-a08a-62c9d0dc0fc1', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-73e660e8-f74c-4690-a45e-8af372465289', 'flavor_name': 'rally-tiny-73e660e8-f74c-4690-a45e-8af372465289', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-73e660e8-f74c-4690-a45e-8af372465289', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-03-23 00:02:17,011 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 8b5f7129-3995-4d75-8e08-08e40375cee0 2018-03-23 00:02:17,011 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '8b5f7129-3995-4d75-8e08-08e40375cee0'] 2018-03-23 00:02:17,978 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 8b5f7129-3995-4d75-8e08-08e40375cee0: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 8b5f7129-3995-4d75-8e08-08e40375cee0 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.695 | 0.695 | 0.695 | 0.695 | 0.695 | 0.695 | 100.0% | 1 | | quotas.delete_quotas | 0.174 | 0.174 | 0.174 | 0.174 | 0.174 | 0.174 | 100.0% | 1 | | total | 0.869 | 0.869 | 0.869 | 0.869 | 0.869 | 0.869 | 100.0% | 1 | | -> duration | 0.869 | 0.869 | 0.869 | 0.869 | 0.869 | 0.869 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.868858 Full duration: 7.849931 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 8b5f7129-3995-4d75-8e08-08e40375cee0 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.78 | 0.78 | 0.78 | 0.78 | 0.78 | 0.78 | 100.0% | 1 | | total | 0.78 | 0.78 | 0.78 | 0.78 | 0.78 | 0.78 | 100.0% | 1 | | -> duration | 0.78 | 0.78 | 0.78 | 0.78 | 0.78 | 0.78 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.780417 Full duration: 8.325269 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 8b5f7129-3995-4d75-8e08-08e40375cee0 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.317 | 0.317 | 0.317 | 0.317 | 0.317 | 0.317 | 100.0% | 1 | | total | 0.711 | 0.711 | 0.711 | 0.711 | 0.711 | 0.711 | 100.0% | 1 | | -> duration | 0.711 | 0.711 | 0.711 | 0.711 | 0.711 | 0.711 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.711245 Full duration: 7.772827 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 8b5f7129-3995-4d75-8e08-08e40375cee0 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.006 | 1.006 | 1.006 | 1.006 | 1.006 | 1.006 | 100.0% | 1 | | total | 1.006 | 1.006 | 1.006 | 1.006 | 1.006 | 1.006 | 100.0% | 1 | | -> duration | 1.006 | 1.006 | 1.006 | 1.006 | 1.006 | 1.006 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.006462 Full duration: 9.063692 HINTS: * To plot HTML graphics with this data, run: rally task report 8b5f7129-3995-4d75-8e08-08e40375cee0 --out output.html * To generate a JUnit report, run: rally task export 8b5f7129-3995-4d75-8e08-08e40375cee0 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 8b5f7129-3995-4d75-8e08-08e40375cee0 --json --out output.json 2018-03-23 00:02:17,978 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '8b5f7129-3995-4d75-8e08-08e40375cee0'] 2018-03-23 00:02:18,814 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-03-23 00:02:18,814 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '8b5f7129-3995-4d75-8e08-08e40375cee0', '--out', u'/home/opnfv/functest/results/rally/opnfv-quotas.html'] 2018-03-23 00:02:18,822 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2018-03-23 00:02:18,825 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:43 | 6 | 100.00% | | glance | 01:30 | 4 | 100.00% | | cinder | 02:49 | 10 | 100.00% | | heat | 01:04 | 4 | 100.00% | | keystone | 02:45 | 11 | 100.00% | | neutron | 04:31 | 11 | 100.00% | | nova | 02:46 | 1 | 0.00% | | quotas | 00:33 | 4 | 100.00% | | | | | | | TOTAL: | 00:16:45 | 51 | 98.04% | +----------------+------------+----------------+-----------+ 2018-03-23 00:02:18,826 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_sanity' success_rate is 98.04% 2018-03-23 00:02:28,582 - xtesting.energy.energy - DEBUG - Restoring previous scenario (refstack_defcore/running) 2018-03-23 00:02:28,582 - xtesting.energy.energy - DEBUG - Submitting scenario (refstack_defcore/running) 2018-03-23 00:02:29,089 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-23 00:02:29,089 - xtesting.ci.run_tests - INFO - Test result: +----------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +----------------------+------------------+------------------+----------------+ | rally_sanity | functest | 20:23 | FAIL | +----------------------+------------------+------------------+----------------+ 2018-03-23 00:02:29,093 - xtesting.ci.run_tests - ERROR - The test case 'rally_sanity' failed. 2018-03-23 00:02:29,094 - xtesting.ci.run_tests - INFO - Running test case 'refstack_defcore'... 2018-03-23 00:02:29,203 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-03-23 00:02:31,586 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-03-23 00:02:31.296 9786 INFO rally.deployment.engine [-] Deployment ce4a2159-ce4b-4036-aaf0-3c116d7dc365 | Starting: Destroy cloud and free allocated resources. 2018-03-23 00:02:31.388 9786 INFO rally.deployment.engine [-] Deployment ce4a2159-ce4b-4036-aaf0-3c116d7dc365 | Completed: Destroy cloud and free allocated resources. 2018-03-23 00:02:31.398 9786 INFO rally.api [-] Deleting deployment-specific data for verifier 'opnfv-tempest' (UUID=441ba0af-51b2-4c9c-89bd-bbeebe0d8a46). 2018-03-23 00:02:31.400 9786 INFO rally.api [-] Deployment-specific data has been successfully deleted! 2018-03-23 00:02:33,953 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-03-23 00:02:33.635 9789 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=3127bb87-58f4-49d4-b46d-3626b4762b6f) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | 3127bb87-58f4-49d4-b46d-3626b4762b6f | 2018-03-23T00:02:33 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: 3127bb87-58f4-49d4-b46d-3626b4762b6f ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-03-23 00:02:37,134 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | key-manager | Available | | __unknown__ | placement | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+----------------+-----------+ 2018-03-23 00:02:37,134 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-03-23 00:02:39,423 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify delete-verifier --id opnfv-tempest --force 2018-03-23 00:02:39.140 9795 INFO rally.api [-] Deleting verifier 'opnfv-tempest' (UUID=441ba0af-51b2-4c9c-89bd-bbeebe0d8a46). 2018-03-23 00:02:39.263 9795 INFO rally.api [-] Verifier has been successfully deleted! 2018-03-23 00:02:42,964 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide 2018-03-23 00:02:41.517 9798 INFO rally.api [-] Creating verifier 'opnfv-tempest'. 2018-03-23 00:02:41.700 9798 INFO rally.verification.manager [-] Cloning verifier repo from /src/tempest. 2018-03-23 00:02:42.784 9798 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=1acf831f-f706-4e1e-9a98-7afa164b756a) has been successfully created! Using verifier 'opnfv-tempest' (UUID=1acf831f-f706-4e1e-9a98-7afa164b756a) as the default verifier for the future CLI operations. 2018-03-23 00:02:45,959 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-03-23 00:02:47,561 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating two images for Tempest suite 2018-03-23 00:02:53,902 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-03-23 00:02:58,631 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-03-23 00:02:57.829 9817 INFO rally.api [-] Configuring verifier 'opnfv-tempest' (UUID=1acf831f-f706-4e1e-9a98-7afa164b756a) for deployment 'opnfv-rally' (UUID=3127bb87-58f4-49d4-b46d-3626b4762b6f). 2018-03-23 00:02:58.496 9817 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=1acf831f-f706-4e1e-9a98-7afa164b756a) has been successfully configured for deployment 'opnfv-rally' (UUID=3127bb87-58f4-49d4-b46d-3626b4762b6f)! 2018-03-23 00:02:58,631 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-03-23 00:02:58,632 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-03-23 00:02:58,634 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-03-23 00:03:00,659 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', u'/home/opnfv/functest/results/refstack/tempest-list.txt']'. 2018-03-23 00:03:02,781 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:02.780 9829 INFO rally.api [-] Starting verification (UUID=0535b10d-6018-40b5-b604-8c766afadf00) for deployment 'opnfv-rally' (UUID=3127bb87-58f4-49d4-b46d-3626b4762b6f) by verifier 'opnfv-tempest' (UUID=1acf831f-f706-4e1e-9a98-7afa164b756a). 2018-03-23 00:03:02,781 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Verification UUID: 0535b10d-6018-40b5-b604-8c766afadf00 2018-03-23 00:03:11,805 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:11.804 9829 INFO opnfv-tempest [-] {8} tempest.api.compute.servers.test_availability_zone.AZV2TestJSON.test_get_availability_zone_list_with_non_admin_user ... success [0.400s] 2018-03-23 00:03:11,865 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:11.865 9829 INFO opnfv-tempest [-] {12} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.011s] 2018-03-23 00:03:13,104 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:13.103 9829 INFO opnfv-tempest [-] {4} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.688s] 2018-03-23 00:03:13,293 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:13.293 9829 INFO opnfv-tempest [-] {4} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_with_detail ... success [0.188s] 2018-03-23 00:03:13,525 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:13.525 9829 INFO opnfv-tempest [-] {9} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [2.124s] 2018-03-23 00:03:13,548 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:13.548 9829 INFO opnfv-tempest [-] {6} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_delete_non_existing_tag ... success [1.794s] 2018-03-23 00:03:13,576 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:13.576 9829 INFO opnfv-tempest [-] {6} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_update_tags_for_non_existing_image ... success [0.028s] 2018-03-23 00:03:16,526 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:16.525 9829 INFO opnfv-tempest [-] {13} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_reserve_unreserve_volume ... success [1.246s] 2018-03-23 00:03:17,268 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:17.268 9829 INFO opnfv-tempest [-] {13} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_bootable ... success [0.742s] 2018-03-23 00:03:18,042 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:18.041 9829 INFO opnfv-tempest [-] {9} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [4.516s] 2018-03-23 00:03:18,663 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:18.663 9829 INFO opnfv-tempest [-] {13} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_readonly_update ... success [1.393s] 2018-03-23 00:03:20,109 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:20.109 9829 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_additional_default_security_group_fails ... success [0.235s] 2018-03-23 00:03:21,564 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:21.563 9829 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [1.348s] 2018-03-23 00:03:21,773 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:21.772 9829 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.208s] 2018-03-23 00:03:22,014 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:22.013 9829 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.241s] 2018-03-23 00:03:25,056 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:25.056 9829 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_duplicate_security_group_rule_fails ... success [4.946s] 2018-03-23 00:03:26,270 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:26.269 9829 INFO opnfv-tempest [-] {8} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_crud_volume_metadata ... success [2.788s] 2018-03-23 00:03:26,659 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:26.658 9829 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_ethertype ... success [1.602s] 2018-03-23 00:03:28,456 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:28.456 9829 INFO opnfv-tempest [-] {8} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_update_show_volume_metadata_item ... success [2.185s] 2018-03-23 00:03:29,169 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:29.169 9829 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_protocol ... success [2.510s] 2018-03-23 00:03:29,521 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:29.521 9829 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_image_null_id ... success [0.360s] 2018-03-23 00:03:29,540 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:29.540 9829 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_non_existing_image ... success [0.019s] 2018-03-23 00:03:30,386 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:30.386 9829 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_delete_deleted_image ... success [0.844s] 2018-03-23 00:03:30,394 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:30.393 9829 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_image_null_id ... success [0.008s] 2018-03-23 00:03:30,408 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:30.407 9829 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_non_existent_image ... success [0.014s] 2018-03-23 00:03:30,453 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:30.453 9829 INFO opnfv-tempest [-] {6} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_crud_snapshot_metadata ... success [2.345s] 2018-03-23 00:03:30,937 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:30.937 9829 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_remote_ip_prefix ... success [1.767s] 2018-03-23 00:03:31,638 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:31.638 9829 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_with_nonexistent_volume_id ... success [0.311s] 2018-03-23 00:03:31,820 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:31.820 9829 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_without_passing_volume_id ... success [0.182s] 2018-03-23 00:03:31,986 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:31.986 9829 INFO opnfv-tempest [-] {6} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_update_show_snapshot_metadata_item ... success [1.532s] 2018-03-23 00:03:33,585 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:33.585 9829 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_invalid_ports ... success [2.646s] 2018-03-23 00:03:35,302 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:35.302 9829 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_remote_groupid ... success [1.716s] 2018-03-23 00:03:35,452 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:35.451 9829 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_security_group ... success [0.150s] 2018-03-23 00:03:35,684 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:35.684 9829 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_delete_non_existent_security_group ... success [0.232s] 2018-03-23 00:03:35,707 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:35.707 9829 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group ... success [0.022s] 2018-03-23 00:03:35,733 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:35.732 9829 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group_rule ... success [0.026s] 2018-03-23 00:03:36,765 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:36.765 9829 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_active_server ... success [25.212s] 2018-03-23 00:03:41,108 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:41.107 9829 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor ... success [0.418s] 2018-03-23 00:03:41,374 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:41.374 9829 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image ... success [0.266s] 2018-03-23 00:03:41,643 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:41.643 9829 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name ... success [0.269s] 2018-03-23 00:03:41,964 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:41.964 9829 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status ... success [0.321s] 2018-03-23 00:03:42,206 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:42.206 9829 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results ... success [0.242s] 2018-03-23 00:03:42,299 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:42.298 9829 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_active_status ... success [0.092s] 2018-03-23 00:03:42,380 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:42.380 9829 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor ... success [0.081s] 2018-03-23 00:03:42,464 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:42.464 9829 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image ... success [0.083s] 2018-03-23 00:03:42,540 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:42.539 9829 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit ... success [0.075s] 2018-03-23 00:03:42,612 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:42.612 9829 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name ... success [0.072s] 2018-03-23 00:03:42,795 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:42.795 9829 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard ... success [0.182s] 2018-03-23 00:03:53,852 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:53.851 9829 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.041s] 2018-03-23 00:03:53,897 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:53.896 9829 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_by_name ... success [0.044s] 2018-03-23 00:03:53,947 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:53.947 9829 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_by_name ... success [0.050s] 2018-03-23 00:03:54,214 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:54.214 9829 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_pagination ... success [0.264s] 2018-03-23 00:03:54,309 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:54.309 9829 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_with_multiple_params ... success [0.094s] 2018-03-23 00:03:54,673 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:54.673 9829 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_pagination ... success [0.363s] 2018-03-23 00:03:54,711 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:54.711 9829 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_param_display_name_and_status ... success [0.039s] 2018-03-23 00:03:54,762 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:54.762 9829 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_display_name_and_status ... success [0.050s] 2018-03-23 00:03:54,819 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:54.819 9829 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_metadata ... success [0.056s] 2018-03-23 00:03:54,873 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:54.873 9829 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_details ... success [0.053s] 2018-03-23 00:03:54,916 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:54.916 9829 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_param_metadata ... success [0.042s] 2018-03-23 00:03:54,998 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:54.998 9829 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_availability_zone ... success [0.082s] 2018-03-23 00:03:55,076 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:55.076 9829 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_status ... success [0.077s] 2018-03-23 00:03:55,133 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:55.132 9829 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_availability_zone ... success [0.057s] 2018-03-23 00:03:55,180 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:03:55.180 9829 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_status ... success [0.048s] 2018-03-23 00:04:01,201 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:01.201 9829 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name ... success [9.092s] 2018-03-23 00:04:01,277 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:01.276 9829 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers ... success [0.075s] 2018-03-23 00:04:01,511 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:01.511 9829 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail ... success [0.233s] 2018-03-23 00:04:01,616 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:01.616 9829 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus ... success [0.104s] 2018-03-23 00:04:01,618 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:01.618 9829 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details ... success [0.001s] 2018-03-23 00:04:09,913 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:09.913 9829 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name ... success [0.984s] 2018-03-23 00:04:10,901 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:10.901 9829 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit ... success [0.987s] 2018-03-23 00:04:12,732 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:12.731 9829 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 ... success [1.830s] 2018-03-23 00:04:14,715 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:14.714 9829 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor ... success [1.982s] 2018-03-23 00:04:16,048 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:16.047 9829 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image ... success [1.332s] 2018-03-23 00:04:17,137 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:17.137 9829 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid ... success [1.089s] 2018-03-23 00:04:17,370 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:17.369 9829 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit ... success [0.232s] 2018-03-23 00:04:17,599 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:17.598 9829 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id ... success [0.229s] 2018-03-23 00:04:17,828 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:17.828 9829 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server ... success [0.229s] 2018-03-23 00:04:18,906 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:18.906 9829 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address ... success [1.075s] 2018-03-23 00:04:19,256 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:19.256 9829 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server ... success [0.350s] 2018-03-23 00:04:19,606 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:19.606 9829 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_deleted_server ... success [0.349s] 2018-03-23 00:04:19,859 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:19.858 9829 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server ... success [0.251s] 2018-03-23 00:04:20,666 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:20.666 9829 INFO opnfv-tempest [-] {7} tempest.api.volume.test_extensions.ExtensionsTestJSON.test_list_extensions ... success [0.162s] 2018-03-23 00:04:21,830 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:21.830 9829 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank ... success [1.970s] 2018-03-23 00:04:22,151 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:22.150 9829 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server ... success [0.319s] 2018-03-23 00:04:22,418 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:22.417 9829 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server ... success [0.268s] 2018-03-23 00:04:22,909 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:22.908 9829 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 ... success [0.489s] 2018-03-23 00:04:23,328 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:23.327 9829 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name ... success [0.418s] 2018-03-23 00:04:26,164 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:26.164 9829 INFO opnfv-tempest [-] {5} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image ... success [55.002s] 2018-03-23 00:04:26,915 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:26.915 9829 INFO opnfv-tempest [-] {5} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name ... success [0.755s] 2018-03-23 00:04:39,930 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:39.929 9829 INFO opnfv-tempest [-] {13} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_upload ... success [81.255s] 2018-03-23 00:04:48,014 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:48.014 9829 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item ... success [0.445s] 2018-03-23 00:04:48,326 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:48.325 9829 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item ... success [0.310s] 2018-03-23 00:04:49,340 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:49.340 9829 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata ... success [1.014s] 2018-03-23 00:04:49,422 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:49.422 9829 INFO opnfv-tempest [-] {15} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server ... success [24.559s] 2018-03-23 00:04:49,425 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:49.425 9829 INFO opnfv-tempest [-] {10} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume ... success [78.854s] 2018-03-23 00:04:51,570 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:51.570 9829 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata ... success [2.229s] 2018-03-23 00:04:52,105 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:52.104 9829 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item ... success [0.534s] 2018-03-23 00:04:52,735 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:52.735 9829 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata ... success [0.630s] 2018-03-23 00:04:59,729 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:59.728 9829 INFO opnfv-tempest [-] {5} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name ... success [3.115s] 2018-03-23 00:04:59,802 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:04:59.802 9829 INFO opnfv-tempest [-] {5} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers ... success [0.073s] 2018-03-23 00:05:00,227 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:00.226 9829 INFO opnfv-tempest [-] {5} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail ... success [0.423s] 2018-03-23 00:05:00,327 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:00.327 9829 INFO opnfv-tempest [-] {5} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus ... success [0.099s] 2018-03-23 00:05:00,329 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:00.329 9829 INFO opnfv-tempest [-] {5} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details ... success [0.002s] 2018-03-23 00:05:00,684 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:00.683 9829 INFO opnfv-tempest [-] {13} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_details_with_params ... success [0.256s] 2018-03-23 00:05:00,756 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:00.756 9829 INFO opnfv-tempest [-] {13} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_with_params ... success [0.073s] 2018-03-23 00:05:00,881 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:00.880 9829 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.315s] 2018-03-23 00:05:02,928 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:02.927 9829 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_additional_args ... success [2.045s] 2018-03-23 00:05:03,184 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:03.183 9829 INFO opnfv-tempest [-] {15} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard ... success [13.772s] 2018-03-23 00:05:06,541 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:06.541 9829 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_icmp_type_code ... success [3.609s] 2018-03-23 00:05:07,160 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:07.159 9829 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_protocol_integer_value ... success [0.621s] 2018-03-23 00:05:11,035 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:11.034 9829 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_group_id ... success [3.873s] 2018-03-23 00:05:13,067 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:13.066 9829 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_ip_prefix ... success [2.031s] 2018-03-23 00:05:15,880 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:15.880 9829 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [2.812s] 2018-03-23 00:05:15,924 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:15.923 9829 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.045s] 2018-03-23 00:05:24,798 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:24.797 9829 INFO opnfv-tempest [-] {5} tempest.api.volume.test_availability_zone.AvailabilityZoneTestJSON.test_get_availability_zone_list ... success [0.156s] 2018-03-23 00:05:24,918 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:24.918 9829 INFO opnfv-tempest [-] {10} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_list_get_volume_attachments ... success [35.486s] 2018-03-23 00:05:39,217 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:39.217 9829 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_invalid_size ... success [0.145s] 2018-03-23 00:05:39,383 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:39.382 9829 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_snapshot_id ... success [0.165s] 2018-03-23 00:05:39,556 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:39.556 9829 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_source_volid ... success [0.173s] 2018-03-23 00:05:39,715 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:39.715 9829 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_volume_type ... success [0.157s] 2018-03-23 00:05:39,729 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:39.729 9829 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_negative ... success [0.014s] 2018-03-23 00:05:39,875 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:39.875 9829 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_zero ... success [0.145s] 2018-03-23 00:05:39,923 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:39.923 9829 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_without_passing_size ... success [0.047s] 2018-03-23 00:05:39,959 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:39.959 9829 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_invalid_volume_id ... success [0.036s] 2018-03-23 00:05:39,971 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:39.971 9829 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_volume_without_passing_volume_id ... success [0.012s] 2018-03-23 00:05:40,005 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:40.005 9829 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id ... success [0.033s] 2018-03-23 00:05:40,015 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:40.015 9829 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id ... success [0.009s] 2018-03-23 00:05:40,061 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:40.061 9829 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_invalid_status ... success [0.046s] 2018-03-23 00:05:40,250 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:40.249 9829 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_nonexistent_name ... success [0.187s] 2018-03-23 00:05:40,288 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:40.287 9829 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_invalid_status ... success [0.038s] 2018-03-23 00:05:40,328 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:40.328 9829 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_nonexistent_name ... success [0.039s] 2018-03-23 00:05:41,296 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:41.295 9829 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_reserve_volume_with_negative_volume_status ... success [0.966s] 2018-03-23 00:05:41,335 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:41.335 9829 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_reserve_volume_with_nonexistent_volume_id ... success [0.040s] 2018-03-23 00:05:41,376 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:41.375 9829 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_unreserve_volume_with_nonexistent_volume_id ... success [0.038s] 2018-03-23 00:05:41,386 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:41.385 9829 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_empty_volume_id ... success [0.009s] 2018-03-23 00:05:41,424 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:41.424 9829 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_invalid_volume_id ... success [0.038s] 2018-03-23 00:05:41,459 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:41.458 9829 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_nonexistent_volume_id ... success [0.034s] 2018-03-23 00:05:41,495 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:41.495 9829 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_delete_nonexistent_volume_id ... success [0.036s] 2018-03-23 00:05:41,527 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:41.527 9829 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_get_nonexistent_volume_id ... success [0.032s] 2018-03-23 00:05:46,232 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:05:46.232 9829 INFO opnfv-tempest [-] {15} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server ... success [43.040s] 2018-03-23 00:06:05,741 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:06:05.741 9829 INFO opnfv-tempest [-] {15} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server ... success [19.506s] 2018-03-23 00:06:27,726 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:06:27.726 9829 INFO opnfv-tempest [-] {15} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [8.310s] 2018-03-23 00:06:41,009 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:06:41.009 9829 INFO opnfv-tempest [-] {15} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_as_clone ... success [13.280s] 2018-03-23 00:06:55,142 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:06:55.141 9829 INFO opnfv-tempest [-] {15} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [14.132s] 2018-03-23 00:07:00,296 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', '0535b10d-6018-40b5-b604-8c766afadf00']'. 2018-03-23 00:07:01,233 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2018-03-23 00:07:01,234 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2018-03-23 00:07:01,234 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-03-23 00:07:01,234 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | 0535b10d-6018-40b5-b604-8c766afadf00 | 2018-03-23 00:07:01,234 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | finished | 2018-03-23 00:07:01,234 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2018-03-23 00:03:02 | 2018-03-23 00:07:01,234 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2018-03-23 00:07:00 | 2018-03-23 00:07:01,234 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 0:03:58 | 2018-03-23 00:07:01,234 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | load_list: (value is too long, use 'detailed' flag to display it) | 2018-03-23 00:07:01,234 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2018-03-23 00:07:01,235 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: 1acf831f-f706-4e1e-9a98-7afa164b756a) | 2018-03-23 00:07:01,235 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2018-03-23 00:07:01,235 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: 3127bb87-58f4-49d4-b46d-3626b4762b6f) | 2018-03-23 00:07:01,235 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 144 | 2018-03-23 00:07:01,235 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 226.269 | 2018-03-23 00:07:01,235 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 144 | 2018-03-23 00:07:01,235 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 0 | 2018-03-23 00:07:01,235 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2018-03-23 00:07:01,235 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2018-03-23 00:07:01,235 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 0 | 2018-03-23 00:07:01,236 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-03-23 00:07:01,236 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2018-03-23 00:07:01,295 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest refstack_defcore success_rate is 100.0% 2018-03-23 00:07:08,302 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-23 00:07:08,302 - xtesting.ci.run_tests - INFO - Test result: +--------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------------+------------------+------------------+----------------+ | refstack_defcore | functest | 04:22 | PASS | +--------------------------+------------------+------------------+----------------+ 2018-03-23 00:07:08,307 - xtesting.ci.run_tests - INFO - Running test case 'patrole'... 2018-03-23 00:07:08,431 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-03-23 00:07:11,025 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-03-23 00:07:10.575 9941 INFO rally.deployment.engine [-] Deployment 3127bb87-58f4-49d4-b46d-3626b4762b6f | Starting: Destroy cloud and free allocated resources. 2018-03-23 00:07:10.635 9941 INFO rally.deployment.engine [-] Deployment 3127bb87-58f4-49d4-b46d-3626b4762b6f | Completed: Destroy cloud and free allocated resources. 2018-03-23 00:07:10.680 9941 INFO rally.api [-] Deleting all verifications created by verifier 'opnfv-tempest' (UUID=1acf831f-f706-4e1e-9a98-7afa164b756a) for deployment 'opnfv-rally'. 2018-03-23 00:07:10.701 9941 INFO rally.api [-] Deleting verification (UUID=0535b10d-6018-40b5-b604-8c766afadf00). 2018-03-23 00:07:10.752 9941 INFO rally.api [-] Verification has been successfully deleted! 2018-03-23 00:07:10.753 9941 INFO rally.api [-] Deleting deployment-specific data for verifier 'opnfv-tempest' (UUID=1acf831f-f706-4e1e-9a98-7afa164b756a). 2018-03-23 00:07:10.765 9941 INFO rally.api [-] Deployment-specific data has been successfully deleted! 2018-03-23 00:07:13,407 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-03-23 00:07:13.132 9944 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=6f17e2ee-4f04-4ede-9535-b704480f30b4) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | 6f17e2ee-4f04-4ede-9535-b704480f30b4 | 2018-03-23T00:07:13 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: 6f17e2ee-4f04-4ede-9535-b704480f30b4 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-03-23 00:07:16,569 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | key-manager | Available | | __unknown__ | placement | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+----------------+-----------+ 2018-03-23 00:07:16,569 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-03-23 00:07:18,881 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify delete-verifier --id opnfv-tempest --force 2018-03-23 00:07:18.636 9950 INFO rally.api [-] Deleting verifier 'opnfv-tempest' (UUID=1acf831f-f706-4e1e-9a98-7afa164b756a). 2018-03-23 00:07:18.754 9950 INFO rally.api [-] Verifier has been successfully deleted! 2018-03-23 00:07:23,002 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide 2018-03-23 00:07:20.935 9953 INFO rally.api [-] Creating verifier 'opnfv-tempest'. 2018-03-23 00:07:21.096 9953 INFO rally.verification.manager [-] Cloning verifier repo from /src/tempest. 2018-03-23 00:07:22.803 9953 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=5323e9a2-aa21-4346-b23a-9a7df152601f) has been successfully created! Using verifier 'opnfv-tempest' (UUID=5323e9a2-aa21-4346-b23a-9a7df152601f) as the default verifier for the future CLI operations. 2018-03-23 00:07:25,942 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-03-23 00:07:28,515 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating two images for Tempest suite 2018-03-23 00:07:33,477 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-03-23 00:07:39,477 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-03-23 00:07:38.628 9972 INFO rally.api [-] Configuring verifier 'opnfv-tempest' (UUID=5323e9a2-aa21-4346-b23a-9a7df152601f) for deployment 'opnfv-rally' (UUID=6f17e2ee-4f04-4ede-9535-b704480f30b4). 2018-03-23 00:07:39.297 9972 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=5323e9a2-aa21-4346-b23a-9a7df152601f) has been successfully configured for deployment 'opnfv-rally' (UUID=6f17e2ee-4f04-4ede-9535-b704480f30b4)! 2018-03-23 00:07:39,478 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-03-23 00:07:39,478 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-03-23 00:07:39,480 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-03-23 00:07:39,488 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Generating test case list... 2018-03-23 00:07:42,451 - functest.opnfv_tests.openstack.tempest.tempest - INFO - (cd /root/.rally/verification/verifier-5323e9a2-aa21-4346-b23a-9a7df152601f/repo; testr list-tests '(?!.*test_networks_multiprovider_rbac)(?=patrole_tempest_plugin.tests.api.(image|network|volume))' >/home/opnfv/functest/results/patrole/tempest-list.txt 2>/dev/null) 2018-03-23 00:07:42,451 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', u'/home/opnfv/functest/results/patrole/tempest-list.txt']'. 2018-03-23 00:07:44,585 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 00:07:44.585 9981 INFO rally.api [-] Starting verification (UUID=6da1cca9-2514-4f3d-974c-dbc495930f15) for deployment 'opnfv-rally' (UUID=6f17e2ee-4f04-4ede-9535-b704480f30b4) by verifier 'opnfv-tempest' (UUID=5323e9a2-aa21-4346-b23a-9a7df152601f). 2018-03-23 00:07:44,586 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Verification UUID: 6da1cca9-2514-4f3d-974c-dbc495930f15 2018-03-23 00:10:47,154 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', '6da1cca9-2514-4f3d-974c-dbc495930f15']'. 2018-03-23 00:10:48,051 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2018-03-23 00:10:48,051 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2018-03-23 00:10:48,051 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-03-23 00:10:48,051 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | 6da1cca9-2514-4f3d-974c-dbc495930f15 | 2018-03-23 00:10:48,051 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | finished | 2018-03-23 00:10:48,051 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2018-03-23 00:07:44 | 2018-03-23 00:10:48,051 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2018-03-23 00:10:46 | 2018-03-23 00:10:48,051 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 0:03:02 | 2018-03-23 00:10:48,051 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | load_list: (value is too long, use 'detailed' flag to display it) | 2018-03-23 00:10:48,051 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2018-03-23 00:10:48,051 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: 5323e9a2-aa21-4346-b23a-9a7df152601f) | 2018-03-23 00:10:48,051 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2018-03-23 00:10:48,051 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: 6f17e2ee-4f04-4ede-9535-b704480f30b4) | 2018-03-23 00:10:48,051 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 287 | 2018-03-23 00:10:48,051 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 172.748 | 2018-03-23 00:10:48,051 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 126 | 2018-03-23 00:10:48,051 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 161 | 2018-03-23 00:10:48,051 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2018-03-23 00:10:48,052 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2018-03-23 00:10:48,052 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 0 | 2018-03-23 00:10:48,052 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-03-23 00:10:48,052 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2018-03-23 00:10:48,165 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest patrole success_rate is 100.0% 2018-03-23 00:10:58,053 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-23 00:10:58,053 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | patrole | functest | 03:32 | PASS | +-------------------+------------------+------------------+----------------+ 2018-03-23 00:10:58,057 - xtesting.ci.run_tests - INFO - Running test case 'snaps_smoke'... 2018-03-23 00:10:58,919 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-03-23 01:13:13,740 - xtesting.core.unit - DEBUG - test_add_rule (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_delete_group (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_group_admin_user_to_new_project (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_group_new_user_to_admin_project (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_group_with_one_complex_rule (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_group_with_one_simple_rule (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_group_with_several_rules (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_group_without_rules (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_remove_rule_by_id (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_remove_rule_by_setting (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_delete_image (snaps.openstack.tests.create_image_tests.CreateImageSuccessTests) ... ok test_create_image_clean_file (snaps.openstack.tests.create_image_tests.CreateImageSuccessTests) ... ok test_create_image_clean_url (snaps.openstack.tests.create_image_tests.CreateImageSuccessTests) ... ok test_create_image_clean_url_properties (snaps.openstack.tests.create_image_tests.CreateImageSuccessTests) ... ok test_create_same_image (snaps.openstack.tests.create_image_tests.CreateImageSuccessTests) ... ok test_create_same_image_new_settings (snaps.openstack.tests.create_image_tests.CreateImageSuccessTests) ... ok test_bad_image_file (snaps.openstack.tests.create_image_tests.CreateImageNegativeTests) ... ok test_bad_image_image_type (snaps.openstack.tests.create_image_tests.CreateImageNegativeTests) ... ok test_bad_image_name (snaps.openstack.tests.create_image_tests.CreateImageNegativeTests) ... ok test_bad_image_url (snaps.openstack.tests.create_image_tests.CreateImageNegativeTests) ... ok test_create_three_part_image_from_file_3_creators (snaps.openstack.tests.create_image_tests.CreateMultiPartImageTests) ... ok test_create_three_part_image_from_url (snaps.openstack.tests.create_image_tests.CreateMultiPartImageTests) ... ok test_create_three_part_image_from_url_3_creators (snaps.openstack.tests.create_image_tests.CreateMultiPartImageTests) ... ok test_create_delete_keypair (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsTests) ... ok test_create_keypair_from_file (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsTests) ... ok test_create_keypair_large_key (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsTests) ... ok test_create_keypair_only (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsTests) ... ok test_create_keypair_save_both (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsTests) ... ok test_create_keypair_save_pub_only (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsTests) ... ok test_create_keypair_exist_files_delete (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsCleanupTests) ... ok test_create_keypair_exist_files_keep (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsCleanupTests) ... ok test_create_keypair_gen_files_delete_1 (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsCleanupTests) ... ok test_create_keypair_gen_files_delete_2 (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsCleanupTests) ... ok test_create_keypair_gen_files_keep (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsCleanupTests) ... ok test_create_delete_network (snaps.openstack.tests.create_network_tests.CreateNetworkSuccessTests) ... ok test_create_network_router_admin_user_to_new_project (snaps.openstack.tests.create_network_tests.CreateNetworkSuccessTests) ... ok test_create_network_router_new_user_to_admin_project (snaps.openstack.tests.create_network_tests.CreateNetworkSuccessTests) ... ok test_create_network_with_router (snaps.openstack.tests.create_network_tests.CreateNetworkSuccessTests) ... ok test_create_network_without_router (snaps.openstack.tests.create_network_tests.CreateNetworkSuccessTests) ... ok test_create_networks_same_name (snaps.openstack.tests.create_network_tests.CreateNetworkSuccessTests) ... ok test_create_delete_router (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_admin_state_True (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_admin_state_false (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_admin_user_to_new_project (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_external_network (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_new_user_as_admin_project (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_private_network (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_vanilla (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_with_ext_port (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_admin_ports (snaps.openstack.tests.create_router_tests.CreateRouterNegativeTests) ... ok test_create_router_invalid_gateway_name (snaps.openstack.tests.create_router_tests.CreateRouterNegativeTests) ... ok test_create_router_noname (snaps.openstack.tests.create_router_tests.CreateRouterNegativeTests) ... ok test_create_delete_qos (snaps.openstack.tests.create_qos_tests.CreateQoSTests) ... ok test_create_qos (snaps.openstack.tests.create_qos_tests.CreateQoSTests) ... ok test_create_same_qos (snaps.openstack.tests.create_qos_tests.CreateQoSTests) ... ok test_create_delete_volume_type (snaps.openstack.tests.create_volume_type_tests.CreateSimpleVolumeTypeSuccessTests) ... ok test_create_same_volume_type (snaps.openstack.tests.create_volume_type_tests.CreateSimpleVolumeTypeSuccessTests) ... ok test_create_volume_type (snaps.openstack.tests.create_volume_type_tests.CreateSimpleVolumeTypeSuccessTests) ... ok test_volume_type_with_encryption (snaps.openstack.tests.create_volume_type_tests.CreateVolumeTypeComplexTests) ... ok test_volume_type_with_qos (snaps.openstack.tests.create_volume_type_tests.CreateVolumeTypeComplexTests) ... ok test_volume_type_with_qos_and_encryption (snaps.openstack.tests.create_volume_type_tests.CreateVolumeTypeComplexTests) ... ok test_create_delete_volume (snaps.openstack.tests.create_volume_tests.CreateSimpleVolumeSuccessTests) ... ok test_create_same_volume (snaps.openstack.tests.create_volume_tests.CreateSimpleVolumeSuccessTests) ... ok test_create_volume_simple (snaps.openstack.tests.create_volume_tests.CreateSimpleVolumeSuccessTests) ... ok test_create_volume_bad_image (snaps.openstack.tests.create_volume_tests.CreateSimpleVolumeFailureTests) ... ok test_create_volume_bad_size (snaps.openstack.tests.create_volume_tests.CreateSimpleVolumeFailureTests) ... ok test_create_volume_bad_type (snaps.openstack.tests.create_volume_tests.CreateSimpleVolumeFailureTests) ... ok test_bad_volume_type (snaps.openstack.tests.create_volume_tests.CreateVolumeWithTypeTests) ... ok test_valid_volume_type (snaps.openstack.tests.create_volume_tests.CreateVolumeWithTypeTests) ... ok test_bad_image_name (snaps.openstack.tests.create_volume_tests.CreateVolumeWithImageTests) ... ok test_valid_volume_image (snaps.openstack.tests.create_volume_tests.CreateVolumeWithImageTests) ... ok test_check_vm_ip_dhcp (snaps.openstack.tests.create_instance_tests.SimpleHealthCheck) ... ok test_ping_via_router (snaps.openstack.tests.create_instance_tests.CreateInstanceTwoNetTests) ... ok test_create_admin_instance (snaps.openstack.tests.create_instance_tests.CreateInstanceSimpleTests) ... ok test_create_delete_instance (snaps.openstack.tests.create_instance_tests.CreateInstanceSimpleTests) ... ok test_set_allowed_address_pairs (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_allowed_address_pairs_bad_ip (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_allowed_address_pairs_bad_mac (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_custom_invalid_ip_one_subnet (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_custom_invalid_mac (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_custom_mac_and_ip (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_custom_valid_ip_one_subnet (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_custom_valid_mac (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_one_port_two_ip_one_subnet (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_one_port_two_ip_two_subnets (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_add_invalid_security_group (snaps.openstack.tests.create_instance_tests.InstanceSecurityGroupTests) ... ok test_add_same_security_group (snaps.openstack.tests.create_instance_tests.InstanceSecurityGroupTests) ... ok test_add_security_group (snaps.openstack.tests.create_instance_tests.InstanceSecurityGroupTests) ... ok test_remove_security_group (snaps.openstack.tests.create_instance_tests.InstanceSecurityGroupTests) ... ok test_remove_security_group_never_added (snaps.openstack.tests.create_instance_tests.InstanceSecurityGroupTests) ... ok test_deploy_vm_to_each_compute_node (snaps.openstack.tests.create_instance_tests.CreateInstanceOnComputeHost) ... ok test_create_instance_from_three_part_image (snaps.openstack.tests.create_instance_tests.CreateInstanceFromThreePartImage) ... ok test_create_instance_with_one_volume (snaps.openstack.tests.create_instance_tests.CreateInstanceVolumeTests) ... ok test_create_instance_with_two_volumes (snaps.openstack.tests.create_instance_tests.CreateInstanceVolumeTests) ... ok test_create_delete_stack (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests) ... ok test_create_same_stack (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests) ... ok test_create_stack_short_timeout (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests) ... ok test_create_stack_template_dict (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests) ... ok test_create_stack_template_file (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests) ... ok test_retrieve_network_creators (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests) ... ok test_retrieve_vm_inst_creators (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests) ... ok test_retrieve_volume_creator (snaps.openstack.tests.create_stack_tests.CreateStackVolumeTests) ... ok test_retrieve_volume_type_creator (snaps.openstack.tests.create_stack_tests.CreateStackVolumeTests) ... ok test_retrieve_flavor_creator (snaps.openstack.tests.create_stack_tests.CreateStackFlavorTests) ... ok test_retrieve_keypair_creator (snaps.openstack.tests.create_stack_tests.CreateStackKeypairTests) ... ok test_retrieve_security_group_creator (snaps.openstack.tests.create_stack_tests.CreateStackSecurityGroupTests) ... ok test_bad_stack_file (snaps.openstack.tests.create_stack_tests.CreateStackNegativeTests) ... ok test_missing_dependencies (snaps.openstack.tests.create_stack_tests.CreateStackNegativeTests) ... ok test_single_port_static (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests) ... ok test_ssh_client_fip_after_active (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests) ... ok test_ssh_client_fip_after_init (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests) ... ok test_ssh_client_fip_after_reboot (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests) ... ok test_ssh_client_fip_before_active (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests) ... ok test_ssh_client_fip_reverse_engineer (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests) ... ok test_ssh_client_fip_second_creator (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests) ... ok test_connect_via_ssh_heat_vm (snaps.openstack.tests.create_stack_tests.CreateStackFloatingIpTests) ... ok test_connect_via_ssh_heat_vm_derived (snaps.openstack.tests.create_stack_tests.CreateStackFloatingIpTests) ... ok test_apply_simple_playbook (snaps.provisioning.tests.ansible_utils_tests.AnsibleProvisioningTests) ... ok test_apply_template_playbook (snaps.provisioning.tests.ansible_utils_tests.AnsibleProvisioningTests) ... ok ---------------------------------------------------------------------- Ran 119 tests in 3734.759s OK 2018-03-23 01:13:13,855 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-23 01:13:13,855 - xtesting.ci.run_tests - INFO - Test result: +---------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +---------------------+------------------+------------------+----------------+ | snaps_smoke | functest | 62:15 | PASS | +---------------------+------------------+------------------+----------------+ 2018-03-23 01:13:13,859 - xtesting.ci.run_tests - INFO - Running test case 'neutron_trunk'... 2018-03-23 01:13:13,957 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-03-23 01:13:16,536 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-03-23 01:13:16.099 10208 INFO rally.deployment.engine [-] Deployment 6f17e2ee-4f04-4ede-9535-b704480f30b4 | Starting: Destroy cloud and free allocated resources. 2018-03-23 01:13:16.167 10208 INFO rally.deployment.engine [-] Deployment 6f17e2ee-4f04-4ede-9535-b704480f30b4 | Completed: Destroy cloud and free allocated resources. 2018-03-23 01:13:16.229 10208 INFO rally.api [-] Deleting all verifications created by verifier 'opnfv-tempest' (UUID=5323e9a2-aa21-4346-b23a-9a7df152601f) for deployment 'opnfv-rally'. 2018-03-23 01:13:16.262 10208 INFO rally.api [-] Deleting verification (UUID=6da1cca9-2514-4f3d-974c-dbc495930f15). 2018-03-23 01:13:16.302 10208 INFO rally.api [-] Verification has been successfully deleted! 2018-03-23 01:13:16.303 10208 INFO rally.api [-] Deleting deployment-specific data for verifier 'opnfv-tempest' (UUID=5323e9a2-aa21-4346-b23a-9a7df152601f). 2018-03-23 01:13:16.309 10208 INFO rally.api [-] Deployment-specific data has been successfully deleted! 2018-03-23 01:13:18,877 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-03-23 01:13:18.563 10211 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=4d8f8490-d397-40c0-a901-0371b9b92468) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | 4d8f8490-d397-40c0-a901-0371b9b92468 | 2018-03-23T01:13:18 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: 4d8f8490-d397-40c0-a901-0371b9b92468 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-03-23 01:13:22,088 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | key-manager | Available | | __unknown__ | placement | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+----------------+-----------+ 2018-03-23 01:13:22,089 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-03-23 01:13:24,382 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify delete-verifier --id opnfv-tempest --force 2018-03-23 01:13:24.065 10217 INFO rally.api [-] Deleting verifier 'opnfv-tempest' (UUID=5323e9a2-aa21-4346-b23a-9a7df152601f). 2018-03-23 01:13:24.197 10217 INFO rally.api [-] Verifier has been successfully deleted! 2018-03-23 01:13:27,805 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide 2018-03-23 01:13:26.475 10220 INFO rally.api [-] Creating verifier 'opnfv-tempest'. 2018-03-23 01:13:26.616 10220 INFO rally.verification.manager [-] Cloning verifier repo from /src/tempest. 2018-03-23 01:13:27.628 10220 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=d7dd87f7-eb53-4508-bfee-a8cde83afc19) has been successfully created! Using verifier 'opnfv-tempest' (UUID=d7dd87f7-eb53-4508-bfee-a8cde83afc19) as the default verifier for the future CLI operations. 2018-03-23 01:13:30,815 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-03-23 01:13:33,438 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating two images for Tempest suite 2018-03-23 01:13:38,623 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-03-23 01:13:45,393 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-03-23 01:13:44.434 10239 INFO rally.api [-] Configuring verifier 'opnfv-tempest' (UUID=d7dd87f7-eb53-4508-bfee-a8cde83afc19) for deployment 'opnfv-rally' (UUID=4d8f8490-d397-40c0-a901-0371b9b92468). 2018-03-23 01:13:45.200 10239 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=d7dd87f7-eb53-4508-bfee-a8cde83afc19) has been successfully configured for deployment 'opnfv-rally' (UUID=4d8f8490-d397-40c0-a901-0371b9b92468)! 2018-03-23 01:13:45,394 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-03-23 01:13:45,394 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-03-23 01:13:45,396 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-03-23 01:13:45,406 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Generating test case list... 2018-03-23 01:13:48,430 - functest.opnfv_tests.openstack.tempest.tempest - INFO - (cd /root/.rally/verification/verifier-d7dd87f7-eb53-4508-bfee-a8cde83afc19/repo; testr list-tests 'neutron.tests.tempest.(api|scenario).test_trunk' >/home/opnfv/functest/results/neutron_trunk/test_list.txt 2>/dev/null) 2018-03-23 01:13:48,430 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Applying tempest blacklist... 2018-03-23 01:13:48,431 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Tempest blacklist file does not exist. 2018-03-23 01:13:48,431 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', u'/home/opnfv/functest/results/neutron_trunk/test_list.txt']'. 2018-03-23 01:13:50,521 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-23 01:13:50.520 10248 INFO rally.api [-] Starting verification (UUID=08fff964-c8cd-4fb3-8a24-a97800f06a43) for deployment 'opnfv-rally' (UUID=4d8f8490-d397-40c0-a901-0371b9b92468) by verifier 'opnfv-tempest' (UUID=d7dd87f7-eb53-4508-bfee-a8cde83afc19). 2018-03-23 01:13:50,522 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Verification UUID: 08fff964-c8cd-4fb3-8a24-a97800f06a43 2018-03-23 01:15:58,769 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', '08fff964-c8cd-4fb3-8a24-a97800f06a43']'. 2018-03-23 01:15:59,753 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2018-03-23 01:15:59,753 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2018-03-23 01:15:59,753 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-03-23 01:15:59,753 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | 08fff964-c8cd-4fb3-8a24-a97800f06a43 | 2018-03-23 01:15:59,753 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | finished | 2018-03-23 01:15:59,753 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2018-03-23 01:13:50 | 2018-03-23 01:15:59,753 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2018-03-23 01:15:58 | 2018-03-23 01:15:59,753 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 0:02:08 | 2018-03-23 01:15:59,753 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | load_list: (value is too long, use 'detailed' flag to display it) | 2018-03-23 01:15:59,753 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2018-03-23 01:15:59,753 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: d7dd87f7-eb53-4508-bfee-a8cde83afc19) | 2018-03-23 01:15:59,753 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2018-03-23 01:15:59,753 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: 4d8f8490-d397-40c0-a901-0371b9b92468) | 2018-03-23 01:15:59,753 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 52 | 2018-03-23 01:15:59,753 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 115.054 | 2018-03-23 01:15:59,753 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 43 | 2018-03-23 01:15:59,753 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 9 | 2018-03-23 01:15:59,753 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2018-03-23 01:15:59,753 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2018-03-23 01:15:59,754 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 0 | 2018-03-23 01:15:59,754 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-03-23 01:15:59,754 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------------------------------------------------------------------+ 2018-03-23 01:15:59,763 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest neutron_trunk success_rate is 100.0% 2018-03-23 01:16:08,945 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-23 01:16:08,945 - xtesting.ci.run_tests - INFO - Test result: +-----------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-----------------------+------------------+------------------+----------------+ | neutron_trunk | functest | 02:38 | PASS | +-----------------------+------------------+------------------+----------------+ 2018-03-23 01:16:08,949 - xtesting.ci.run_tests - INFO - Xtesting report: +------------------------------+------------------+---------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +------------------------------+------------------+---------------+------------------+----------------+ | vping_ssh | functest | smoke | 01:24 | PASS | | vping_userdata | functest | smoke | 00:37 | PASS | | tempest_smoke_serial | functest | smoke | 13:20 | PASS | | rally_sanity | functest | smoke | 20:23 | FAIL | | refstack_defcore | functest | smoke | 04:22 | PASS | | patrole | functest | smoke | 03:32 | PASS | | snaps_smoke | functest | smoke | 62:15 | PASS | | neutron_trunk | functest | smoke | 02:38 | PASS | | odl | functest | smoke | 00:00 | SKIP | | odl_netvirt | functest | smoke | 00:00 | SKIP | +------------------------------+------------------+---------------+------------------+----------------+ 2018-03-23 01:16:08,957 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR 2018-03-23 01:16:40,473 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-apex-baremetal-daily-master-42 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-nosdn-bar-noha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod1 | +--------------------------------------+----------------------------------------------------------+ 2018-03-23 01:16:40,475 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Clear any old environment that may conflict. for key in $( set | awk '{FS="="} /^OS_/ {print $1}' ); do unset $key ; done export OS_USERNAME=admin export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_BAREMETAL_API_VERSION=1.34 export NOVA_VERSION=1.1 export OS_PROJECT_NAME=admin export OS_PASSWORD=2yF32GEZxKYmC83RxVhafnVGD export OS_NO_CACHE=True export COMPUTE_API_VERSION=1.1 export no_proxy=,172.30.9.24,192.30.9.6 export OS_VOLUME_API_VERSION=3 export OS_CLOUDNAME=overcloud export OS_AUTH_URL=http://172.30.9.24:5000/v3 export IRONIC_API_VERSION=1.34 export OS_IDENTITY_API_VERSION=3 export OS_IMAGE_API_VERSION=2 export OS_AUTH_TYPE=password export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available" # Add OS_CLOUDNAME to PS1 if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then export PS1=${PS1:-""} export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1 export CLOUDPROMPT_ENABLED=1 fi export OS_REGION_NAME=regionOne 2018-03-23 01:16:40,475 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-03-23 01:16:40,476 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +------------------+---------------+--------------------------+-------------------------------------------+-----------------------------------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +------------------+---------------+--------------------------+-------------------------------------------+-----------------------------------------------+ | features | 2 | (daily)|(weekly) | Test suites from feature projects | doctor-notification barometercollectd | | | | | integrated in functest | | +------------------+---------------+--------------------------+-------------------------------------------+-----------------------------------------------+ 2018-03-23 01:16:40,477 - xtesting.ci.run_tests - INFO - Running tier 'features' 2018-03-23 01:16:40,477 - xtesting.ci.run_tests - INFO - Running test case 'doctor-notification'... 2018-03-23 01:21:24,995 - xtesting.core.feature - INFO - Test result is stored in '/var/lib/xtesting/results/doctor-notification.log' 2018-03-23 01:21:25,116 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-23 01:21:25,116 - xtesting.ci.run_tests - INFO - Test result: +-----------------------------+-----------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-----------------------------+-----------------+------------------+----------------+ | doctor-notification | doctor | 04:44 | PASS | +-----------------------------+-----------------+------------------+----------------+ 2018-03-23 01:21:25,120 - xtesting.ci.run_tests - INFO - Running test case 'barometercollectd'... 2018-03-23 02:06:34,657 - xtesting.core.feature - INFO - Test result is stored in '/var/lib/xtesting/results/barometercollectd.log' 2018-03-23 02:06:34,770 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-23 02:06:34,770 - xtesting.ci.run_tests - INFO - Test result: +---------------------------+-------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +---------------------------+-------------------+------------------+----------------+ | barometercollectd | barometer | 45:09 | FAIL | +---------------------------+-------------------+------------------+----------------+ 2018-03-23 02:06:34,775 - xtesting.ci.run_tests - ERROR - The test case 'barometercollectd' failed. 2018-03-23 02:06:34,776 - xtesting.ci.run_tests - INFO - Xtesting report: +-----------------------------+------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +-----------------------------+------------------------+------------------+------------------+----------------+ | doctor-notification | doctor | features | 04:44 | PASS | | barometercollectd | barometer | features | 45:09 | FAIL | | bgpvpn | sdnvpn | features | 00:00 | SKIP | | functest-odl-sfc | sfc | features | 00:00 | SKIP | | fds | fastdatastacks | features | 00:00 | SKIP | +-----------------------------+------------------------+------------------+------------------+----------------+ 2018-03-23 02:06:34,781 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR 2018-03-23 02:07:30,416 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-apex-baremetal-daily-master-42 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-nosdn-bar-noha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod1 | +--------------------------------------+----------------------------------------------------------+ 2018-03-23 02:07:30,421 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Clear any old environment that may conflict. for key in $( set | awk '{FS="="} /^OS_/ {print $1}' ); do unset $key ; done export OS_USERNAME=admin export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_BAREMETAL_API_VERSION=1.34 export NOVA_VERSION=1.1 export OS_PROJECT_NAME=admin export OS_PASSWORD=2yF32GEZxKYmC83RxVhafnVGD export OS_NO_CACHE=True export COMPUTE_API_VERSION=1.1 export no_proxy=,172.30.9.24,192.30.9.6 export OS_VOLUME_API_VERSION=3 export OS_CLOUDNAME=overcloud export OS_AUTH_URL=http://172.30.9.24:5000/v3 export IRONIC_API_VERSION=1.34 export OS_IDENTITY_API_VERSION=3 export OS_IMAGE_API_VERSION=2 export OS_AUTH_TYPE=password export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available" # Add OS_CLOUDNAME to PS1 if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then export PS1=${PS1:-""} export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1 export CLOUDPROMPT_ENABLED=1 fi export OS_REGION_NAME=regionOne 2018-03-23 02:07:30,421 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-03-23 02:07:30,421 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------+---------------+-----------------+---------------------+-------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------+---------------+-----------------+---------------------+-------------------+ +---------------+---------------+-----------------+---------------------+-------------------+ 2018-03-23 02:07:30,422 - xtesting.ci.run_tests - INFO - Xtesting report: +----------------------+------------------+--------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +----------------------+------------------+--------------+------------------+----------------+ | cloudify_ims | functest | vnf | 00:00 | SKIP | | vyos_vrouter | functest | vnf | 00:00 | SKIP | | juju_epc | functest | vnf | 00:00 | SKIP | +----------------------+------------------+--------------+------------------+----------------+ 2018-03-23 02:07:30,424 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK 2018-03-23 02:07:33,176 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-apex-baremetal-daily-master-42 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-nosdn-bar-noha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod1 | +--------------------------------------+----------------------------------------------------------+ 2018-03-23 02:07:33,179 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Clear any old environment that may conflict. for key in $( set | awk '{FS="="} /^OS_/ {print $1}' ); do unset $key ; done export OS_USERNAME=admin export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_BAREMETAL_API_VERSION=1.34 export NOVA_VERSION=1.1 export OS_PROJECT_NAME=admin export OS_PASSWORD=2yF32GEZxKYmC83RxVhafnVGD export OS_NO_CACHE=True export COMPUTE_API_VERSION=1.1 export no_proxy=,172.30.9.24,192.30.9.6 export OS_VOLUME_API_VERSION=3 export OS_CLOUDNAME=overcloud export OS_AUTH_URL=http://172.30.9.24:5000/v3 export IRONIC_API_VERSION=1.34 export OS_IDENTITY_API_VERSION=3 export OS_IMAGE_API_VERSION=2 export OS_AUTH_TYPE=password export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available" # Add OS_CLOUDNAME to PS1 if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then export PS1=${PS1:-""} export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1 export CLOUDPROMPT_ENABLED=1 fi export OS_REGION_NAME=regionOne 2018-03-23 02:07:33,179 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-03-23 02:07:33,179 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +------------------+---------------+--------------------------+-------------------------------------------+-----------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +------------------+---------------+--------------------------+-------------------------------------------+-----------------------+ | features | 2 | (daily)|(weekly) | Test suites from feature projects | parser-basics | | | | | integrated in functest | | +------------------+---------------+--------------------------+-------------------------------------------+-----------------------+ 2018-03-23 02:07:33,180 - xtesting.ci.run_tests - INFO - Running tier 'features' 2018-03-23 02:07:33,180 - xtesting.ci.run_tests - INFO - Running test case 'parser-basics'... 2018-03-23 02:10:32,417 - xtesting.core.feature - INFO - Test result is stored in '/var/lib/xtesting/results/parser-basics.log' 2018-03-23 02:10:32,534 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-23 02:10:32,534 - xtesting.ci.run_tests - INFO - Test result: +-----------------------+-----------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-----------------------+-----------------+------------------+----------------+ | parser-basics | parser | 02:59 | PASS | +-----------------------+-----------------+------------------+----------------+ 2018-03-23 02:10:32,538 - xtesting.ci.run_tests - INFO - Xtesting report: +-----------------------+-----------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +-----------------------+-----------------+------------------+------------------+----------------+ | parser-basics | parser | features | 02:59 | PASS | +-----------------------+-----------------+------------------+------------------+----------------+ 2018-03-23 02:10:32,539 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK