2018-04-18 09:47:52,455 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-fuel-baremetal-daily-master-121 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | fuel | | DEPLOY_SCENARIO | os-nosdn-ovs-ha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod2 | +--------------------------------------+----------------------------------------------------------+ 2018-04-18 09:47:52,459 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file export OS_IDENTITY_API_VERSION=3 export OS_PROJECT_DOMAIN_NAME=Default export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_NAME=admin export OS_TENANT_NAME=admin export OS_USERNAME=admin export OS_PASSWORD=opnfv_secret export OS_REGION_NAME=RegionOne export OS_INTERFACE=internal export OS_ENDPOINT_TYPE="internal" export OS_CACERT="/etc/ssl/certs/mcp_os_cacert" export VOLUME_DEVICE_NAME=vdc export OS_AUTH_URL=http://10.167.4.35:35357/v3 2018-04-18 09:47:52,459 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-04-18 09:47:52,460 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------------+---------------+-------------------------------------------+-------------------------------------------------+------------------------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------------+---------------+-------------------------------------------+-------------------------------------------------+------------------------------------+ | healthcheck | 0 | (merge)|(verify)|(daily)|(weekly) | First tier to be executed to verify the | connection_check api_check | | | | | basic operations in the VIM. | snaps_health_check | +---------------------+---------------+-------------------------------------------+-------------------------------------------------+------------------------------------+ 2018-04-18 09:47:52,462 - xtesting.ci.run_tests - INFO - Running tier 'healthcheck' 2018-04-18 09:47:52,462 - xtesting.ci.run_tests - INFO - Running test case 'connection_check'... 2018-04-18 09:47:54,198 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata '{u'hw:mem_page_size': u'large'}' 2018-04-18 09:48:03,100 - xtesting.core.unit - DEBUG - test_glance_connect_fail (snaps.openstack.utils.tests.glance_utils_tests.GlanceSmokeTests) ... ok test_glance_connect_success (snaps.openstack.utils.tests.glance_utils_tests.GlanceSmokeTests) ... ok test_keystone_connect_fail (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneSmokeTests) ... ok test_keystone_connect_success (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneSmokeTests) ... ok test_neutron_connect_fail (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_neutron_connect_success (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_retrieve_ext_network_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_nova_connect_fail (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_nova_connect_success (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_nova_get_hypervisor_hosts (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_heat_connect_fail (snaps.openstack.utils.tests.heat_utils_tests.HeatSmokeTests) ... ok test_heat_connect_success (snaps.openstack.utils.tests.heat_utils_tests.HeatSmokeTests) ... ok test_cinder_connect_fail (snaps.openstack.utils.tests.cinder_utils_tests.CinderSmokeTests) ... ok test_cinder_connect_success (snaps.openstack.utils.tests.cinder_utils_tests.CinderSmokeTests) ... ok ---------------------------------------------------------------------- Ran 14 tests in 8.888s OK 2018-04-18 09:48:03,218 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-18 09:48:03,218 - xtesting.ci.run_tests - INFO - Test result: +--------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------------+------------------+------------------+----------------+ | connection_check | functest | 00:09 | PASS | +--------------------------+------------------+------------------+----------------+ 2018-04-18 09:48:03,221 - xtesting.ci.run_tests - INFO - Running test case 'api_check'... 2018-04-18 09:48:04,719 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata '{u'hw:mem_page_size': u'large'}' 2018-04-18 10:00:05,922 - xtesting.core.unit - DEBUG - test_create_project_minimal (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_create_user_minimal (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_fail_without_proper_credentials (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_fail_without_proper_service (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_success (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_with_each_interface (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_grant_user_role_to_project (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_create_admin_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_delete_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_user_2x (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_delete_project (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_2x (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_bad_domain (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_quota_override (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_update_quotas (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_sec_grp_one_user (snaps.openstack.tests.create_project_tests.CreateProjectUserTests) ... ok test_create_project_sec_grp_two_users (snaps.openstack.tests.create_project_tests.CreateProjectUserTests) ... ok test_create_image_minimal_file (snaps.openstack.utils.tests.glance_utils_tests.GlanceUtilsTests) ... ok test_create_image_minimal_url (snaps.openstack.utils.tests.glance_utils_tests.GlanceUtilsTests) ... ok test_create_network (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_network_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_network_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_empty_cidr (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_null_cidr (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_add_interface_router (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_missing_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_null_router (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_null_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_invalid_ip (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_invalid_ip_to_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_ip (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_network_object (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_router_simple (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_router_with_public_interface (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_delete_simple_sec_grp (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_list_sec_grp_no_rules (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_no_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_no_rules (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_one_rule (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_get_sec_grp_by_id (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_floating_ips (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsFloatingIpTests) ... ok test_create_delete_keypair (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_key_from_file (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_keypair (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_delete_flavor (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsFlavorTests) ... ok test_create_flavor (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsFlavorTests) ... ok test_create_instance (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceTests) ... ok test_add_remove_volume (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_attach_volume_nowait (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_detach_volume_nowait (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_create_clean_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_delete_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor_all_settings (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor_existing (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateSimpleStackTests) ... ok test_create_stack_x2 (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateSimpleStackTests) ... ok test_get_settings_from_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateComplexStackTests) ... ok test_create_flavor_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsFlavorTests) ... ok test_create_keypair_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsKeypairTests) ... ok test_create_security_group_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsSecurityGroupTests) ... ok test_create_delete_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_back (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_both (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_front (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_delete_volume (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTests) ... ok test_create_simple_volume (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTests) ... ok test_create_delete_volume_type (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsSimpleVolumeTypeTests) ... ok test_create_simple_volume_type (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsSimpleVolumeTypeTests) ... ok test_create_bad_key_size (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_delete_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_simple_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_with_all_attrs (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_with_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_invalid_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_qos_and_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok ---------------------------------------------------------------------- Ran 85 tests in 721.149s OK 2018-04-18 10:00:06,035 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-18 10:00:06,037 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | api_check | functest | 12:01 | PASS | +-------------------+------------------+------------------+----------------+ 2018-04-18 10:00:06,041 - xtesting.ci.run_tests - INFO - Running test case 'snaps_health_check'... 2018-04-18 10:00:07,069 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata '{u'hw:mem_page_size': u'large'}' 2018-04-18 10:00:52,970 - xtesting.core.unit - DEBUG - test_check_vm_ip_dhcp (snaps.openstack.tests.create_instance_tests.SimpleHealthCheck) ... ok ---------------------------------------------------------------------- Ran 1 test in 45.900s OK 2018-04-18 10:00:53,099 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-18 10:00:53,100 - xtesting.ci.run_tests - INFO - Test result: +----------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +----------------------------+------------------+------------------+----------------+ | snaps_health_check | functest | 00:46 | PASS | +----------------------------+------------------+------------------+----------------+ 2018-04-18 10:00:53,105 - xtesting.ci.run_tests - INFO - Xtesting report: +----------------------------+------------------+---------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +----------------------------+------------------+---------------------+------------------+----------------+ | connection_check | functest | healthcheck | 00:09 | PASS | | api_check | functest | healthcheck | 12:01 | PASS | | snaps_health_check | functest | healthcheck | 00:46 | PASS | +----------------------------+------------------+---------------------+------------------+----------------+ 2018-04-18 10:00:53,108 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK 2018-04-18 10:01:54,984 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-fuel-baremetal-daily-master-121 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | fuel | | DEPLOY_SCENARIO | os-nosdn-ovs-ha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod2 | +--------------------------------------+----------------------------------------------------------+ 2018-04-18 10:01:54,987 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file export OS_IDENTITY_API_VERSION=3 export OS_PROJECT_DOMAIN_NAME=Default export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_NAME=admin export OS_TENANT_NAME=admin export OS_USERNAME=admin export OS_PASSWORD=opnfv_secret export OS_REGION_NAME=RegionOne export OS_INTERFACE=internal export OS_ENDPOINT_TYPE="internal" export OS_CACERT="/etc/ssl/certs/mcp_os_cacert" export VOLUME_DEVICE_NAME=vdc export OS_AUTH_URL=http://10.167.4.35:35357/v3 2018-04-18 10:01:54,987 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-04-18 10:01:54,988 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------+---------------+--------------------------+------------------------------------------+-------------------------------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------+---------------+--------------------------+------------------------------------------+-------------------------------------------+ | smoke | 1 | (daily)|(weekly) | Set of basic Functional tests to | vping_ssh vping_userdata | | | | | validate the OPNFV scenarios. | tempest_smoke_serial rally_sanity | | | | | | patrole snaps_smoke neutron_trunk | +---------------+---------------+--------------------------+------------------------------------------+-------------------------------------------+ 2018-04-18 10:01:54,989 - xtesting.ci.run_tests - INFO - Running tier 'smoke' 2018-04-18 10:01:54,989 - xtesting.ci.run_tests - INFO - Running test case 'vping_ssh'... 2018-04-18 10:01:55,950 - xtesting.energy.energy - INFO - API recorder available at : http://energy.opnfv.fr/resources/recorders/environment/lf-pod2 2018-04-18 10:01:55,950 - xtesting.energy.energy - DEBUG - Getting current scenario 2018-04-18 10:01:56,360 - xtesting.energy.energy - DEBUG - Starting recording 2018-04-18 10:01:56,360 - xtesting.energy.energy - DEBUG - Submitting scenario (vping_ssh/running) 2018-04-18 10:01:56,726 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin virtual environment setup 2018-04-18 10:01:56,726 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing Start Time:'2018-04-18 10:01:56' 2018-04-18 10:01:56,726 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating image with name: 'functest-vping--80a14b25-8704-4cd2-a66b-d125cd4a9803' 2018-04-18 10:01:58,700 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating network with name: 'vping-net-80a14b25-8704-4cd2-a66b-d125cd4a9803' 2018-04-18 10:02:02,306 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating router with name: 'vping-router-80a14b25-8704-4cd2-a66b-d125cd4a9803' 2018-04-18 10:02:14,392 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating flavor with name: 'vping-flavor-80a14b25-8704-4cd2-a66b-d125cd4a9803' 2018-04-18 10:02:15,379 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating keypair with name: 'vPing-keypair-80a14b25-8704-4cd2-a66b-d125cd4a9803' 2018-04-18 10:02:16,146 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 1 instance with name: 'opnfv-vping-1-80a14b25-8704-4cd2-a66b-d125cd4a9803' 2018-04-18 10:02:22,113 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Security group with name: 'vPing-sg-80a14b25-8704-4cd2-a66b-d125cd4a9803' 2018-04-18 10:02:25,291 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 2 instance with name: 'opnfv-vping-2-80a14b25-8704-4cd2-a66b-d125cd4a9803' 2018-04-18 10:02:45,746 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin test execution 2018-04-18 10:02:53,337 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Trying to transfer ping.sh 2018-04-18 10:02:53,475 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Waiting for ping... 2018-04-18 10:02:54,482 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing detected! 2018-04-18 10:02:54,482 - xtesting.energy.energy - DEBUG - Restoring previous scenario (default/default) 2018-04-18 10:02:54,482 - xtesting.energy.energy - DEBUG - Submitting scenario (default/default) 2018-04-18 10:02:54,977 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-18 10:02:54,977 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | vping_ssh | functest | 00:58 | PASS | +-------------------+------------------+------------------+----------------+ 2018-04-18 10:03:17,505 - xtesting.ci.run_tests - INFO - Running test case 'vping_userdata'... 2018-04-18 10:03:17,609 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin virtual environment setup 2018-04-18 10:03:17,609 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing Start Time:'2018-04-18 10:03:17' 2018-04-18 10:03:17,609 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating image with name: 'functest-vping--965f14f8-ce2a-4fef-9714-3a7c87b67da8' 2018-04-18 10:03:19,413 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating network with name: 'vping-net-965f14f8-ce2a-4fef-9714-3a7c87b67da8' 2018-04-18 10:03:22,085 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating router with name: 'vping-router-965f14f8-ce2a-4fef-9714-3a7c87b67da8' 2018-04-18 10:03:34,765 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating flavor with name: 'vping-flavor-965f14f8-ce2a-4fef-9714-3a7c87b67da8' 2018-04-18 10:03:35,588 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 1 instance with name: 'opnfv-vping-1-965f14f8-ce2a-4fef-9714-3a7c87b67da8' 2018-04-18 10:03:42,233 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 2 instance with name: 'opnfv-vping-2-965f14f8-ce2a-4fef-9714-3a7c87b67da8' 2018-04-18 10:03:48,102 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin test execution 2018-04-18 10:03:57,982 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Waiting for ping... 2018-04-18 10:04:00,039 - functest.opnfv_tests.openstack.vping.vping_base - DEBUG - Pinging 192.168.130.13. Waiting for response... 2018-04-18 10:04:11,742 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing detected! 2018-04-18 10:04:11,858 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-18 10:04:11,859 - xtesting.ci.run_tests - INFO - Test result: +------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +------------------------+------------------+------------------+----------------+ | vping_userdata | functest | 00:54 | PASS | +------------------------+------------------+------------------+----------------+ 2018-04-18 10:04:32,044 - xtesting.ci.run_tests - INFO - Running test case 'tempest_smoke_serial'... 2018-04-18 10:04:32,143 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-04-18 10:04:39,193 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | 25f73a7d-508a-4dc4-aa7d-613db1b6d096 | 2018-04-18T10:04:38.428251 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 25f73a7d-508a-4dc4-aa7d-613db1b6d096 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-04-18 10:04:43,193 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | artifact | Available | | __unknown__ | compute_legacy | Available | | __unknown__ | placement | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | designate | dns | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+----------------+-----------+ 2018-04-18 10:04:43,193 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-04-18 10:04:50,770 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide Using verifier 'opnfv-tempest' (UUID=6e9a19ca-0dcb-437d-b3e6-380287ba5a27) as the default verifier for the future CLI operations. 2018-04-18 10:04:54,318 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-04-18 10:04:56,699 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating two images for Tempest suite 2018-04-18 10:05:00,602 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-04-18 10:05:07,087 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-04-18 10:05:07,087 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-04-18 10:05:07,088 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-04-18 10:05:07,092 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-04-18 10:05:07,097 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Generating test case list... 2018-04-18 10:05:10,373 - functest.opnfv_tests.openstack.tempest.tempest - INFO - (cd /root/.rally/verification/verifier-6e9a19ca-0dcb-437d-b3e6-380287ba5a27/repo; stestr list '^tempest\.(api|scenario).*\[.*\bsmoke\b.*\]$' >/home/opnfv/functest/results/tempest/test_list.txt 2>/dev/null) 2018-04-18 10:05:10,374 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Applying tempest blacklist... 2018-04-18 10:05:10,377 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Tempest blacklist file does not exist. 2018-04-18 10:05:10,377 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', u'/home/opnfv/functest/results/tempest/test_list.txt', '--concurrency', '1']'. 2018-04-18 10:25:30,991 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Verification UUID: 37604002-4921-42bb-b72f-e1bf63a8f660 2018-04-18 10:25:31,293 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', '37604002-4921-42bb-b72f-e1bf63a8f660']'. 2018-04-18 10:25:32,420 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2018-04-18 10:25:32,421 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2018-04-18 10:25:32,421 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-04-18 10:25:32,421 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | 37604002-4921-42bb-b72f-e1bf63a8f660 | 2018-04-18 10:25:32,421 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | failed | 2018-04-18 10:25:32,421 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2018-04-18 10:05:13 | 2018-04-18 10:25:32,421 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2018-04-18 10:25:30 | 2018-04-18 10:25:32,421 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 0:20:17 | 2018-04-18 10:25:32,421 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | concurrency: 1 | 2018-04-18 10:25:32,421 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | | load_list: (value is too long, use 'detailed' flag to display it) | 2018-04-18 10:25:32,422 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2018-04-18 10:25:32,422 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: 6e9a19ca-0dcb-437d-b3e6-380287ba5a27) | 2018-04-18 10:25:32,422 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2018-04-18 10:25:32,422 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: 25f73a7d-508a-4dc4-aa7d-613db1b6d096) | 2018-04-18 10:25:32,422 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 109 | 2018-04-18 10:25:32,422 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 1184.233 | 2018-04-18 10:25:32,422 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 89 | 2018-04-18 10:25:32,422 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 19 | 2018-04-18 10:25:32,422 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2018-04-18 10:25:32,422 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2018-04-18 10:25:32,423 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 1 | 2018-04-18 10:25:32,423 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-04-18 10:25:32,423 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------------------------------------------------------------------+ 2018-04-18 10:25:32,426 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest tempest_smoke_serial success_rate is 98.8888888889% 2018-04-18 10:25:38,101 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-18 10:25:38,101 - xtesting.ci.run_tests - INFO - Test result: +------------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +------------------------------+------------------+------------------+----------------+ | tempest_smoke_serial | functest | 20:44 | FAIL | +------------------------------+------------------+------------------+----------------+ 2018-04-18 10:25:38,108 - xtesting.ci.run_tests - ERROR - The test case 'tempest_smoke_serial' failed. 2018-04-18 10:25:38,108 - xtesting.ci.run_tests - INFO - Running test case 'rally_sanity'... 2018-04-18 10:25:38,213 - xtesting.energy.energy - DEBUG - Getting current scenario 2018-04-18 10:25:38,638 - xtesting.energy.energy - DEBUG - Starting recording 2018-04-18 10:25:38,638 - xtesting.energy.energy - DEBUG - Submitting scenario (rally_sanity/running) 2018-04-18 10:25:39,091 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-04-18 10:25:42,661 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-04-18 10:25:46,164 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | 067a9b77-67eb-4edc-9521-22ca7faec26d | 2018-04-18T10:25:45.278406 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 067a9b77-67eb-4edc-9521-22ca7faec26d ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-04-18 10:25:50,339 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | artifact | Available | | __unknown__ | compute_legacy | Available | | __unknown__ | placement | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | designate | dns | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+----------------+-----------+ 2018-04-18 10:25:50,340 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating the test name... 2018-04-18 10:25:52,110 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating image 'Cirros-0.4.0-78df643c-d18f-49fd-aa89-3cb1e2e27d2f'... 2018-04-18 10:25:54,004 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating network 'rally-net-78df643c-d18f-49fd-aa89-3cb1e2e27d2f'... 2018-04-18 10:25:56,687 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating router 'rally-router-78df643c-d18f-49fd-aa89-3cb1e2e27d2f'... 2018-04-18 10:26:07,936 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating flavor 'rally-tiny-78df643c-d18f-49fd-aa89-3cb1e2e27d2f'... 2018-04-18 10:26:08,828 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating flavor 'rally-mini-78df643c-d18f-49fd-aa89-3cb1e2e27d2f'... 2018-04-18 10:26:09,716 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2018-04-18 10:26:09,717 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-authenticate.yaml 2018-04-18 10:26:09,717 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-18 10:26:09,738 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-04-18 10:26:09,739 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'floating_net', 'service_list': ['authenticate'], 'concurrency': 4, 'netid': '06bf5493-cfab-4628-bac5-8edcc2d703c6', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-78df643c-d18f-49fd-aa89-3cb1e2e27d2f', 'flavor_name': 'rally-tiny-78df643c-d18f-49fd-aa89-3cb1e2e27d2f', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-78df643c-d18f-49fd-aa89-3cb1e2e27d2f', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-18 10:27:18,652 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 025b6107-dcdd-4437-8d7a-7d0565db9a09 2018-04-18 10:27:18,653 - functest.opnfv_tests.openstack.rally.rally - DEBUG - /home/opnfv/functest/results/rally does not exist, we create it. 2018-04-18 10:27:18,654 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '025b6107-dcdd-4437-8d7a-7d0565db9a09'] 2018-04-18 10:27:19,772 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 025b6107-dcdd-4437-8d7a-7d0565db9a09: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 025b6107-dcdd-4437-8d7a-7d0565db9a09 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 0.641 | 0.641 | 0.641 | 0.641 | 0.641 | 0.641 | 100.0% | 1 | | total | 0.642 | 0.642 | 0.642 | 0.642 | 0.642 | 0.642 | 100.0% | 1 | | -> duration | 0.642 | 0.642 | 0.642 | 0.642 | 0.642 | 0.642 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.641531 Full duration: 7.901864 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 025b6107-dcdd-4437-8d7a-7d0565db9a09 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.665 | 0.665 | 0.665 | 0.665 | 0.665 | 0.665 | 100.0% | 1 | | total | 1.319 | 1.319 | 1.319 | 1.319 | 1.319 | 1.319 | 100.0% | 1 | | -> duration | 1.319 | 1.319 | 1.319 | 1.319 | 1.319 | 1.319 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.318619 Full duration: 8.043653 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 025b6107-dcdd-4437-8d7a-7d0565db9a09 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.582 | 0.582 | 0.582 | 0.582 | 0.582 | 0.582 | 100.0% | 1 | | total | 1.333 | 1.333 | 1.333 | 1.333 | 1.333 | 1.333 | 100.0% | 1 | | -> duration | 1.333 | 1.333 | 1.333 | 1.333 | 1.333 | 1.333 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.333369 Full duration: 8.272476 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 025b6107-dcdd-4437-8d7a-7d0565db9a09 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.409 | 0.409 | 0.409 | 0.409 | 0.409 | 0.409 | 100.0% | 1 | | total | 1.085 | 1.085 | 1.085 | 1.085 | 1.085 | 1.085 | 100.0% | 1 | | -> duration | 1.085 | 1.085 | 1.085 | 1.085 | 1.085 | 1.085 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.085495 Full duration: 8.175992 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 025b6107-dcdd-4437-8d7a-7d0565db9a09 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.882 | 0.882 | 0.882 | 0.882 | 0.882 | 0.882 | 100.0% | 1 | | total | 1.512 | 1.512 | 1.512 | 1.512 | 1.512 | 1.512 | 100.0% | 1 | | -> duration | 1.512 | 1.512 | 1.512 | 1.512 | 1.512 | 1.512 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.512434 Full duration: 8.167643 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 025b6107-dcdd-4437-8d7a-7d0565db9a09 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.336 | 0.336 | 0.336 | 0.336 | 0.336 | 0.336 | 100.0% | 1 | | total | 0.98 | 0.98 | 0.98 | 0.98 | 0.98 | 0.98 | 100.0% | 1 | | -> duration | 0.98 | 0.98 | 0.98 | 0.98 | 0.98 | 0.98 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.980288 Full duration: 7.782922 HINTS: * To plot HTML graphics with this data, run: rally task report 025b6107-dcdd-4437-8d7a-7d0565db9a09 --out output.html * To generate a JUnit report, run: rally task export 025b6107-dcdd-4437-8d7a-7d0565db9a09 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 025b6107-dcdd-4437-8d7a-7d0565db9a09 --json --out output.json 2018-04-18 10:27:19,773 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '025b6107-dcdd-4437-8d7a-7d0565db9a09'] 2018-04-18 10:27:20,892 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-18 10:27:20,893 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '025b6107-dcdd-4437-8d7a-7d0565db9a09', '--out', u'/home/opnfv/functest/results/rally/opnfv-authenticate.html'] 2018-04-18 10:27:20,906 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2018-04-18 10:27:20,907 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2018-04-18 10:27:20,908 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-glance.yaml 2018-04-18 10:27:20,908 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-18 10:27:20,924 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-04-18 10:27:20,925 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'floating_net', 'service_list': ['glance'], 'concurrency': 4, 'netid': '06bf5493-cfab-4628-bac5-8edcc2d703c6', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-78df643c-d18f-49fd-aa89-3cb1e2e27d2f', 'flavor_name': 'rally-tiny-78df643c-d18f-49fd-aa89-3cb1e2e27d2f', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-78df643c-d18f-49fd-aa89-3cb1e2e27d2f', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-18 10:28:58,149 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 09616c84-0850-48ba-9ed9-0e96885b91ca 2018-04-18 10:28:58,149 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '09616c84-0850-48ba-9ed9-0e96885b91ca'] 2018-04-18 10:28:59,300 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 09616c84-0850-48ba-9ed9-0e96885b91ca: finished -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 09616c84-0850-48ba-9ed9-0e96885b91ca has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 3.215 | 3.215 | 3.215 | 3.215 | 3.215 | 3.215 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.349 | 0.349 | 0.349 | 0.349 | 0.349 | 0.349 | 100.0% | 1 | | -> glance_v2.upload_data | 0.39 | 0.39 | 0.39 | 0.39 | 0.39 | 0.39 | 100.0% | 1 | | glance_v2.delete_image | 0.226 | 0.226 | 0.226 | 0.226 | 0.226 | 0.226 | 100.0% | 1 | | total | 3.441 | 3.441 | 3.441 | 3.441 | 3.441 | 3.441 | 100.0% | 1 | | -> duration | 3.441 | 3.441 | 3.441 | 3.441 | 3.441 | 3.441 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.440591 Full duration: 12.105118 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 09616c84-0850-48ba-9ed9-0e96885b91ca has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 3.178 | 3.178 | 3.178 | 3.178 | 3.178 | 3.178 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.321 | 0.321 | 0.321 | 0.321 | 0.321 | 0.321 | 100.0% | 1 | | -> glance_v2.upload_data | 0.374 | 0.374 | 0.374 | 0.374 | 0.374 | 0.374 | 100.0% | 1 | | glance_v2.list_images | 0.155 | 0.155 | 0.155 | 0.155 | 0.155 | 0.155 | 100.0% | 1 | | total | 3.334 | 3.334 | 3.334 | 3.334 | 3.334 | 3.334 | 100.0% | 1 | | -> duration | 3.334 | 3.334 | 3.334 | 3.334 | 3.334 | 3.334 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.333922 Full duration: 13.855646 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 09616c84-0850-48ba-9ed9-0e96885b91ca has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.385 | 0.385 | 0.385 | 0.385 | 0.385 | 0.385 | 100.0% | 1 | | total | 0.386 | 0.386 | 0.386 | 0.386 | 0.386 | 0.386 | 100.0% | 1 | | -> duration | 0.386 | 0.386 | 0.386 | 0.386 | 0.386 | 0.386 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.385628 Full duration: 8.360026 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "cores": -1, "security_groups": -1 } } }, "args": { "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "container_format": "bare", "disk_format": "qcow2", "number_instances": 2, "nics": [ { "net-id": "06bf5493-cfab-4628-bac5-8edcc2d703c6" } ], "flavor": { "name": "rally-tiny-78df643c-d18f-49fd-aa89-3cb1e2e27d2f" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 09616c84-0850-48ba-9ed9-0e96885b91ca has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 3.266 | 3.266 | 3.266 | 3.266 | 3.266 | 3.266 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.471 | 0.471 | 0.471 | 0.471 | 0.471 | 0.471 | 100.0% | 1 | | -> glance_v2.upload_data | 0.384 | 0.384 | 0.384 | 0.384 | 0.384 | 0.384 | 100.0% | 1 | | nova.boot_servers | 15.424 | 15.424 | 15.424 | 15.424 | 15.424 | 15.424 | 100.0% | 1 | | total | 18.691 | 18.691 | 18.691 | 18.691 | 18.691 | 18.691 | 100.0% | 1 | | -> duration | 17.691 | 17.691 | 17.691 | 17.691 | 17.691 | 17.691 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 17.691485 Full duration: 42.954703 HINTS: * To plot HTML graphics with this data, run: rally task report 09616c84-0850-48ba-9ed9-0e96885b91ca --out output.html * To generate a JUnit report, run: rally task export 09616c84-0850-48ba-9ed9-0e96885b91ca --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 09616c84-0850-48ba-9ed9-0e96885b91ca --json --out output.json 2018-04-18 10:28:59,301 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '09616c84-0850-48ba-9ed9-0e96885b91ca'] 2018-04-18 10:29:00,489 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-18 10:29:00,490 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '09616c84-0850-48ba-9ed9-0e96885b91ca', '--out', u'/home/opnfv/functest/results/rally/opnfv-glance.html'] 2018-04-18 10:29:00,504 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" OK. 2018-04-18 10:29:00,505 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2018-04-18 10:29:00,505 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-cinder.yaml 2018-04-18 10:29:00,505 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-18 10:29:00,524 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-04-18 10:29:00,525 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'floating_net', 'service_list': ['cinder'], 'concurrency': 4, 'netid': '06bf5493-cfab-4628-bac5-8edcc2d703c6', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-78df643c-d18f-49fd-aa89-3cb1e2e27d2f', 'flavor_name': 'rally-tiny-78df643c-d18f-49fd-aa89-3cb1e2e27d2f', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-78df643c-d18f-49fd-aa89-3cb1e2e27d2f', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-18 10:34:08,769 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 8a3f9bf9-f1be-4ace-821e-010c95162700 2018-04-18 10:34:08,770 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '8a3f9bf9-f1be-4ace-821e-010c95162700'] 2018-04-18 10:34:09,910 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 8a3f9bf9-f1be-4ace-821e-010c95162700: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "volumes": { "volumes_per_tenant": 1, "size": 1 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "force": false }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8a3f9bf9-f1be-4ace-821e-010c95162700 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_snapshot | 3.432 | 3.432 | 3.432 | 3.432 | 3.432 | 3.432 | 100.0% | 1 | | cinder_v2.delete_snapshot | 10.592 | 10.592 | 10.592 | 10.592 | 10.592 | 10.592 | 100.0% | 1 | | total | 14.025 | 14.025 | 14.025 | 14.025 | 14.025 | 14.025 | 100.0% | 1 | | -> duration | 14.025 | 14.025 | 14.025 | 14.025 | 14.025 | 14.025 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 14.024611 Full duration: 41.964694 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "size": { "max": 1, "min": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8a3f9bf9-f1be-4ace-821e-010c95162700 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.379 | 3.379 | 3.379 | 3.379 | 3.379 | 3.379 | 100.0% | 1 | | cinder_v2.delete_volume | 10.807 | 10.807 | 10.807 | 10.807 | 10.807 | 10.807 | 100.0% | 1 | | total | 14.187 | 14.187 | 14.187 | 14.187 | 14.187 | 14.187 | 100.0% | 1 | | -> duration | 14.187 | 14.187 | 14.187 | 14.187 | 14.187 | 14.187 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 14.186935 Full duration: 24.753109 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "image": { "name": "Cirros-0.4.0-78df643c-d18f-49fd-aa89-3cb1e2e27d2f" }, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8a3f9bf9-f1be-4ace-821e-010c95162700 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 5.956 | 5.956 | 5.956 | 5.956 | 5.956 | 5.956 | 100.0% | 1 | | cinder_v2.delete_volume | 10.799 | 10.799 | 10.799 | 10.799 | 10.799 | 10.799 | 100.0% | 1 | | total | 16.755 | 16.755 | 16.755 | 16.755 | 16.755 | 16.755 | 100.0% | 1 | | -> duration | 16.755 | 16.755 | 16.755 | 16.755 | 16.755 | 16.755 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 16.754855 Full duration: 28.544983 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8a3f9bf9-f1be-4ace-821e-010c95162700 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.415 | 3.415 | 3.415 | 3.415 | 3.415 | 3.415 | 100.0% | 1 | | cinder_v2.delete_volume | 10.821 | 10.821 | 10.821 | 10.821 | 10.821 | 10.821 | 100.0% | 1 | | total | 14.237 | 14.237 | 14.237 | 14.237 | 14.237 | 14.237 | 100.0% | 1 | | -> duration | 14.237 | 14.237 | 14.237 | 14.237 | 14.237 | 14.237 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 14.237301 Full duration: 24.133592 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "new_size": 2, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8a3f9bf9-f1be-4ace-821e-010c95162700 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.483 | 3.483 | 3.483 | 3.483 | 3.483 | 3.483 | 100.0% | 1 | | cinder_v2.extend_volume | 2.443 | 2.443 | 2.443 | 2.443 | 2.443 | 2.443 | 100.0% | 1 | | cinder_v2.delete_volume | 19.317 | 19.317 | 19.317 | 19.317 | 19.317 | 19.317 | 100.0% | 1 | | total | 25.244 | 25.244 | 25.244 | 25.244 | 25.244 | 25.244 | 100.0% | 1 | | -> duration | 25.244 | 25.244 | 25.244 | 25.244 | 25.244 | 25.244 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 25.244459 Full duration: 36.260388 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "volumes": { "volumes_per_tenant": 1, "size": 1 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8a3f9bf9-f1be-4ace-821e-010c95162700 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 26.914 | 26.914 | 26.914 | 26.914 | 26.914 | 26.914 | 100.0% | 1 | | cinder_v2.delete_volume | 10.839 | 10.839 | 10.839 | 10.839 | 10.839 | 10.839 | 100.0% | 1 | | total | 37.755 | 37.755 | 37.755 | 37.755 | 37.755 | 37.755 | 100.0% | 1 | | -> duration | 37.755 | 37.755 | 37.755 | 37.755 | 37.755 | 37.755 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 37.754925 Full duration: 64.455858 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "write_iops_sec": "10", "consumer": "both", "read_iops_sec": "1000" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8a3f9bf9-f1be-4ace-821e-010c95162700 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_qos | 0.744 | 0.744 | 0.744 | 0.744 | 0.744 | 0.744 | 100.0% | 1 | | cinder_v2.list_qos | 0.051 | 0.051 | 0.051 | 0.051 | 0.051 | 0.051 | 100.0% | 1 | | total | 0.795 | 0.795 | 0.795 | 0.795 | 0.795 | 0.795 | 100.0% | 1 | | -> duration | 0.795 | 0.795 | 0.795 | 0.795 | 0.795 | 0.795 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.795456 Full duration: 12.87397 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "set_read_iops_sec": "1001", "set_consumer": "both", "read_iops_sec": "1000", "set_write_iops_sec": "11", "write_iops_sec": "10", "consumer": "back-end" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8a3f9bf9-f1be-4ace-821e-010c95162700 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_qos | 0.705 | 0.705 | 0.705 | 0.705 | 0.705 | 0.705 | 100.0% | 1 | | cinder_v2.set_qos | 0.079 | 0.079 | 0.079 | 0.079 | 0.079 | 0.079 | 100.0% | 1 | | total | 0.785 | 0.785 | 0.785 | 0.785 | 0.785 | 0.785 | 100.0% | 1 | | -> duration | 0.785 | 0.785 | 0.785 | 0.785 | 0.785 | 0.785 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.785026 Full duration: 13.05761 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "description": "rally tests creating types" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8a3f9bf9-f1be-4ace-821e-010c95162700 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.81 | 0.81 | 0.81 | 0.81 | 0.81 | 0.81 | 100.0% | 1 | | cinder_v2.list_types | 0.072 | 0.072 | 0.072 | 0.072 | 0.072 | 0.072 | 100.0% | 1 | | total | 0.883 | 0.883 | 0.883 | 0.883 | 0.883 | 0.883 | 100.0% | 1 | | -> duration | 0.883 | 0.883 | 0.883 | 0.883 | 0.883 | 0.883 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.882962 Full duration: 12.182792 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "control_location": "front-end", "cipher": "aes-xts-plain64", "description": "rally tests creating types", "key_size": 512, "provider": "LuksEncryptor" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8a3f9bf9-f1be-4ace-821e-010c95162700 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.776 | 0.776 | 0.776 | 0.776 | 0.776 | 0.776 | 100.0% | 1 | | cinder_v2.create_encryption_type | 0.1 | 0.1 | 0.1 | 0.1 | 0.1 | 0.1 | 100.0% | 1 | | total | 0.877 | 0.877 | 0.877 | 0.877 | 0.877 | 0.877 | 100.0% | 1 | | -> duration | 0.877 | 0.877 | 0.877 | 0.877 | 0.877 | 0.877 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.876508 Full duration: 12.883108 HINTS: * To plot HTML graphics with this data, run: rally task report 8a3f9bf9-f1be-4ace-821e-010c95162700 --out output.html * To generate a JUnit report, run: rally task export 8a3f9bf9-f1be-4ace-821e-010c95162700 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 8a3f9bf9-f1be-4ace-821e-010c95162700 --json --out output.json 2018-04-18 10:34:09,911 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '8a3f9bf9-f1be-4ace-821e-010c95162700'] 2018-04-18 10:34:11,120 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-18 10:34:11,120 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '8a3f9bf9-f1be-4ace-821e-010c95162700', '--out', u'/home/opnfv/functest/results/rally/opnfv-cinder.html'] 2018-04-18 10:34:11,136 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2018-04-18 10:34:11,136 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2018-04-18 10:34:11,137 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-heat.yaml 2018-04-18 10:34:11,137 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-18 10:34:11,162 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-04-18 10:34:11,162 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'floating_net', 'service_list': ['heat'], 'concurrency': 4, 'netid': '06bf5493-cfab-4628-bac5-8edcc2d703c6', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-78df643c-d18f-49fd-aa89-3cb1e2e27d2f', 'flavor_name': 'rally-tiny-78df643c-d18f-49fd-aa89-3cb1e2e27d2f', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-78df643c-d18f-49fd-aa89-3cb1e2e27d2f', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-18 10:35:59,727 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 6e119c28-4563-41f1-8c50-2f9a95fef914 2018-04-18 10:35:59,728 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '6e119c28-4563-41f1-8c50-2f9a95fef914'] 2018-04-18 10:36:00,781 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 6e119c28-4563-41f1-8c50-2f9a95fef914: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6e119c28-4563-41f1-8c50-2f9a95fef914 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 5.074 | 5.074 | 5.074 | 5.074 | 5.074 | 5.074 | 100.0% | 1 | | heat.update_stack | 2.659 | 2.659 | 2.659 | 2.659 | 2.659 | 2.659 | 100.0% | 1 | | heat.delete_stack | 2.723 | 2.723 | 2.723 | 2.723 | 2.723 | 2.723 | 100.0% | 1 | | total | 10.457 | 10.457 | 10.457 | 10.457 | 10.457 | 10.457 | 100.0% | 1 | | -> duration | 6.457 | 6.457 | 6.457 | 6.457 | 6.457 | 6.457 | 100.0% | 1 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.456757 Full duration: 22.964091 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6e119c28-4563-41f1-8c50-2f9a95fef914 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 4.763 | 4.763 | 4.763 | 4.763 | 4.763 | 4.763 | 100.0% | 1 | | heat.check_stack | 1.699 | 1.699 | 1.699 | 1.699 | 1.699 | 1.699 | 100.0% | 1 | | heat.delete_stack | 2.444 | 2.444 | 2.444 | 2.444 | 2.444 | 2.444 | 100.0% | 1 | | total | 8.906 | 8.906 | 8.906 | 8.906 | 8.906 | 8.906 | 100.0% | 1 | | -> duration | 6.906 | 6.906 | 6.906 | 6.906 | 6.906 | 6.906 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.90627 Full duration: 20.572345 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6e119c28-4563-41f1-8c50-2f9a95fef914 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 4.95 | 4.95 | 4.95 | 4.95 | 4.95 | 4.95 | 100.0% | 1 | | heat.suspend_stack | 0.574 | 0.574 | 0.574 | 0.574 | 0.574 | 0.574 | 100.0% | 1 | | heat.resume_stack | 1.606 | 1.606 | 1.606 | 1.606 | 1.606 | 1.606 | 100.0% | 1 | | heat.delete_stack | 2.554 | 2.554 | 2.554 | 2.554 | 2.554 | 2.554 | 100.0% | 1 | | total | 9.684 | 9.684 | 9.684 | 9.684 | 9.684 | 9.684 | 100.0% | 1 | | -> duration | 7.684 | 7.684 | 7.684 | 7.684 | 7.684 | 7.684 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.683796 Full duration: 21.632757 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "roles": [ "heat_stack_owner" ] }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6e119c28-4563-41f1-8c50-2f9a95fef914 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 0.832 | 0.832 | 0.832 | 0.832 | 0.832 | 0.832 | 100.0% | 1 | | total | 0.832 | 0.832 | 0.832 | 0.832 | 0.832 | 0.832 | 100.0% | 1 | | -> duration | 0.832 | 0.832 | 0.832 | 0.832 | 0.832 | 0.832 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.832222 Full duration: 11.844953 HINTS: * To plot HTML graphics with this data, run: rally task report 6e119c28-4563-41f1-8c50-2f9a95fef914 --out output.html * To generate a JUnit report, run: rally task export 6e119c28-4563-41f1-8c50-2f9a95fef914 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 6e119c28-4563-41f1-8c50-2f9a95fef914 --json --out output.json 2018-04-18 10:36:00,782 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '6e119c28-4563-41f1-8c50-2f9a95fef914'] 2018-04-18 10:36:01,865 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-18 10:36:01,865 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '6e119c28-4563-41f1-8c50-2f9a95fef914', '--out', u'/home/opnfv/functest/results/rally/opnfv-heat.html'] 2018-04-18 10:36:01,879 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2018-04-18 10:36:01,879 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2018-04-18 10:36:01,880 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-keystone.yaml 2018-04-18 10:36:01,880 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-18 10:36:01,896 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-04-18 10:36:01,897 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'floating_net', 'service_list': ['keystone'], 'concurrency': 4, 'netid': '06bf5493-cfab-4628-bac5-8edcc2d703c6', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-78df643c-d18f-49fd-aa89-3cb1e2e27d2f', 'flavor_name': 'rally-tiny-78df643c-d18f-49fd-aa89-3cb1e2e27d2f', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-78df643c-d18f-49fd-aa89-3cb1e2e27d2f', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-18 10:39:21,003 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 5f86e474-e51f-4829-b681-bdaf3cd37562 2018-04-18 10:39:21,004 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '5f86e474-e51f-4829-b681-bdaf3cd37562'] 2018-04-18 10:39:22,146 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 5f86e474-e51f-4829-b681-bdaf3cd37562: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5f86e474-e51f-4829-b681-bdaf3cd37562 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.526 | 0.526 | 0.526 | 0.526 | 0.526 | 0.526 | 100.0% | 1 | | keystone_v3.add_role | 0.063 | 0.063 | 0.063 | 0.063 | 0.063 | 0.063 | 100.0% | 1 | | keystone_v3.revoke_role | 0.075 | 0.075 | 0.075 | 0.075 | 0.075 | 0.075 | 100.0% | 1 | | total | 0.664 | 0.664 | 0.664 | 0.664 | 0.664 | 0.664 | 100.0% | 1 | | -> duration | 0.664 | 0.664 | 0.664 | 0.664 | 0.664 | 0.664 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.664351 Full duration: 15.34216 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5f86e474-e51f-4829-b681-bdaf3cd37562 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.468 | 0.468 | 0.468 | 0.468 | 0.468 | 0.468 | 100.0% | 1 | | keystone_v3.add_role | 0.064 | 0.064 | 0.064 | 0.064 | 0.064 | 0.064 | 100.0% | 1 | | keystone_v3.list_roles | 0.055 | 0.055 | 0.055 | 0.055 | 0.055 | 0.055 | 100.0% | 1 | | total | 0.587 | 0.587 | 0.587 | 0.587 | 0.587 | 0.587 | 100.0% | 1 | | -> duration | 0.587 | 0.587 | 0.587 | 0.587 | 0.587 | 0.587 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.58687 Full duration: 15.099252 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5f86e474-e51f-4829-b681-bdaf3cd37562 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.602 | 0.602 | 0.602 | 0.602 | 0.602 | 0.602 | 100.0% | 1 | | keystone_v3.list_projects | 0.044 | 0.044 | 0.044 | 0.044 | 0.044 | 0.044 | 100.0% | 1 | | total | 0.646 | 0.646 | 0.646 | 0.646 | 0.646 | 0.646 | 100.0% | 1 | | -> duration | 0.646 | 0.646 | 0.646 | 0.646 | 0.646 | 0.646 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.645873 Full duration: 14.944957 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5f86e474-e51f-4829-b681-bdaf3cd37562 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.457 | 0.457 | 0.457 | 0.457 | 0.457 | 0.457 | 100.0% | 1 | | keystone_v3.delete_role | 0.065 | 0.065 | 0.065 | 0.065 | 0.065 | 0.065 | 100.0% | 1 | | total | 0.523 | 0.523 | 0.523 | 0.523 | 0.523 | 0.523 | 100.0% | 1 | | -> duration | 0.523 | 0.523 | 0.523 | 0.523 | 0.523 | 0.523 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.522617 Full duration: 12.91516 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5f86e474-e51f-4829-b681-bdaf3cd37562 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.503 | 0.503 | 0.503 | 0.503 | 0.503 | 0.503 | 100.0% | 1 | | keystone_v3.delete_service | 0.101 | 0.101 | 0.101 | 0.101 | 0.101 | 0.101 | 100.0% | 1 | | total | 0.604 | 0.604 | 0.604 | 0.604 | 0.604 | 0.604 | 100.0% | 1 | | -> duration | 0.604 | 0.604 | 0.604 | 0.604 | 0.604 | 0.604 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.604292 Full duration: 12.847512 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5f86e474-e51f-4829-b681-bdaf3cd37562 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.596 | 0.596 | 0.596 | 0.596 | 0.596 | 0.596 | 100.0% | 1 | | keystone_v3.create_user | 0.288 | 0.288 | 0.288 | 0.288 | 0.288 | 0.288 | 100.0% | 1 | | -> keystone_v3.list_roles | 0.04 | 0.04 | 0.04 | 0.04 | 0.04 | 0.04 | 100.0% | 1 | | -> keystone_v3.add_role | 0.108 | 0.108 | 0.108 | 0.108 | 0.108 | 0.108 | 100.0% | 1 | | keystone_v3.create_role | 0.056 | 0.056 | 0.056 | 0.056 | 0.056 | 0.056 | 100.0% | 1 | | keystone_v3.get_project | 0.04 | 0.04 | 0.04 | 0.04 | 0.04 | 0.04 | 100.0% | 1 | | keystone_v3.get_user | 0.052 | 0.052 | 0.052 | 0.052 | 0.052 | 0.052 | 100.0% | 1 | | keystone_v3.get_role | 0.039 | 0.039 | 0.039 | 0.039 | 0.039 | 0.039 | 100.0% | 1 | | keystone_v3.list_services | 0.041 | 0.041 | 0.041 | 0.041 | 0.041 | 0.041 | 100.0% | 1 | | keystone_v3.get_services | 0.043 | 0.043 | 0.043 | 0.043 | 0.043 | 0.043 | 100.0% | 1 | | total | 1.194 | 1.194 | 1.194 | 1.194 | 1.194 | 1.194 | 100.0% | 1 | | -> duration | 1.194 | 1.194 | 1.194 | 1.194 | 1.194 | 1.194 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.194195 Full duration: 19.856481 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5f86e474-e51f-4829-b681-bdaf3cd37562 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.555 | 0.555 | 0.555 | 0.555 | 0.555 | 0.555 | 100.0% | 1 | | keystone_v3.update_project | 0.066 | 0.066 | 0.066 | 0.066 | 0.066 | 0.066 | 100.0% | 1 | | keystone_v3.delete_project | 0.163 | 0.163 | 0.163 | 0.163 | 0.163 | 0.163 | 100.0% | 1 | | total | 0.785 | 0.785 | 0.785 | 0.785 | 0.785 | 0.785 | 100.0% | 1 | | -> duration | 0.785 | 0.785 | 0.785 | 0.785 | 0.785 | 0.785 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.784993 Full duration: 13.311356 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5f86e474-e51f-4829-b681-bdaf3cd37562 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.531 | 0.531 | 0.531 | 0.531 | 0.531 | 0.531 | 100.0% | 1 | | total | 0.608 | 0.608 | 0.608 | 0.608 | 0.608 | 0.608 | 100.0% | 1 | | -> duration | 0.608 | 0.608 | 0.608 | 0.608 | 0.608 | 0.608 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.608429 Full duration: 14.691548 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5f86e474-e51f-4829-b681-bdaf3cd37562 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.554 | 0.554 | 0.554 | 0.554 | 0.554 | 0.554 | 100.0% | 1 | | total | 0.554 | 0.554 | 0.554 | 0.554 | 0.554 | 0.554 | 100.0% | 1 | | -> duration | 0.554 | 0.554 | 0.554 | 0.554 | 0.554 | 0.554 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.554484 Full duration: 14.545751 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5f86e474-e51f-4829-b681-bdaf3cd37562 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.679 | 0.679 | 0.679 | 0.679 | 0.679 | 0.679 | 100.0% | 1 | | keystone_v3.list_users | 0.084 | 0.084 | 0.084 | 0.084 | 0.084 | 0.084 | 100.0% | 1 | | total | 0.849 | 0.849 | 0.849 | 0.849 | 0.849 | 0.849 | 100.0% | 1 | | -> duration | 0.849 | 0.849 | 0.849 | 0.849 | 0.849 | 0.849 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.84875 Full duration: 15.012271 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "args": { "users_per_tenant": 10 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5f86e474-e51f-4829-b681-bdaf3cd37562 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.611 | 0.611 | 0.611 | 0.611 | 0.611 | 0.611 | 100.0% | 1 | | keystone_v3.create_users | 2.909 | 2.909 | 2.909 | 2.909 | 2.909 | 2.909 | 100.0% | 1 | | -> keystone_v3.create_user (x10) | 2.909 | 2.909 | 2.909 | 2.909 | 2.909 | 2.909 | 100.0% | 1 | | --> keystone_v3.list_roles (x10) | 0.417 | 0.417 | 0.417 | 0.417 | 0.417 | 0.417 | 100.0% | 1 | | --> keystone_v3.add_role (x10) | 1.047 | 1.047 | 1.047 | 1.047 | 1.047 | 1.047 | 100.0% | 1 | | total | 3.885 | 3.885 | 3.885 | 3.885 | 3.885 | 3.885 | 100.0% | 1 | | -> duration | 3.885 | 3.885 | 3.885 | 3.885 | 3.885 | 3.885 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.885424 Full duration: 21.43475 HINTS: * To plot HTML graphics with this data, run: rally task report 5f86e474-e51f-4829-b681-bdaf3cd37562 --out output.html * To generate a JUnit report, run: rally task export 5f86e474-e51f-4829-b681-bdaf3cd37562 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 5f86e474-e51f-4829-b681-bdaf3cd37562 --json --out output.json 2018-04-18 10:39:22,147 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '5f86e474-e51f-4829-b681-bdaf3cd37562'] 2018-04-18 10:39:23,271 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-18 10:39:23,271 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '5f86e474-e51f-4829-b681-bdaf3cd37562', '--out', u'/home/opnfv/functest/results/rally/opnfv-keystone.html'] 2018-04-18 10:39:23,284 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2018-04-18 10:39:23,284 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2018-04-18 10:39:23,285 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-neutron.yaml 2018-04-18 10:39:23,285 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-18 10:39:23,298 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-04-18 10:39:23,299 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'floating_net', 'service_list': ['neutron'], 'concurrency': 4, 'netid': '06bf5493-cfab-4628-bac5-8edcc2d703c6', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-78df643c-d18f-49fd-aa89-3cb1e2e27d2f', 'flavor_name': 'rally-tiny-78df643c-d18f-49fd-aa89-3cb1e2e27d2f', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-78df643c-d18f-49fd-aa89-3cb1e2e27d2f', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-18 10:46:18,353 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 75edd8ca-a6a4-410d-afa0-7a457239aff7 2018-04-18 10:46:18,355 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '75edd8ca-a6a4-410d-afa0-7a457239aff7'] 2018-04-18 10:46:19,436 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 75edd8ca-a6a4-410d-afa0-7a457239aff7: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1 } } }, "args": { "network_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 75edd8ca-a6a4-410d-afa0-7a457239aff7 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.453 | 1.453 | 1.453 | 1.453 | 1.453 | 1.453 | 100.0% | 1 | | neutron.delete_network | 1.017 | 1.017 | 1.017 | 1.017 | 1.017 | 1.017 | 100.0% | 1 | | total | 2.47 | 2.47 | 2.47 | 2.47 | 2.47 | 2.47 | 100.0% | 1 | | -> duration | 2.47 | 2.47 | 2.47 | 2.47 | 2.47 | 2.47 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.470331 Full duration: 15.7108 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "quotas": { "neutron": { "network": -1, "port": -1 } }, "users": { "users_per_tenant": 1, "tenants": 1 }, "network": {} }, "args": { "network_create_args": {}, "ports_per_network": 1, "port_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 75edd8ca-a6a4-410d-afa0-7a457239aff7 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 1.944 | 1.944 | 1.944 | 1.944 | 1.944 | 1.944 | 100.0% | 1 | | neutron.delete_port | 0.788 | 0.788 | 0.788 | 0.788 | 0.788 | 0.788 | 100.0% | 1 | | total | 2.733 | 2.733 | 2.733 | 2.733 | 2.733 | 2.733 | 100.0% | 1 | | -> duration | 2.733 | 2.733 | 2.733 | 2.733 | 2.733 | 2.733 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.732537 Full duration: 41.840545 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "quotas": { "neutron": { "subnet": -1, "router": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 1, "tenants": 1 }, "network": {} }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 1, "router_create_args": {}, "subnet_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 75edd8ca-a6a4-410d-afa0-7a457239aff7 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.104 | 1.104 | 1.104 | 1.104 | 1.104 | 1.104 | 100.0% | 1 | | neutron.create_subnet | 0.752 | 0.752 | 0.752 | 0.752 | 0.752 | 0.752 | 100.0% | 1 | | neutron.create_router | 3.31 | 3.31 | 3.31 | 3.31 | 3.31 | 3.31 | 100.0% | 1 | | neutron.add_interface_router | 2.046 | 2.046 | 2.046 | 2.046 | 2.046 | 2.046 | 100.0% | 1 | | neutron.remove_interface_router | 2.224 | 2.224 | 2.224 | 2.224 | 2.224 | 2.224 | 100.0% | 1 | | neutron.delete_router | 2.413 | 2.413 | 2.413 | 2.413 | 2.413 | 2.413 | 100.0% | 1 | | total | 11.85 | 11.85 | 11.85 | 11.85 | 11.85 | 11.85 | 100.0% | 1 | | -> duration | 11.85 | 11.85 | 11.85 | 11.85 | 11.85 | 11.85 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 11.850136 Full duration: 55.662054 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "quotas": { "neutron": { "subnet": -1, "network": -1 } }, "users": { "users_per_tenant": 1, "tenants": 1 }, "network": {} }, "args": { "network_create_args": {}, "subnet_create_args": {}, "subnets_per_network": 1, "subnet_cidr_start": "1.1.0.0/30" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 75edd8ca-a6a4-410d-afa0-7a457239aff7 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet | 1.407 | 1.407 | 1.407 | 1.407 | 1.407 | 1.407 | 100.0% | 1 | | neutron.delete_subnet | 1.138 | 1.138 | 1.138 | 1.138 | 1.138 | 1.138 | 100.0% | 1 | | total | 2.546 | 2.546 | 2.546 | 2.546 | 2.546 | 2.546 | 100.0% | 1 | | -> duration | 2.546 | 2.546 | 2.546 | 2.546 | 2.546 | 2.546 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.545834 Full duration: 38.854684 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1 } } }, "args": { "network_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 75edd8ca-a6a4-410d-afa0-7a457239aff7 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.564 | 1.564 | 1.564 | 1.564 | 1.564 | 1.564 | 100.0% | 1 | | neutron.list_networks | 0.292 | 0.292 | 0.292 | 0.292 | 0.292 | 0.292 | 100.0% | 1 | | total | 1.856 | 1.856 | 1.856 | 1.856 | 1.856 | 1.856 | 100.0% | 1 | | -> duration | 1.856 | 1.856 | 1.856 | 1.856 | 1.856 | 1.856 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.85629 Full duration: 18.026796 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "quotas": { "neutron": { "network": -1, "port": -1 } }, "users": { "users_per_tenant": 1, "tenants": 1 }, "network": {} }, "args": { "network_create_args": {}, "ports_per_network": 1, "port_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 75edd8ca-a6a4-410d-afa0-7a457239aff7 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 1.743 | 1.743 | 1.743 | 1.743 | 1.743 | 1.743 | 100.0% | 1 | | neutron.list_ports | 0.223 | 0.223 | 0.223 | 0.223 | 0.223 | 0.223 | 100.0% | 1 | | total | 1.966 | 1.966 | 1.966 | 1.966 | 1.966 | 1.966 | 100.0% | 1 | | -> duration | 1.966 | 1.966 | 1.966 | 1.966 | 1.966 | 1.966 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.966089 Full duration: 41.782233 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "quotas": { "neutron": { "subnet": -1, "network": -1, "router": -1 } }, "users": { "users_per_tenant": 1, "tenants": 1 }, "network": {} }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 1, "router_create_args": {}, "subnet_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 75edd8ca-a6a4-410d-afa0-7a457239aff7 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.071 | 1.071 | 1.071 | 1.071 | 1.071 | 1.071 | 100.0% | 1 | | neutron.create_subnet | 0.853 | 0.853 | 0.853 | 0.853 | 0.853 | 0.853 | 100.0% | 1 | | neutron.create_router | 2.739 | 2.739 | 2.739 | 2.739 | 2.739 | 2.739 | 100.0% | 1 | | neutron.add_interface_router | 2.156 | 2.156 | 2.156 | 2.156 | 2.156 | 2.156 | 100.0% | 1 | | neutron.list_routers | 0.154 | 0.154 | 0.154 | 0.154 | 0.154 | 0.154 | 100.0% | 1 | | total | 6.975 | 6.975 | 6.975 | 6.975 | 6.975 | 6.975 | 100.0% | 1 | | -> duration | 6.975 | 6.975 | 6.975 | 6.975 | 6.975 | 6.975 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.97505 Full duration: 59.148572 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "quotas": { "neutron": { "subnet": -1, "network": -1 } }, "users": { "users_per_tenant": 1, "tenants": 1 }, "network": {} }, "args": { "network_create_args": {}, "subnet_create_args": {}, "subnets_per_network": 1, "subnet_cidr_start": "1.1.0.0/30" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 75edd8ca-a6a4-410d-afa0-7a457239aff7 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.109 | 1.109 | 1.109 | 1.109 | 1.109 | 1.109 | 100.0% | 1 | | neutron.create_subnet | 0.682 | 0.682 | 0.682 | 0.682 | 0.682 | 0.682 | 100.0% | 1 | | neutron.list_subnets | 0.145 | 0.145 | 0.145 | 0.145 | 0.145 | 0.145 | 100.0% | 1 | | total | 1.937 | 1.937 | 1.937 | 1.937 | 1.937 | 1.937 | 100.0% | 1 | | -> duration | 1.937 | 1.937 | 1.937 | 1.937 | 1.937 | 1.937 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.936506 Full duration: 45.180069 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "security_group": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 75edd8ca-a6a4-410d-afa0-7a457239aff7 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.736 | 1.736 | 1.736 | 1.736 | 1.736 | 1.736 | 100.0% | 1 | | neutron.delete_security_group | 0.3 | 0.3 | 0.3 | 0.3 | 0.3 | 0.3 | 100.0% | 1 | | total | 2.036 | 2.036 | 2.036 | 2.036 | 2.036 | 2.036 | 100.0% | 1 | | -> duration | 2.036 | 2.036 | 2.036 | 2.036 | 2.036 | 2.036 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.035945 Full duration: 16.344188 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "security_group": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 75edd8ca-a6a4-410d-afa0-7a457239aff7 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.248 | 1.248 | 1.248 | 1.248 | 1.248 | 1.248 | 100.0% | 1 | | neutron.create_security_group_rule | 0.305 | 0.305 | 0.305 | 0.305 | 0.305 | 0.305 | 100.0% | 1 | | neutron.delete_security_group_rule | 0.228 | 0.228 | 0.228 | 0.228 | 0.228 | 0.228 | 100.0% | 1 | | neutron.delete_security_group | 0.221 | 0.221 | 0.221 | 0.221 | 0.221 | 0.221 | 100.0% | 1 | | total | 2.003 | 2.003 | 2.003 | 2.003 | 2.003 | 2.003 | 100.0% | 1 | | -> duration | 2.003 | 2.003 | 2.003 | 2.003 | 2.003 | 2.003 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.002891 Full duration: 15.342574 -------------------------------------------------------------------------------- test scenario NeutronNetworks.set_and_clear_router_gateway args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "roles": [ "admin" ], "quotas": { "neutron": { "router": -1, "network": -1 } } }, "args": { "network_create_args": { "router:external": true } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 75edd8ca-a6a4-410d-afa0-7a457239aff7 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.365 | 1.365 | 1.365 | 1.365 | 1.365 | 1.365 | 100.0% | 1 | | neutron.create_router | 4.401 | 4.401 | 4.401 | 4.401 | 4.401 | 4.401 | 100.0% | 1 | | neutron.add_gateway_router | 2.016 | 2.016 | 2.016 | 2.016 | 2.016 | 2.016 | 100.0% | 1 | | neutron.remove_gateway_router | 1.425 | 1.425 | 1.425 | 1.425 | 1.425 | 1.425 | 100.0% | 1 | | total | 9.207 | 9.207 | 9.207 | 9.207 | 9.207 | 9.207 | 100.0% | 1 | | -> duration | 9.207 | 9.207 | 9.207 | 9.207 | 9.207 | 9.207 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.206964 Full duration: 35.413758 HINTS: * To plot HTML graphics with this data, run: rally task report 75edd8ca-a6a4-410d-afa0-7a457239aff7 --out output.html * To generate a JUnit report, run: rally task export 75edd8ca-a6a4-410d-afa0-7a457239aff7 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 75edd8ca-a6a4-410d-afa0-7a457239aff7 --json --out output.json 2018-04-18 10:46:19,437 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '75edd8ca-a6a4-410d-afa0-7a457239aff7'] 2018-04-18 10:46:20,587 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-18 10:46:20,587 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '75edd8ca-a6a4-410d-afa0-7a457239aff7', '--out', u'/home/opnfv/functest/results/rally/opnfv-neutron.html'] 2018-04-18 10:46:20,601 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2018-04-18 10:46:20,602 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2018-04-18 10:46:20,602 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-nova.yaml 2018-04-18 10:46:20,602 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-18 10:46:20,620 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-04-18 10:46:20,621 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'floating_net', 'service_list': ['nova'], 'concurrency': 4, 'netid': '06bf5493-cfab-4628-bac5-8edcc2d703c6', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-78df643c-d18f-49fd-aa89-3cb1e2e27d2f', 'flavor_name': 'rally-tiny-78df643c-d18f-49fd-aa89-3cb1e2e27d2f', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-78df643c-d18f-49fd-aa89-3cb1e2e27d2f', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-18 10:56:06,811 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 4bfeeff4-6f81-4298-be16-cb9114fcb0f0 2018-04-18 10:56:06,813 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '4bfeeff4-6f81-4298-be16-cb9114fcb0f0'] 2018-04-18 10:56:08,042 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 4bfeeff4-6f81-4298-be16-cb9114fcb0f0: finished -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_live_migrate_server args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "block_migration": false, "flavor": { "name": "rally-tiny-78df643c-d18f-49fd-aa89-3cb1e2e27d2f" }, "image": { "name": "Cirros-0.4.0-78df643c-d18f-49fd-aa89-3cb1e2e27d2f" }, "nics": [ { "net-id": "06bf5493-cfab-4628-bac5-8edcc2d703c6" } ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4bfeeff4-6f81-4298-be16-cb9114fcb0f0 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 16.185 | 16.185 | 16.185 | 16.185 | 16.185 | 16.185 | 100.0% | 1 | | nova.live_migrate | 13.958 | 13.958 | 13.958 | 13.958 | 13.958 | 13.958 | 100.0% | 1 | | nova.delete_server | 3.293 | 3.293 | 3.293 | 3.293 | 3.293 | 3.293 | 100.0% | 1 | | total | 33.437 | 33.437 | 33.437 | 33.437 | 33.437 | 33.437 | 100.0% | 1 | | -> duration | 32.437 | 32.437 | 32.437 | 32.437 | 32.437 | 32.437 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 32.43672 Full duration: 43.368365 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_attach_created_volume_and_live_migrate args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "block_migration": false, "flavor": { "name": "rally-tiny-78df643c-d18f-49fd-aa89-3cb1e2e27d2f" }, "boot_server_kwargs": { "nics": [ { "net-id": "06bf5493-cfab-4628-bac5-8edcc2d703c6" } ] }, "image": { "name": "Cirros-0.4.0-78df643c-d18f-49fd-aa89-3cb1e2e27d2f" }, "size": 10 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4bfeeff4-6f81-4298-be16-cb9114fcb0f0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 11.996 | 11.996 | 11.996 | 11.996 | 11.996 | 11.996 | 100.0% | 1 | | cinder_v2.create_volume | 2.795 | 2.795 | 2.795 | 2.795 | 2.795 | 2.795 | 100.0% | 1 | | nova.attach_volume | 7.044 | 7.044 | 7.044 | 7.044 | 7.044 | 7.044 | 100.0% | 1 | | nova.live_migrate | 18.644 | 18.644 | 18.644 | 18.644 | 18.644 | 18.644 | 100.0% | 1 | | nova.detach_volume | 3.893 | 3.893 | 3.893 | 3.893 | 3.893 | 3.893 | 100.0% | 1 | | cinder_v2.delete_volume | 91.802 | 91.802 | 91.802 | 91.802 | 91.802 | 91.802 | 100.0% | 1 | | nova.delete_server | 2.777 | 2.777 | 2.777 | 2.777 | 2.777 | 2.777 | 100.0% | 1 | | total | 138.952 | 138.952 | 138.952 | 138.952 | 138.952 | 138.952 | 100.0% | 1 | | -> duration | 137.952 | 137.952 | 137.952 | 137.952 | 137.952 | 137.952 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 137.951778 Full duration: 151.476874 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_from_volume_and_live_migrate args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "volume_size": 10, "nics": [ { "net-id": "06bf5493-cfab-4628-bac5-8edcc2d703c6" } ], "image": { "name": "Cirros-0.4.0-78df643c-d18f-49fd-aa89-3cb1e2e27d2f" }, "block_migration": false, "force_delete": false, "flavor": { "name": "rally-tiny-78df643c-d18f-49fd-aa89-3cb1e2e27d2f" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4bfeeff4-6f81-4298-be16-cb9114fcb0f0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 5.789 | 5.789 | 5.789 | 5.789 | 5.789 | 5.789 | 100.0% | 1 | | nova.boot_server | 11.046 | 11.046 | 11.046 | 11.046 | 11.046 | 11.046 | 100.0% | 1 | | nova.live_migrate | 16.802 | 16.802 | 16.802 | 16.802 | 16.802 | 16.802 | 100.0% | 1 | | nova.delete_server | 5.176 | 5.176 | 5.176 | 5.176 | 5.176 | 5.176 | 100.0% | 1 | | total | 38.814 | 38.814 | 38.814 | 38.814 | 38.814 | 38.814 | 100.0% | 1 | | -> duration | 37.814 | 37.814 | 37.814 | 37.814 | 37.814 | 37.814 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 37.81391 Full duration: 51.947048 -------------------------------------------------------------------------------- test scenario NovaKeypair.boot_and_delete_server_with_keypair args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "key_pairs": -1, "cores": -1, "security_groups": -1 }, "neutron": { "subnet": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 1, "tenants": 1 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" } }, "args": { "server_kwargs": { "nics": [ { "net-id": "06bf5493-cfab-4628-bac5-8edcc2d703c6" } ] }, "flavor": { "name": "rally-tiny-78df643c-d18f-49fd-aa89-3cb1e2e27d2f" }, "image": { "name": "Cirros-0.4.0-78df643c-d18f-49fd-aa89-3cb1e2e27d2f" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4bfeeff4-6f81-4298-be16-cb9114fcb0f0 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 1.022 | 1.022 | 1.022 | 1.022 | 1.022 | 1.022 | 100.0% | 1 | | nova.boot_server | 13.125 | 13.125 | 13.125 | 13.125 | 13.125 | 13.125 | 100.0% | 1 | | nova.delete_server | 5.345 | 5.345 | 5.345 | 5.345 | 5.345 | 5.345 | 100.0% | 1 | | nova.delete_keypair | 0.053 | 0.053 | 0.053 | 0.053 | 0.053 | 0.053 | 100.0% | 1 | | total | 19.547 | 19.547 | 19.547 | 19.547 | 19.547 | 19.547 | 100.0% | 1 | | -> duration | 18.547 | 18.547 | 18.547 | 18.547 | 18.547 | 18.547 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 18.547382 Full duration: 55.722808 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_from_volume_and_delete args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 }, "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "cores": -1, "security_groups": -1 }, "neutron": { "subnet": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 1, "tenants": 1 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" } }, "args": { "volume_size": 5, "flavor": { "name": "rally-tiny-78df643c-d18f-49fd-aa89-3cb1e2e27d2f" }, "image": { "name": "Cirros-0.4.0-78df643c-d18f-49fd-aa89-3cb1e2e27d2f" }, "nics": [ { "net-id": "06bf5493-cfab-4628-bac5-8edcc2d703c6" } ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4bfeeff4-6f81-4298-be16-cb9114fcb0f0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 5.892 | 5.892 | 5.892 | 5.892 | 5.892 | 5.892 | 100.0% | 1 | | nova.boot_server | 16.684 | 16.684 | 16.684 | 16.684 | 16.684 | 16.684 | 100.0% | 1 | | nova.delete_server | 5.155 | 5.155 | 5.155 | 5.155 | 5.155 | 5.155 | 100.0% | 1 | | total | 27.732 | 27.732 | 27.732 | 27.732 | 27.732 | 27.732 | 100.0% | 1 | | -> duration | 26.732 | 26.732 | 26.732 | 26.732 | 26.732 | 26.732 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 26.732144 Full duration: 67.10497 -------------------------------------------------------------------------------- test scenario NovaServers.pause_and_unpause_server args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "cores": -1, "security_groups": -1 }, "neutron": { "subnet": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 1, "tenants": 1 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" } }, "args": { "force_delete": false, "flavor": { "name": "rally-tiny-78df643c-d18f-49fd-aa89-3cb1e2e27d2f" }, "image": { "name": "Cirros-0.4.0-78df643c-d18f-49fd-aa89-3cb1e2e27d2f" }, "nics": [ { "net-id": "06bf5493-cfab-4628-bac5-8edcc2d703c6" } ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4bfeeff4-6f81-4298-be16-cb9114fcb0f0 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 11.963 | 11.963 | 11.963 | 11.963 | 11.963 | 11.963 | 100.0% | 1 | | nova.pause_server | 7.648 | 7.648 | 7.648 | 7.648 | 7.648 | 7.648 | 100.0% | 1 | | nova.unpause_server | 2.629 | 2.629 | 2.629 | 2.629 | 2.629 | 2.629 | 100.0% | 1 | | nova.delete_server | 2.911 | 2.911 | 2.911 | 2.911 | 2.911 | 2.911 | 100.0% | 1 | | total | 25.151 | 25.151 | 25.151 | 25.151 | 25.151 | 25.151 | 100.0% | 1 | | -> duration | 20.151 | 20.151 | 20.151 | 20.151 | 20.151 | 20.151 | 100.0% | 1 | | -> idle_duration | 5.0 | 5.0 | 5.0 | 5.0 | 5.0 | 5.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 20.151472 Full duration: 60.0225 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_migrate_server args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "nics": [ { "net-id": "06bf5493-cfab-4628-bac5-8edcc2d703c6" } ], "flavor": { "name": "rally-tiny-78df643c-d18f-49fd-aa89-3cb1e2e27d2f" }, "image": { "name": "Cirros-0.4.0-78df643c-d18f-49fd-aa89-3cb1e2e27d2f" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4bfeeff4-6f81-4298-be16-cb9114fcb0f0 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 12.324 | 12.324 | 12.324 | 12.324 | 12.324 | 12.324 | 100.0% | 1 | | nova.migrate | 29.163 | 29.163 | 29.163 | 29.163 | 29.163 | 29.163 | 100.0% | 1 | | nova.resize_confirm | 3.101 | 3.101 | 3.101 | 3.101 | 3.101 | 3.101 | 100.0% | 1 | | nova.delete_server | 2.754 | 2.754 | 2.754 | 2.754 | 2.754 | 2.754 | 100.0% | 1 | | total | 47.342 | 47.342 | 47.342 | 47.342 | 47.342 | 47.342 | 100.0% | 1 | | -> duration | 46.342 | 46.342 | 46.342 | 46.342 | 46.342 | 46.342 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 46.341763 Full duration: 57.502003 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_and_list_interfaces args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "network": {} }, "args": { "flavor": { "name": "rally-tiny-78df643c-d18f-49fd-aa89-3cb1e2e27d2f" }, "auto_assign_nic": true, "image": { "name": "Cirros-0.4.0-78df643c-d18f-49fd-aa89-3cb1e2e27d2f" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4bfeeff4-6f81-4298-be16-cb9114fcb0f0 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 11.398 | 11.398 | 11.398 | 11.398 | 11.398 | 11.398 | 100.0% | 1 | | nova.list_interfaces | 0.287 | 0.287 | 0.287 | 0.287 | 0.287 | 0.287 | 100.0% | 1 | | total | 11.685 | 11.685 | 11.685 | 11.685 | 11.685 | 11.685 | 100.0% | 1 | | -> duration | 10.685 | 10.685 | 10.685 | 10.685 | 10.685 | 10.685 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.68538 Full duration: 52.371197 -------------------------------------------------------------------------------- test scenario NovaServerGroups.create_and_delete_server_group args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "policies": [ "affinity" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4bfeeff4-6f81-4298-be16-cb9114fcb0f0 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_server_group | 0.928 | 0.928 | 0.928 | 0.928 | 0.928 | 0.928 | 100.0% | 1 | | nova.delete_server_group | 0.09 | 0.09 | 0.09 | 0.09 | 0.09 | 0.09 | 100.0% | 1 | | total | 1.019 | 1.019 | 1.019 | 1.019 | 1.019 | 1.019 | 100.0% | 1 | | -> duration | 1.019 | 1.019 | 1.019 | 1.019 | 1.019 | 1.019 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.018834 Full duration: 10.054878 HINTS: * To plot HTML graphics with this data, run: rally task report 4bfeeff4-6f81-4298-be16-cb9114fcb0f0 --out output.html * To generate a JUnit report, run: rally task export 4bfeeff4-6f81-4298-be16-cb9114fcb0f0 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 4bfeeff4-6f81-4298-be16-cb9114fcb0f0 --json --out output.json 2018-04-18 10:56:08,043 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '4bfeeff4-6f81-4298-be16-cb9114fcb0f0'] 2018-04-18 10:56:09,183 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-18 10:56:09,184 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '4bfeeff4-6f81-4298-be16-cb9114fcb0f0', '--out', u'/home/opnfv/functest/results/rally/opnfv-nova.html'] 2018-04-18 10:56:09,198 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" OK. 2018-04-18 10:56:09,199 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2018-04-18 10:56:09,199 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-quotas.yaml 2018-04-18 10:56:09,200 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-18 10:56:09,227 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-04-18 10:56:09,228 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'floating_net', 'service_list': ['quotas'], 'concurrency': 4, 'netid': '06bf5493-cfab-4628-bac5-8edcc2d703c6', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-78df643c-d18f-49fd-aa89-3cb1e2e27d2f', 'flavor_name': 'rally-tiny-78df643c-d18f-49fd-aa89-3cb1e2e27d2f', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-78df643c-d18f-49fd-aa89-3cb1e2e27d2f', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-18 10:57:05,505 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : c8277a54-1d4f-46de-87b1-34e171d4bafd 2018-04-18 10:57:05,505 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'c8277a54-1d4f-46de-87b1-34e171d4bafd'] 2018-04-18 10:57:06,619 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task c8277a54-1d4f-46de-87b1-34e171d4bafd: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c8277a54-1d4f-46de-87b1-34e171d4bafd has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.304 | 1.304 | 1.304 | 1.304 | 1.304 | 1.304 | 100.0% | 1 | | quotas.delete_quotas | 0.066 | 0.066 | 0.066 | 0.066 | 0.066 | 0.066 | 100.0% | 1 | | total | 1.37 | 1.37 | 1.37 | 1.37 | 1.37 | 1.37 | 100.0% | 1 | | -> duration | 1.37 | 1.37 | 1.37 | 1.37 | 1.37 | 1.37 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.370221 Full duration: 9.744131 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c8277a54-1d4f-46de-87b1-34e171d4bafd has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.962 | 0.962 | 0.962 | 0.962 | 0.962 | 0.962 | 100.0% | 1 | | total | 0.963 | 0.963 | 0.963 | 0.963 | 0.963 | 0.963 | 100.0% | 1 | | -> duration | 0.963 | 0.963 | 0.963 | 0.963 | 0.963 | 0.963 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.962547 Full duration: 9.177078 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c8277a54-1d4f-46de-87b1-34e171d4bafd has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.3 | 0.3 | 0.3 | 0.3 | 0.3 | 0.3 | 100.0% | 1 | | total | 0.784 | 0.784 | 0.784 | 0.784 | 0.784 | 0.784 | 100.0% | 1 | | -> duration | 0.784 | 0.784 | 0.784 | 0.784 | 0.784 | 0.784 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.783541 Full duration: 8.47756 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c8277a54-1d4f-46de-87b1-34e171d4bafd has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.124 | 1.124 | 1.124 | 1.124 | 1.124 | 1.124 | 100.0% | 1 | | total | 1.124 | 1.124 | 1.124 | 1.124 | 1.124 | 1.124 | 100.0% | 1 | | -> duration | 1.124 | 1.124 | 1.124 | 1.124 | 1.124 | 1.124 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.123813 Full duration: 8.978945 HINTS: * To plot HTML graphics with this data, run: rally task report c8277a54-1d4f-46de-87b1-34e171d4bafd --out output.html * To generate a JUnit report, run: rally task export c8277a54-1d4f-46de-87b1-34e171d4bafd --type junit --to output.xml * To get raw JSON output of task results, run: rally task report c8277a54-1d4f-46de-87b1-34e171d4bafd --json --out output.json 2018-04-18 10:57:06,620 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'c8277a54-1d4f-46de-87b1-34e171d4bafd'] 2018-04-18 10:57:07,727 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-18 10:57:07,727 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'c8277a54-1d4f-46de-87b1-34e171d4bafd', '--out', u'/home/opnfv/functest/results/rally/opnfv-quotas.html'] 2018-04-18 10:57:07,741 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2018-04-18 10:57:07,745 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:48 | 6 | 100.00% | | glance | 01:17 | 4 | 100.00% | | cinder | 04:31 | 10 | 100.00% | | heat | 01:17 | 4 | 100.00% | | keystone | 02:50 | 11 | 100.00% | | neutron | 06:23 | 11 | 100.00% | | nova | 09:09 | 9 | 100.00% | | quotas | 00:36 | 4 | 100.00% | | | | | | | TOTAL: | 00:26:53 | 59 | 100.00% | +----------------+------------+----------------+-----------+ 2018-04-18 10:57:07,745 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_sanity' success_rate is 100.00% 2018-04-18 10:57:21,810 - xtesting.energy.energy - DEBUG - Restoring previous scenario (default/default) 2018-04-18 10:57:21,810 - xtesting.energy.energy - DEBUG - Submitting scenario (default/default) 2018-04-18 10:57:22,330 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-18 10:57:22,331 - xtesting.ci.run_tests - INFO - Test result: +----------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +----------------------+------------------+------------------+----------------+ | rally_sanity | functest | 31:43 | PASS | +----------------------+------------------+------------------+----------------+ 2018-04-18 10:57:22,336 - xtesting.ci.run_tests - INFO - Running test case 'patrole'... 2018-04-18 10:57:22,432 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-04-18 10:57:25,866 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-04-18 10:57:29,281 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | 50780d77-f8dd-485f-95d7-3d4a6ccfabce | 2018-04-18T10:57:28.530894 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 50780d77-f8dd-485f-95d7-3d4a6ccfabce ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-04-18 10:57:33,366 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | artifact | Available | | __unknown__ | compute_legacy | Available | | __unknown__ | placement | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | designate | dns | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+----------------+-----------+ 2018-04-18 10:57:33,367 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-04-18 10:57:36,484 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify delete-verifier --id opnfv-tempest --force 2018-04-18 10:57:41,221 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide Using verifier 'opnfv-tempest' (UUID=25285776-14b9-435a-bf3f-e66e02e025fc) as the default verifier for the future CLI operations. 2018-04-18 10:57:44,818 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-04-18 10:57:47,274 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating two images for Tempest suite 2018-04-18 10:57:52,778 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-04-18 10:57:59,551 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-04-18 10:57:59,552 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-04-18 10:57:59,552 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-04-18 10:57:59,557 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-04-18 10:57:59,563 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Generating test case list... 2018-04-18 10:58:02,993 - functest.opnfv_tests.openstack.tempest.tempest - INFO - (cd /root/.rally/verification/verifier-25285776-14b9-435a-bf3f-e66e02e025fc/repo; stestr list '(?!.*test_networks_multiprovider_rbac)(?=patrole_tempest_plugin.tests.api.(image|network))' >/home/opnfv/functest/results/patrole/tempest-list.txt 2>/dev/null) 2018-04-18 10:58:02,993 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', u'/home/opnfv/functest/results/patrole/tempest-list.txt']'. 2018-04-18 11:00:22,925 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Verification UUID: 26a6e4c3-204e-4dc4-bab3-67fa00808674 2018-04-18 11:00:23,151 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', '26a6e4c3-204e-4dc4-bab3-67fa00808674']'. 2018-04-18 11:00:24,221 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2018-04-18 11:00:24,222 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2018-04-18 11:00:24,222 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-04-18 11:00:24,222 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | 26a6e4c3-204e-4dc4-bab3-67fa00808674 | 2018-04-18 11:00:24,222 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | finished | 2018-04-18 11:00:24,222 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2018-04-18 10:58:05 | 2018-04-18 11:00:24,223 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2018-04-18 11:00:22 | 2018-04-18 11:00:24,223 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 0:02:17 | 2018-04-18 11:00:24,223 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | load_list: (value is too long, use 'detailed' flag to display it) | 2018-04-18 11:00:24,223 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2018-04-18 11:00:24,223 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: 25285776-14b9-435a-bf3f-e66e02e025fc) | 2018-04-18 11:00:24,223 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2018-04-18 11:00:24,223 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: 50780d77-f8dd-485f-95d7-3d4a6ccfabce) | 2018-04-18 11:00:24,223 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 136 | 2018-04-18 11:00:24,223 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 105.453 | 2018-04-18 11:00:24,224 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 136 | 2018-04-18 11:00:24,224 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 0 | 2018-04-18 11:00:24,224 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2018-04-18 11:00:24,224 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2018-04-18 11:00:24,224 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 0 | 2018-04-18 11:00:24,224 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-04-18 11:00:24,224 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2018-04-18 11:00:24,226 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest patrole success_rate is 100.0% 2018-04-18 11:00:29,714 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-18 11:00:29,715 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | patrole | functest | 02:45 | PASS | +-------------------+------------------+------------------+----------------+ 2018-04-18 11:00:29,719 - xtesting.ci.run_tests - INFO - Running test case 'snaps_smoke'... 2018-04-18 11:00:30,756 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata '{u'hw:mem_page_size': u'large'}' 2018-04-18 12:16:32,825 - xtesting.core.unit - DEBUG - test_add_rule (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_delete_group (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_group_admin_user_to_new_project (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_group_new_user_to_admin_project (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_group_with_one_complex_rule (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_group_with_one_simple_rule (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_group_with_several_rules (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_group_without_rules (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_remove_rule_by_id (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_remove_rule_by_setting (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_delete_image (snaps.openstack.tests.create_image_tests.CreateImageSuccessTests) ... ok test_create_image_clean_file (snaps.openstack.tests.create_image_tests.CreateImageSuccessTests) ... ok test_create_image_clean_url (snaps.openstack.tests.create_image_tests.CreateImageSuccessTests) ... ok test_create_image_clean_url_properties (snaps.openstack.tests.create_image_tests.CreateImageSuccessTests) ... ok test_create_same_image (snaps.openstack.tests.create_image_tests.CreateImageSuccessTests) ... ok test_create_same_image_new_settings (snaps.openstack.tests.create_image_tests.CreateImageSuccessTests) ... ok test_bad_image_file (snaps.openstack.tests.create_image_tests.CreateImageNegativeTests) ... ok test_bad_image_image_type (snaps.openstack.tests.create_image_tests.CreateImageNegativeTests) ... ok test_bad_image_name (snaps.openstack.tests.create_image_tests.CreateImageNegativeTests) ... ok test_bad_image_url (snaps.openstack.tests.create_image_tests.CreateImageNegativeTests) ... ok test_create_three_part_image_from_file_3_creators (snaps.openstack.tests.create_image_tests.CreateMultiPartImageTests) ... ok test_create_three_part_image_from_url (snaps.openstack.tests.create_image_tests.CreateMultiPartImageTests) ... ok test_create_three_part_image_from_url_3_creators (snaps.openstack.tests.create_image_tests.CreateMultiPartImageTests) ... ok test_create_delete_keypair (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsTests) ... ok test_create_keypair_from_file (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsTests) ... ok test_create_keypair_large_key (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsTests) ... ok test_create_keypair_only (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsTests) ... ok test_create_keypair_save_both (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsTests) ... ok test_create_keypair_save_pub_only (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsTests) ... ok test_create_keypair_exist_files_delete (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsCleanupTests) ... ok test_create_keypair_exist_files_keep (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsCleanupTests) ... ok test_create_keypair_gen_files_delete_1 (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsCleanupTests) ... ok test_create_keypair_gen_files_delete_2 (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsCleanupTests) ... ok test_create_keypair_gen_files_keep (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsCleanupTests) ... ok test_create_delete_network (snaps.openstack.tests.create_network_tests.CreateNetworkSuccessTests) ... ok test_create_network_router_admin_user_to_new_project (snaps.openstack.tests.create_network_tests.CreateNetworkSuccessTests) ... ok test_create_network_router_new_user_to_admin_project (snaps.openstack.tests.create_network_tests.CreateNetworkSuccessTests) ... ok test_create_network_with_router (snaps.openstack.tests.create_network_tests.CreateNetworkSuccessTests) ... ok test_create_network_without_router (snaps.openstack.tests.create_network_tests.CreateNetworkSuccessTests) ... ok test_create_networks_same_name (snaps.openstack.tests.create_network_tests.CreateNetworkSuccessTests) ... ok test_create_delete_router (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_admin_state_True (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_admin_state_false (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_admin_user_to_new_project (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_external_network (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_new_user_as_admin_project (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_private_network (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_vanilla (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_with_ext_port (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... FAIL test_create_router_admin_ports (snaps.openstack.tests.create_router_tests.CreateRouterNegativeTests) ... ok test_create_router_invalid_gateway_name (snaps.openstack.tests.create_router_tests.CreateRouterNegativeTests) ... ok test_create_router_noname (snaps.openstack.tests.create_router_tests.CreateRouterNegativeTests) ... ok test_create_delete_qos (snaps.openstack.tests.create_qos_tests.CreateQoSTests) ... ok test_create_qos (snaps.openstack.tests.create_qos_tests.CreateQoSTests) ... ok test_create_same_qos (snaps.openstack.tests.create_qos_tests.CreateQoSTests) ... ok test_create_delete_volume_type (snaps.openstack.tests.create_volume_type_tests.CreateSimpleVolumeTypeSuccessTests) ... ok test_create_same_volume_type (snaps.openstack.tests.create_volume_type_tests.CreateSimpleVolumeTypeSuccessTests) ... ok test_create_volume_type (snaps.openstack.tests.create_volume_type_tests.CreateSimpleVolumeTypeSuccessTests) ... ok test_volume_type_with_encryption (snaps.openstack.tests.create_volume_type_tests.CreateVolumeTypeComplexTests) ... ok test_volume_type_with_qos (snaps.openstack.tests.create_volume_type_tests.CreateVolumeTypeComplexTests) ... ok test_volume_type_with_qos_and_encryption (snaps.openstack.tests.create_volume_type_tests.CreateVolumeTypeComplexTests) ... ok test_create_delete_volume (snaps.openstack.tests.create_volume_tests.CreateSimpleVolumeSuccessTests) ... ok test_create_same_volume (snaps.openstack.tests.create_volume_tests.CreateSimpleVolumeSuccessTests) ... ok test_create_volume_simple (snaps.openstack.tests.create_volume_tests.CreateSimpleVolumeSuccessTests) ... ok test_create_volume_bad_image (snaps.openstack.tests.create_volume_tests.CreateSimpleVolumeFailureTests) ... ok test_create_volume_bad_size (snaps.openstack.tests.create_volume_tests.CreateSimpleVolumeFailureTests) ... ok test_create_volume_bad_type (snaps.openstack.tests.create_volume_tests.CreateSimpleVolumeFailureTests) ... ok test_bad_volume_type (snaps.openstack.tests.create_volume_tests.CreateVolumeWithTypeTests) ... ok test_valid_volume_type (snaps.openstack.tests.create_volume_tests.CreateVolumeWithTypeTests) ... ok test_bad_image_name (snaps.openstack.tests.create_volume_tests.CreateVolumeWithImageTests) ... ok test_valid_volume_image (snaps.openstack.tests.create_volume_tests.CreateVolumeWithImageTests) ... ok test_check_vm_ip_dhcp (snaps.openstack.tests.create_instance_tests.SimpleHealthCheck) ... ok test_ping_via_router (snaps.openstack.tests.create_instance_tests.CreateInstanceTwoNetTests) ... FAIL test_create_admin_instance (snaps.openstack.tests.create_instance_tests.CreateInstanceSimpleTests) ... ok test_create_delete_instance (snaps.openstack.tests.create_instance_tests.CreateInstanceSimpleTests) ... ok test_set_allowed_address_pairs (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_allowed_address_pairs_bad_ip (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_allowed_address_pairs_bad_mac (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_custom_invalid_ip_one_subnet (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_custom_invalid_mac (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_custom_mac_and_ip (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_custom_valid_ip_one_subnet (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_custom_valid_mac (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_one_port_two_ip_one_subnet (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_one_port_two_ip_two_subnets (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_add_invalid_security_group (snaps.openstack.tests.create_instance_tests.InstanceSecurityGroupTests) ... ok test_add_same_security_group (snaps.openstack.tests.create_instance_tests.InstanceSecurityGroupTests) ... ok test_add_security_group (snaps.openstack.tests.create_instance_tests.InstanceSecurityGroupTests) ... ok test_remove_security_group (snaps.openstack.tests.create_instance_tests.InstanceSecurityGroupTests) ... ok test_remove_security_group_never_added (snaps.openstack.tests.create_instance_tests.InstanceSecurityGroupTests) ... ok test_deploy_vm_to_each_compute_node (snaps.openstack.tests.create_instance_tests.CreateInstanceOnComputeHost) ... ok test_create_instance_from_three_part_image (snaps.openstack.tests.create_instance_tests.CreateInstanceFromThreePartImage) ... ok test_create_instance_with_one_volume (snaps.openstack.tests.create_instance_tests.CreateInstanceVolumeTests) ... ok test_create_instance_with_two_volumes (snaps.openstack.tests.create_instance_tests.CreateInstanceVolumeTests) ... ok test_create_delete_stack (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests) ... ok test_create_same_stack (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests) ... ok test_create_stack_short_timeout (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests) ... ok test_create_stack_template_dict (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests) ... ok test_create_stack_template_file (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests) ... ok test_retrieve_network_creators (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests) ... ok test_retrieve_vm_inst_creators (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests) ... ok test_retrieve_volume_creator (snaps.openstack.tests.create_stack_tests.CreateStackVolumeTests) ... ok test_retrieve_volume_type_creator (snaps.openstack.tests.create_stack_tests.CreateStackVolumeTests) ... ok test_retrieve_flavor_creator (snaps.openstack.tests.create_stack_tests.CreateStackFlavorTests) ... ok test_retrieve_keypair_creator (snaps.openstack.tests.create_stack_tests.CreateStackKeypairTests) ... ok test_retrieve_security_group_creator (snaps.openstack.tests.create_stack_tests.CreateStackSecurityGroupTests) ... ok test_bad_stack_file (snaps.openstack.tests.create_stack_tests.CreateStackNegativeTests) ... ok test_missing_dependencies (snaps.openstack.tests.create_stack_tests.CreateStackNegativeTests) ... ok test_single_port_static (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests) ... ok test_ssh_client_fip_after_active (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests) ... ok test_ssh_client_fip_after_init (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests) ... ok test_ssh_client_fip_after_reboot (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests) ... ok test_ssh_client_fip_before_active (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests) ... ok test_ssh_client_fip_reverse_engineer (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests) ... ok test_ssh_client_fip_second_creator (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests) ... ok test_connect_via_ssh_heat_vm (snaps.openstack.tests.create_stack_tests.CreateStackFloatingIpTests) ... FAIL test_connect_via_ssh_heat_vm_derived (snaps.openstack.tests.create_stack_tests.CreateStackFloatingIpTests) ... FAIL test_apply_simple_playbook (snaps.provisioning.tests.ansible_utils_tests.AnsibleProvisioningTests) ... ok test_apply_template_playbook (snaps.provisioning.tests.ansible_utils_tests.AnsibleProvisioningTests) ... ok ====================================================================== FAIL: test_create_router_with_ext_port (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/snaps/openstack/tests/create_router_tests.py", line 419, in test_create_router_with_ext_port self.assertEqual(ext_net.id, port.network_id) AssertionError: u'05ddc763-f19d-46e9-851c-50fce0fe164d' != u'0733ceef-ab7a-4d7c-9dfa-0c7ce42ea497' - 05ddc763-f19d-46e9-851c-50fce0fe164d + 0733ceef-ab7a-4d7c-9dfa-0c7ce42ea497 ====================================================================== FAIL: test_ping_via_router (snaps.openstack.tests.create_instance_tests.CreateInstanceTwoNetTests) ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/snaps/openstack/tests/create_instance_tests.py", line 3034, in test_ping_via_router self.assertTrue(check_ping(self.inst_creators[0])) AssertionError: False is not true ====================================================================== FAIL: test_connect_via_ssh_heat_vm (snaps.openstack.tests.create_stack_tests.CreateStackFloatingIpTests) ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/snaps/openstack/tests/create_stack_tests.py", line 515, in test_connect_via_ssh_heat_vm create_instance_tests.validate_ssh_client(vm_inst_creator)) AssertionError: False is not true ====================================================================== FAIL: test_connect_via_ssh_heat_vm_derived (snaps.openstack.tests.create_stack_tests.CreateStackFloatingIpTests) ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/snaps/openstack/tests/create_stack_tests.py", line 548, in test_connect_via_ssh_heat_vm_derived create_instance_tests.validate_ssh_client(vm_inst_creator)) AssertionError: False is not true ---------------------------------------------------------------------- Ran 119 tests in 4561.998s FAILED (failures=4) 2018-04-18 12:16:32,999 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-18 12:16:33,000 - xtesting.ci.run_tests - INFO - Test result: +---------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +---------------------+------------------+------------------+----------------+ | snaps_smoke | functest | 76:02 | FAIL | +---------------------+------------------+------------------+----------------+ 2018-04-18 12:16:33,005 - xtesting.ci.run_tests - ERROR - The test case 'snaps_smoke' failed. 2018-04-18 12:16:33,005 - xtesting.ci.run_tests - INFO - Running test case 'neutron_trunk'... 2018-04-18 12:16:33,090 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-04-18 12:16:36,683 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-04-18 12:16:40,218 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | eaff409e-d21b-4120-b38b-b5865573e47f | 2018-04-18T12:16:39.471333 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: eaff409e-d21b-4120-b38b-b5865573e47f ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-04-18 12:16:44,517 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | artifact | Available | | __unknown__ | compute_legacy | Available | | __unknown__ | placement | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | designate | dns | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+----------------+-----------+ 2018-04-18 12:16:44,518 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-04-18 12:16:47,663 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify delete-verifier --id opnfv-tempest --force 2018-04-18 12:16:52,563 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide Using verifier 'opnfv-tempest' (UUID=d1419ef2-93f4-4888-b266-3c34a72b835c) as the default verifier for the future CLI operations. 2018-04-18 12:16:56,069 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-04-18 12:16:58,934 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating two images for Tempest suite 2018-04-18 12:17:03,382 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-04-18 12:17:09,781 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-04-18 12:17:09,782 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-04-18 12:17:09,782 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-04-18 12:17:09,787 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-04-18 12:17:09,793 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Generating test case list... 2018-04-18 12:17:12,900 - functest.opnfv_tests.openstack.tempest.tempest - INFO - (cd /root/.rally/verification/verifier-d1419ef2-93f4-4888-b266-3c34a72b835c/repo; stestr list 'neutron_tempest_plugin.(api|scenario).test_trunk' >/home/opnfv/functest/results/neutron_trunk/test_list.txt 2>/dev/null) 2018-04-18 12:17:12,901 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Applying tempest blacklist... 2018-04-18 12:17:12,903 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Tempest blacklist file does not exist. 2018-04-18 12:17:12,904 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', u'/home/opnfv/functest/results/neutron_trunk/test_list.txt']'. 2018-04-18 12:19:34,773 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Verification UUID: f4fe0f71-d070-4c8c-97d7-13e35cdf30e4 2018-04-18 12:19:35,063 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', 'f4fe0f71-d070-4c8c-97d7-13e35cdf30e4']'. 2018-04-18 12:19:36,210 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2018-04-18 12:19:36,210 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2018-04-18 12:19:36,210 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-04-18 12:19:36,211 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | f4fe0f71-d070-4c8c-97d7-13e35cdf30e4 | 2018-04-18 12:19:36,211 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | finished | 2018-04-18 12:19:36,211 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2018-04-18 12:17:15 | 2018-04-18 12:19:36,211 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2018-04-18 12:19:34 | 2018-04-18 12:19:36,211 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 0:02:19 | 2018-04-18 12:19:36,211 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | load_list: (value is too long, use 'detailed' flag to display it) | 2018-04-18 12:19:36,211 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2018-04-18 12:19:36,211 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: d1419ef2-93f4-4888-b266-3c34a72b835c) | 2018-04-18 12:19:36,211 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2018-04-18 12:19:36,211 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: eaff409e-d21b-4120-b38b-b5865573e47f) | 2018-04-18 12:19:36,212 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 52 | 2018-04-18 12:19:36,212 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 125.997 | 2018-04-18 12:19:36,212 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 43 | 2018-04-18 12:19:36,212 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 9 | 2018-04-18 12:19:36,212 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2018-04-18 12:19:36,212 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2018-04-18 12:19:36,212 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 0 | 2018-04-18 12:19:36,212 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-04-18 12:19:36,212 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +------------------------------------------------------------------------------------------------------------------------------------------------------+ 2018-04-18 12:19:36,214 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest neutron_trunk success_rate is 100.0% 2018-04-18 12:19:41,737 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-18 12:19:41,737 - xtesting.ci.run_tests - INFO - Test result: +-----------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-----------------------+------------------+------------------+----------------+ | neutron_trunk | functest | 02:46 | PASS | +-----------------------+------------------+------------------+----------------+ 2018-04-18 12:19:41,742 - xtesting.ci.run_tests - INFO - Xtesting report: +------------------------------+------------------+---------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +------------------------------+------------------+---------------+------------------+----------------+ | vping_ssh | functest | smoke | 00:58 | PASS | | vping_userdata | functest | smoke | 00:54 | PASS | | tempest_smoke_serial | functest | smoke | 20:44 | FAIL | | rally_sanity | functest | smoke | 31:43 | PASS | | patrole | functest | smoke | 02:45 | PASS | | snaps_smoke | functest | smoke | 76:02 | FAIL | | neutron_trunk | functest | smoke | 02:46 | PASS | | refstack_defcore | functest | smoke | 00:00 | SKIP | | odl | functest | smoke | 00:00 | SKIP | +------------------------------+------------------+---------------+------------------+----------------+ 2018-04-18 12:19:41,748 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR 2018-04-18 12:20:22,969 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-fuel-baremetal-daily-master-121 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | fuel | | DEPLOY_SCENARIO | os-nosdn-ovs-ha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod2 | +--------------------------------------+----------------------------------------------------------+ 2018-04-18 12:20:22,976 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file export OS_IDENTITY_API_VERSION=3 export OS_PROJECT_DOMAIN_NAME=Default export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_NAME=admin export OS_TENANT_NAME=admin export OS_USERNAME=admin export OS_PASSWORD=opnfv_secret export OS_REGION_NAME=RegionOne export OS_INTERFACE=internal export OS_ENDPOINT_TYPE="internal" export OS_CACERT="/etc/ssl/certs/mcp_os_cacert" export VOLUME_DEVICE_NAME=vdc export OS_AUTH_URL=http://10.167.4.35:35357/v3 2018-04-18 12:20:22,976 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-04-18 12:20:22,978 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +------------------+---------------+--------------------------+-------------------------------------------+-----------------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +------------------+---------------+--------------------------+-------------------------------------------+-----------------------------+ | features | 2 | (daily)|(weekly) | Test suites from feature projects | doctor-notification | | | | | integrated in functest | | +------------------+---------------+--------------------------+-------------------------------------------+-----------------------------+ 2018-04-18 12:20:22,980 - xtesting.ci.run_tests - INFO - Running tier 'features' 2018-04-18 12:20:22,980 - xtesting.ci.run_tests - INFO - Running test case 'doctor-notification'... 2018-04-18 12:20:26,726 - xtesting.core.feature - ERROR - Execute command: doctor-test failed 2018-04-18 12:20:26,728 - xtesting.core.feature - INFO - Test result is stored in '/var/lib/xtesting/results/doctor-notification.log' 2018-04-18 12:20:26,850 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-18 12:20:26,851 - xtesting.ci.run_tests - INFO - Test result: +-----------------------------+-----------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-----------------------------+-----------------+------------------+----------------+ | doctor-notification | doctor | 00:04 | FAIL | +-----------------------------+-----------------+------------------+----------------+ 2018-04-18 12:20:26,854 - xtesting.ci.run_tests - ERROR - The test case 'doctor-notification' failed. 2018-04-18 12:20:26,855 - xtesting.ci.run_tests - INFO - Xtesting report: +-----------------------------+------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +-----------------------------+------------------------+------------------+------------------+----------------+ | doctor-notification | doctor | features | 00:04 | FAIL | | bgpvpn | sdnvpn | features | 00:00 | SKIP | | functest-odl-sfc | sfc | features | 00:00 | SKIP | | barometercollectd | barometer | features | 00:00 | SKIP | | fds | fastdatastacks | features | 00:00 | SKIP | +-----------------------------+------------------------+------------------+------------------+----------------+ 2018-04-18 12:20:26,859 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR 2018-04-18 12:22:58,382 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-fuel-baremetal-daily-master-121 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | fuel | | DEPLOY_SCENARIO | os-nosdn-ovs-ha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod2 | +--------------------------------------+----------------------------------------------------------+ 2018-04-18 12:22:58,384 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file export OS_IDENTITY_API_VERSION=3 export OS_PROJECT_DOMAIN_NAME=Default export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_NAME=admin export OS_TENANT_NAME=admin export OS_USERNAME=admin export OS_PASSWORD=opnfv_secret export OS_REGION_NAME=RegionOne export OS_INTERFACE=internal export OS_ENDPOINT_TYPE="internal" export OS_CACERT="/etc/ssl/certs/mcp_os_cacert" export VOLUME_DEVICE_NAME=vdc export OS_AUTH_URL=http://10.167.4.35:35357/v3 2018-04-18 12:22:58,385 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-04-18 12:22:58,385 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------+---------------+-----------------+---------------------+-------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------+---------------+-----------------+---------------------+-------------------+ +---------------+---------------+-----------------+---------------------+-------------------+ 2018-04-18 12:22:58,385 - xtesting.ci.run_tests - INFO - Xtesting report: +----------------------+------------------+--------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +----------------------+------------------+--------------+------------------+----------------+ | cloudify_ims | functest | vnf | 00:00 | SKIP | | vyos_vrouter | functest | vnf | 00:00 | SKIP | | juju_epc | functest | vnf | 00:00 | SKIP | +----------------------+------------------+--------------+------------------+----------------+ 2018-04-18 12:22:58,386 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK 2018-04-18 12:23:11,895 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-fuel-baremetal-daily-master-121 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | fuel | | DEPLOY_SCENARIO | os-nosdn-ovs-ha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod2 | +--------------------------------------+----------------------------------------------------------+ 2018-04-18 12:23:11,900 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file export OS_IDENTITY_API_VERSION=3 export OS_PROJECT_DOMAIN_NAME=Default export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_NAME=admin export OS_TENANT_NAME=admin export OS_USERNAME=admin export OS_PASSWORD=opnfv_secret export OS_REGION_NAME=RegionOne export OS_INTERFACE=internal export OS_ENDPOINT_TYPE="internal" export OS_CACERT="/etc/ssl/certs/mcp_os_cacert" export VOLUME_DEVICE_NAME=vdc export OS_AUTH_URL=http://10.167.4.35:35357/v3 2018-04-18 12:23:11,900 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-04-18 12:23:11,902 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +------------------+---------------+--------------------------+-------------------------------------------+-----------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +------------------+---------------+--------------------------+-------------------------------------------+-----------------------+ | features | 2 | (daily)|(weekly) | Test suites from feature projects | parser-basics | | | | | integrated in functest | | +------------------+---------------+--------------------------+-------------------------------------------+-----------------------+ 2018-04-18 12:23:11,904 - xtesting.ci.run_tests - INFO - Running tier 'features' 2018-04-18 12:23:11,904 - xtesting.ci.run_tests - INFO - Running test case 'parser-basics'... 2018-04-18 12:26:01,900 - xtesting.core.feature - INFO - Test result is stored in '/var/lib/xtesting/results/parser-basics.log' 2018-04-18 12:26:02,019 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-18 12:26:02,020 - xtesting.ci.run_tests - INFO - Test result: +-----------------------+-----------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-----------------------+-----------------+------------------+----------------+ | parser-basics | parser | 02:50 | PASS | +-----------------------+-----------------+------------------+----------------+ 2018-04-18 12:26:02,023 - xtesting.ci.run_tests - INFO - Xtesting report: +-----------------------+-----------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +-----------------------+-----------------+------------------+------------------+----------------+ | parser-basics | parser | features | 02:50 | PASS | +-----------------------+-----------------+------------------+------------------+----------------+ 2018-04-18 12:26:02,025 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK