2018-01-30 20:00:47,997 - functest.ci.check_deployment - DEBUG - 192.168.11.20:35357 is reachable!
2018-01-30 20:00:47,998 - functest.ci.check_deployment - INFO - Connectivity to OS_AUTH_URL http://192.168.11.20:35357/v3 ...OK
2018-01-30 20:00:48,540 - functest.ci.check_deployment - INFO - Got token ...OK
2018-01-30 20:00:49,000 - functest.ci.check_deployment - DEBUG - 192.168.11.20:5000 is reachable!
2018-01-30 20:00:49,000 - functest.ci.check_deployment - INFO - Connectivity to the public endpoint http://192.168.11.20:5000 ...OK
2018-01-30 20:00:49,444 - functest.ci.check_deployment - DEBUG - 192.168.11.20:8774 is reachable!
2018-01-30 20:00:49,444 - functest.ci.check_deployment - INFO - Connectivity to endpoint 'compute' http://192.168.11.20:8774/v2.1/2b2f48c2aa504a4eb5ae7f51ceb21ef8 ...OK
2018-01-30 20:00:49,886 - functest.ci.check_deployment - DEBUG - 192.168.11.20:9696 is reachable!
2018-01-30 20:00:49,886 - functest.ci.check_deployment - INFO - Connectivity to endpoint 'network' http://192.168.11.20:9696 ...OK
2018-01-30 20:00:50,323 - functest.ci.check_deployment - DEBUG - 192.168.11.20:9292 is reachable!
2018-01-30 20:00:50,323 - functest.ci.check_deployment - INFO - Connectivity to endpoint 'image' http://192.168.11.20:9292 ...OK
2018-01-30 20:00:51,084 - functest.ci.check_deployment - INFO - Nova service ...OK
2018-01-30 20:00:52,609 - functest.ci.check_deployment - INFO - Neutron service ...OK
2018-01-30 20:00:52,634 - functest.ci.check_deployment - INFO - Glance service ...OK
2018-01-30 20:00:54,116 - functest.ci.check_deployment - INFO - External network found: admin_external
2018-01-30 20:00:56,627 - functest.ci.run_tests - DEBUG - Sourcing the OpenStack RC file...
2018-01-30 20:00:56,628 - functest.ci.run_tests - DEBUG - Test args: all
2018-01-30 20:00:56,629 - functest.ci.run_tests - INFO - TESTS TO BE EXECUTED:

+---------------------+---------------+--------------------------+-------------------------------------------------+------------------------------------+
|        TIERS        |     ORDER     |         CI LOOP          |                   DESCRIPTION                   |             TESTCASES              |
+---------------------+---------------+--------------------------+-------------------------------------------------+------------------------------------+
|     healthcheck     |       0       |     (daily)|(weekly)     |     First tier to be executed to verify the     |     connection_check api_check     |
|                     |               |                          |           basic operations in the VIM.          |         snaps_health_check         |
+---------------------+---------------+--------------------------+-------------------------------------------------+------------------------------------+

2018-01-30 20:00:56,631 - functest.ci.run_tests - INFO - Running tier 'healthcheck'
2018-01-30 20:00:56,632 - functest.ci.run_tests - INFO - Running test case 'connection_check'...
2018-01-30 20:00:58,228 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None'
2018-01-30 20:01:07,885 - functest.core.unit - DEBUG - 

test_glance_connect_fail (snaps.openstack.utils.tests.glance_utils_tests.GlanceSmokeTests) ... ok
test_glance_connect_success (snaps.openstack.utils.tests.glance_utils_tests.GlanceSmokeTests) ... ok
test_keystone_connect_fail (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneSmokeTests) ... ok
test_keystone_connect_success (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneSmokeTests) ... ok
test_neutron_connect_fail (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok
test_neutron_connect_success (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok
test_retrieve_ext_network_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok
test_nova_connect_fail (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok
test_nova_connect_success (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok
test_nova_get_hypervisor_hosts (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok
test_heat_connect_fail (snaps.openstack.utils.tests.heat_utils_tests.HeatSmokeTests) ... ok
test_heat_connect_success (snaps.openstack.utils.tests.heat_utils_tests.HeatSmokeTests) ... ok
test_cinder_connect_fail (snaps.openstack.utils.tests.cinder_utils_tests.CinderSmokeTests) ... ok
test_cinder_connect_success (snaps.openstack.utils.tests.cinder_utils_tests.CinderSmokeTests) ... ok

----------------------------------------------------------------------
Ran 14 tests in 9.653s

OK

2018-01-30 20:01:07,885 - functest.core.testcase - ERROR - Please set env var: 'TEST_DB_URL'
2018-01-30 20:01:07,887 - functest.ci.run_tests - INFO - Test result:

+--------------------------+------------------+------------------+----------------+
|        TEST CASE         |     PROJECT      |     DURATION     |     RESULT     |
+--------------------------+------------------+------------------+----------------+
|     connection_check     |     functest     |      00:10       |      PASS      |
+--------------------------+------------------+------------------+----------------+

2018-01-30 20:01:07,890 - functest.ci.run_tests - INFO - Running test case 'api_check'...
2018-01-30 20:01:08,656 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None'
2018-01-30 20:09:37,071 - functest.core.unit - DEBUG - 

test_create_project_minimal (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok
test_create_user_minimal (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok
test_get_endpoint_fail_without_proper_credentials (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok
test_get_endpoint_fail_without_proper_service (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok
test_get_endpoint_success (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok
test_get_endpoint_with_each_interface (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok
test_grant_user_role_to_project (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok
test_create_admin_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok
test_create_delete_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok
test_create_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok
test_create_user_2x (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok
test_create_delete_project (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok
test_create_project (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok
test_create_project_2x (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok
test_create_project_bad_domain (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok
test_update_quotas (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok
test_create_project_sec_grp_one_user (snaps.openstack.tests.create_project_tests.CreateProjectUserTests) ... ok
test_create_project_sec_grp_two_users (snaps.openstack.tests.create_project_tests.CreateProjectUserTests) ... ok
test_create_image_minimal_file (snaps.openstack.utils.tests.glance_utils_tests.GlanceUtilsTests) ... ok
test_create_image_minimal_url (snaps.openstack.utils.tests.glance_utils_tests.GlanceUtilsTests) ... ok
test_create_network (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok
test_create_network_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok
test_create_network_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok
test_create_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok
test_create_subnet_empty_cidr (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok
test_create_subnet_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok
test_create_subnet_null_cidr (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok
test_create_subnet_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok
test_add_interface_router (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok
test_add_interface_router_missing_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok
test_add_interface_router_null_router (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok
test_add_interface_router_null_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok
test_create_port (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok
test_create_port_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok
test_create_port_invalid_ip (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok
test_create_port_invalid_ip_to_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok
test_create_port_null_ip (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok
test_create_port_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok
test_create_port_null_network_object (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok
test_create_router_simple (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok
test_create_router_with_public_interface (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok
test_create_delete_simple_sec_grp (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok
test_create_sec_grp_no_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok
test_create_sec_grp_no_rules (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok
test_create_sec_grp_one_rule (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok
test_get_sec_grp_by_id (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok
test_floating_ips (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsFloatingIpTests) ... ok
test_create_delete_keypair (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok
test_create_key_from_file (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok
test_create_keypair (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok
test_create_delete_flavor (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsFlavorTests) ... ok
test_create_flavor (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsFlavorTests) ... ok
test_create_instance (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceTests) ... ok
test_add_remove_volume (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok
test_create_clean_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok
test_create_delete_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok
test_create_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok
test_create_flavor_all_settings (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok
test_create_flavor_existing (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok
test_create_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateSimpleStackTests) ... ok
test_create_stack_x2 (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateSimpleStackTests) ... ok
test_get_settings_from_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateComplexStackTests) ... ok
test_create_flavor_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsFlavorTests) ... ok
test_create_keypair_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsKeypairTests) ... ok
test_create_security_group_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsSecurityGroupTests) ... ok
test_create_delete_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok
test_create_qos_back (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok
test_create_qos_both (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok
test_create_qos_front (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok
test_create_delete_volume (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTests) ... ok
test_create_simple_volume (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTests) ... ok
test_create_delete_volume_type (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsSimpleVolumeTypeTests) ... ok
test_create_simple_volume_type (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsSimpleVolumeTypeTests) ... ok
test_create_bad_key_size (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok
test_create_delete_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok
test_create_simple_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok
test_create_with_all_attrs (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok
test_create_with_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok
test_create_with_invalid_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok
test_create_with_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok
test_create_with_qos_and_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok

----------------------------------------------------------------------
Ran 81 tests in 508.405s

OK

2018-01-30 20:09:37,072 - functest.core.testcase - ERROR - Please set env var: 'TEST_DB_URL'
2018-01-30 20:09:37,072 - functest.ci.run_tests - INFO - Test result:

+-------------------+------------------+------------------+----------------+
|     TEST CASE     |     PROJECT      |     DURATION     |     RESULT     |
+-------------------+------------------+------------------+----------------+
|     api_check     |     functest     |      08:28       |      PASS      |
+-------------------+------------------+------------------+----------------+

2018-01-30 20:09:37,076 - functest.ci.run_tests - INFO - Running test case 'snaps_health_check'...
2018-01-30 20:09:37,922 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None'
2018-01-30 20:10:13,605 - functest.core.unit - DEBUG - 

test_check_vm_ip_dhcp (snaps.openstack.tests.create_instance_tests.SimpleHealthCheck) ... ok

----------------------------------------------------------------------
Ran 1 test in 35.682s

OK

2018-01-30 20:10:13,606 - functest.core.testcase - ERROR - Please set env var: 'TEST_DB_URL'
2018-01-30 20:10:13,607 - functest.ci.run_tests - INFO - Test result:

+----------------------------+------------------+------------------+----------------+
|         TEST CASE          |     PROJECT      |     DURATION     |     RESULT     |
+----------------------------+------------------+------------------+----------------+
|     snaps_health_check     |     functest     |      00:36       |      PASS      |
+----------------------------+------------------+------------------+----------------+

2018-01-30 20:10:13,611 - functest.ci.run_tests - INFO - Deployment description:

+-------------------------+-----------------------------------------------------------+
|         ENV VAR         |                           VALUE                           |
+-------------------------+-----------------------------------------------------------+
|      INSTALLER_TYPE     |                           daisy                           |
|     DEPLOY_SCENARIO     |                    os-odl-nofeature-ha                    |
|        BUILD_TAG        |     jenkins-functest-daisy-baremetal-daily-master-279     |
|         CI_LOOP         |                           daily                           |
+-------------------------+-----------------------------------------------------------+

2018-01-30 20:10:13,613 - functest.ci.run_tests - INFO - FUNCTEST REPORT:

+----------------------------+------------------+---------------------+------------------+----------------+
|         TEST CASE          |     PROJECT      |         TIER        |     DURATION     |     RESULT     |
+----------------------------+------------------+---------------------+------------------+----------------+
|      connection_check      |     functest     |     healthcheck     |      00:10       |      PASS      |
|         api_check          |     functest     |     healthcheck     |      08:28       |      PASS      |
|     snaps_health_check     |     functest     |     healthcheck     |      00:36       |      PASS      |
+----------------------------+------------------+---------------------+------------------+----------------+

2018-01-30 20:10:13,616 - functest.ci.run_tests - INFO - Execution exit value: Result.EX_OK
2018-01-30 20:10:38,569 - functest.ci.run_tests - DEBUG - Sourcing the OpenStack RC file...
2018-01-30 20:10:38,569 - functest.ci.run_tests - DEBUG - Test args: all
2018-01-30 20:10:38,571 - functest.ci.run_tests - INFO - TESTS TO BE EXECUTED:

+---------------+---------------+--------------------------+------------------------------------------+-------------------------------------------+
|     TIERS     |     ORDER     |         CI LOOP          |               DESCRIPTION                |                 TESTCASES                 |
+---------------+---------------+--------------------------+------------------------------------------+-------------------------------------------+
|     smoke     |       1       |     (daily)|(weekly)     |     Set of basic Functional tests to     |          vping_ssh vping_userdata         |
|               |               |                          |      validate the OPNFV scenarios.       |     tempest_smoke_serial rally_sanity     |
|               |               |                          |                                          |      refstack_defcore odl snaps_smoke     |
+---------------+---------------+--------------------------+------------------------------------------+-------------------------------------------+

2018-01-30 20:10:38,573 - functest.ci.run_tests - INFO - Running tier 'smoke'
2018-01-30 20:10:38,573 - functest.ci.run_tests - INFO - Running test case 'vping_ssh'...
2018-01-30 20:10:39,645 - functest.energy.energy - INFO - API recorder available at : http://energy.opnfv.fr/resources/recorders/environment/zte-pod3
2018-01-30 20:10:39,645 - functest.energy.energy - DEBUG - Getting current scenario
2018-01-30 20:10:40,357 - functest.energy.energy - INFO - No current running scenario at http://energy.opnfv.fr/resources/recorders/environment/zte-pod3
2018-01-30 20:10:40,357 - functest.energy.energy - DEBUG - Starting recording
2018-01-30 20:10:40,357 - functest.energy.energy - DEBUG - Submitting scenario (vping_ssh/running)
2018-01-30 20:10:41,062 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin virtual environment setup
2018-01-30 20:10:41,062 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing Start Time:'2018-01-30 20:10:41'
2018-01-30 20:10:41,062 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating image with name: 'functest-vping--9557fddf-9ec7-4338-b4f4-d9f69ff9e8aa'
2018-01-30 20:10:42,679 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating network with name: 'vping-net-9557fddf-9ec7-4338-b4f4-d9f69ff9e8aa'
2018-01-30 20:10:45,808 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating router with name: 'vping-router-9557fddf-9ec7-4338-b4f4-d9f69ff9e8aa'
2018-01-30 20:10:51,274 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating flavor with name: 'vping-flavor-9557fddf-9ec7-4338-b4f4-d9f69ff9e8aa'
2018-01-30 20:10:52,042 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating keypair with name: 'vPing-keypair-9557fddf-9ec7-4338-b4f4-d9f69ff9e8aa'
2018-01-30 20:10:52,806 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 1 instance with name: 'opnfv-vping-1-9557fddf-9ec7-4338-b4f4-d9f69ff9e8aa'
2018-01-30 20:10:58,247 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Security group with name: 'vPing-sg-9557fddf-9ec7-4338-b4f4-d9f69ff9e8aa'
2018-01-30 20:11:01,437 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 2 instance with name: 'opnfv-vping-2-9557fddf-9ec7-4338-b4f4-d9f69ff9e8aa'
2018-01-30 20:11:23,656 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin test execution
2018-01-30 20:11:28,856 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Trying to transfer ping.sh
2018-01-30 20:11:28,937 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Waiting for ping...
2018-01-30 20:11:29,948 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing detected!
2018-01-30 20:11:47,564 - functest.energy.energy - DEBUG - Stopping recording
2018-01-30 20:11:48,313 - functest.core.testcase - ERROR - Please set env var: 'TEST_DB_URL'
2018-01-30 20:11:48,314 - functest.ci.run_tests - INFO - Test result:

+-------------------+------------------+------------------+----------------+
|     TEST CASE     |     PROJECT      |     DURATION     |     RESULT     |
+-------------------+------------------+------------------+----------------+
|     vping_ssh     |     functest     |      00:49       |      PASS      |
+-------------------+------------------+------------------+----------------+

2018-01-30 20:11:48,317 - functest.ci.run_tests - INFO - Running test case 'vping_userdata'...
2018-01-30 20:11:48,393 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin virtual environment setup
2018-01-30 20:11:48,393 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing Start Time:'2018-01-30 20:11:48'
2018-01-30 20:11:48,394 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating image with name: 'functest-vping--3e943a3a-e8ef-4e9e-81a1-42b1a51cf2e5'
2018-01-30 20:11:51,070 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating network with name: 'vping-net-3e943a3a-e8ef-4e9e-81a1-42b1a51cf2e5'
2018-01-30 20:11:53,663 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating router with name: 'vping-router-3e943a3a-e8ef-4e9e-81a1-42b1a51cf2e5'
2018-01-30 20:11:59,574 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating flavor with name: 'vping-flavor-3e943a3a-e8ef-4e9e-81a1-42b1a51cf2e5'
2018-01-30 20:12:00,276 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 1 instance with name: 'opnfv-vping-1-3e943a3a-e8ef-4e9e-81a1-42b1a51cf2e5'
2018-01-30 20:12:06,545 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 2 instance with name: 'opnfv-vping-2-3e943a3a-e8ef-4e9e-81a1-42b1a51cf2e5'
2018-01-30 20:12:11,173 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin test execution
2018-01-30 20:12:23,055 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Waiting for ping...
2018-01-30 20:12:25,492 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing detected!
2018-01-30 20:12:41,250 - functest.core.testcase - ERROR - Please set env var: 'TEST_DB_URL'
2018-01-30 20:12:41,251 - functest.ci.run_tests - INFO - Test result:

+------------------------+------------------+------------------+----------------+
|       TEST CASE        |     PROJECT      |     DURATION     |     RESULT     |
+------------------------+------------------+------------------+----------------+
|     vping_userdata     |     functest     |      00:37       |      PASS      |
+------------------------+------------------+------------------+----------------+

2018-01-30 20:12:41,255 - functest.ci.run_tests - INFO - Running test case 'tempest_smoke_serial'...
2018-01-30 20:12:41,345 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment...
2018-01-30 20:12:44,945 - functest.utils.functest_utils - DEBUG - Executing command: 'rally deployment create --fromenv --name=opnfv-rally'
2018-01-30 20:12:48,598 - functest.utils.functest_utils - DEBUG - Executing command: 'rally deployment check'
2018-01-30 20:12:53,306 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo...
2018-01-30 20:12:56,864 - functest.utils.functest_utils - DEBUG - Executing command: 'rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide'
2018-01-30 20:13:06,774 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite
2018-01-30 20:13:08,862 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating image for Tempest suite
2018-01-30 20:13:08,862 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating image for Tempest suite
2018-01-30 20:13:11,650 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Configuring the verifier...
2018-01-30 20:13:11,650 - functest.utils.functest_utils - DEBUG - Executing command: 'rally verify configure-verifier'
2018-01-30 20:13:15,990 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file...
2018-01-30 20:13:15,990 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters...
2018-01-30 20:13:15,992 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file
2018-01-30 20:13:15,995 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Generating test case list...
2018-01-30 20:13:15,995 - functest.utils.functest_utils - DEBUG - Executing command: 'cd /root/.rally/verification/verifier-ba0bb091-9990-4427-b40c-c75e5607d028/repo;testr list-tests smoke > /home/opnfv/functest/results/tempest/test_raw_list.txt;cd -;'
2018-01-30 20:13:19,737 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Applying tempest blacklist...
2018-01-30 20:13:19,739 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Tempest blacklist file does not exist.
2018-01-30 20:13:19,740 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: 'rally verify start --concurrency 1 --load-list /home/opnfv/functest/results/tempest/test_list.txt --detailed'.
2018-01-30 20:13:23,187 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:13:23.186 62 INFO rally.api [-] Starting verification (UUID=1a9e8c92-5640-4ab0-886a-7ac6173aa5d2) for deployment 'opnfv-rally' (UUID=0c0d4985-ed77-4a3d-9b06-d53d3c2946af) by verifier 'opnfv-tempest' (UUID=ba0bb091-9990-4427-b40c-c75e5607d028).
2018-01-30 20:13:23,187 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Verification UUID: 1a9e8c92-5640-4ab0-886a-7ac6173aa5d2
2018-01-30 20:13:30,263 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:13:30.263 62 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor ... success [0.089s]
2018-01-30 20:13:30,356 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:13:30.356 62 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.093s]
2018-01-30 20:13:37,544 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:13:37.543 62 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create ... success [1.106s]
2018-01-30 20:13:39,088 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:13:39.088 62 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list ... success [1.543s]
2018-01-30 20:13:49,091 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:13:49.090 62 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete ... success [3.072s]
2018-01-30 20:14:07,077 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:14:07.077 62 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip ... success [11.244s]
2018-01-30 20:14:43,374 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:14:43.374 62 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_list_servers ... success [0.121s]
2018-01-30 20:14:43,375 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:14:43.374 62 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_verify_server_details ... success [0.001s]
2018-01-30 20:15:19,901 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:15:19.901 62 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers ... success [0.139s]
2018-01-30 20:15:19,902 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:15:19.902 62 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details ... success [0.001s]
2018-01-30 20:15:53,456 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:15:53.455 62 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers ... success [0.115s]
2018-01-30 20:15:53,457 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:15:53.456 62 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details ... success [0.001s]
2018-01-30 20:19:35,885 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:19:35.884 62 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard ... fail [188.441s]
2018-01-30 20:20:02,268 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:20:02.264 62 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses ... success [0.086s]
2018-01-30 20:20:02,428 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:20:02.428 62 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network ... success [0.164s]
2018-01-30 20:20:11,090 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:20:11.090 62 INFO opnfv-tempest [-] {0} tempest.api.compute.test_versions.TestVersions.test_get_version_details ... success [0.931s]
2018-01-30 20:20:11,101 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:20:11.100 62 INFO opnfv-tempest [-] {0} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.011s]
2018-01-30 20:20:12,816 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:20:12.816 62 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v2.test_services.ServicesTestJSON ... skip: Identity api v2 is not enabled
2018-01-30 20:20:12,817 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:20:12.816 62 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v2.test_users.UsersTestJSON ... skip: Identity api v2 is not enabled
2018-01-30 20:20:17,072 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:20:17.072 62 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete ... success [0.250s]
2018-01-30 20:20:23,534 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:20:23.533 62 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists ... success [0.038s]
2018-01-30 20:20:30,574 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:20:30.574 62 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain ... success [0.577s]
2018-01-30 20:20:38,395 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:20:38.395 62 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint ... success [0.413s]
2018-01-30 20:20:47,452 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:20:47.452 62 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete ... success [2.778s]
2018-01-30 20:20:54,252 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:20:54.252 62 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy ... success [0.425s]
2018-01-30 20:21:00,784 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:21:00.783 62 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id ... success [0.125s]
2018-01-30 20:21:08,159 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:21:08.159 62 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_show_list ... success [0.240s]
2018-01-30 20:21:15,808 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:21:15.808 62 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service ... success [0.276s]
2018-01-30 20:21:24,687 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:21:24.686 62 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all ... success [2.799s]
2018-01-30 20:21:27,565 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:21:27.565 62 INFO opnfv-tempest [-] {0} tempest.api.identity.v2.test_api_discovery.TestApiDiscovery ... skip: Identity api v2 is not enabled
2018-01-30 20:21:29,767 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:21:29.766 62 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.073s]
2018-01-30 20:21:29,787 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:21:29.786 62 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.020s]
2018-01-30 20:21:29,811 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:21:29.810 62 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.024s]
2018-01-30 20:21:29,819 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:21:29.818 62 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_list_api_versions ... success [0.007s]
2018-01-30 20:21:34,033 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:21:34.033 62 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [0.510s]
2018-01-30 20:21:34,817 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:21:34.816 62 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file ... success [0.782s]
2018-01-30 20:21:35,893 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:21:35.893 62 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [1.076s]
2018-01-30 20:21:41,892 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:21:41.892 62 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_versions.VersionsTest.test_list_versions ... success [0.007s]
2018-01-30 20:21:46,879 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:21:46.878 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions ... success [0.876s]
2018-01-30 20:22:02,693 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:22:02.693 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address ... success [3.475s]
2018-01-30 20:22:07,193 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:22:07.193 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip ... success [4.499s]
2018-01-30 20:22:21,245 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:22:21.244 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_network ... success [3.433s]
2018-01-30 20:22:25,310 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:22:25.310 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_port ... success [4.064s]
2018-01-30 20:22:35,429 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:22:35.429 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_subnet ... success [10.118s]
2018-01-30 20:22:48,049 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:22:48.049 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_network ... success [3.588s]
2018-01-30 20:22:52,081 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:22:52.081 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_port ... success [4.030s]
2018-01-30 20:22:59,059 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:22:59.059 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_subnet ... success [6.977s]
2018-01-30 20:23:18,206 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:23:18.206 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_update_delete_network_subnet ... success [5.070s]
2018-01-30 20:23:18,441 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:23:18.440 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_external_network_visibility ... success [0.234s]
2018-01-30 20:23:18,639 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:23:18.639 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_networks ... success [0.197s]
2018-01-30 20:23:18,732 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:23:18.732 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_subnets ... success [0.093s]
2018-01-30 20:23:18,906 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:23:18.906 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_network ... success [0.173s]
2018-01-30 20:23:18,999 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:23:18.998 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_subnet ... success [0.092s]
2018-01-30 20:23:32,977 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:23:32.976 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [5.017s]
2018-01-30 20:23:33,202 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:23:33.202 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_external_network_visibility ... success [0.225s]
2018-01-30 20:23:33,436 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:23:33.436 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.234s]
2018-01-30 20:23:33,525 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:23:33.524 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.087s]
2018-01-30 20:23:33,699 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:23:33.699 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.173s]
2018-01-30 20:23:33,794 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:23:33.793 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.094s]
2018-01-30 20:23:47,684 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:23:47.683 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools ... success [5.093s]
2018-01-30 20:23:53,711 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:23:53.710 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups ... success [6.026s]
2018-01-30 20:23:56,237 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:23:56.236 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port ... success [2.526s]
2018-01-30 20:23:56,503 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:23:56.503 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports ... success [0.266s]
2018-01-30 20:23:56,593 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:23:56.593 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port ... success [0.090s]
2018-01-30 20:24:10,741 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:24:10.740 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [5.159s]
2018-01-30 20:24:17,427 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:24:17.426 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups ... success [6.686s]
2018-01-30 20:24:19,746 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:24:19.746 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [2.318s]
2018-01-30 20:24:19,843 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:24:19.843 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.097s]
2018-01-30 20:24:19,977 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:24:19.976 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.133s]
2018-01-30 20:24:38,339 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:24:38.338 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces ... success [11.961s]
2018-01-30 20:24:45,213 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:24:45.212 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id ... success [6.874s]
2018-01-30 20:24:51,134 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:24:51.134 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id ... success [5.921s]
2018-01-30 20:24:55,063 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:24:55.063 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router ... success [3.929s]
2018-01-30 20:25:21,318 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:25:21.317 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces ... success [11.837s]
2018-01-30 20:25:29,139 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:25:29.139 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id ... success [7.821s]
2018-01-30 20:25:35,476 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:25:35.476 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id ... success [6.336s]
2018-01-30 20:25:39,448 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:25:39.448 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router ... success [3.971s]
2018-01-30 20:25:55,464 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:25:55.464 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group ... success [1.452s]
2018-01-30 20:25:57,450 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:25:57.450 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule ... success [1.983s]
2018-01-30 20:25:57,575 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:25:57.574 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups ... success [0.127s]
2018-01-30 20:26:02,373 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:26:02.373 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.352s]
2018-01-30 20:26:04,365 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:26:04.364 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [1.989s]
2018-01-30 20:26:04,444 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:26:04.444 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.081s]
2018-01-30 20:26:08,698 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:26:08.697 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [0.702s]
2018-01-30 20:26:12,342 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:26:12.342 62 INFO opnfv-tempest [-] {0} tempest.api.network.test_versions.NetworksApiDiscovery.test_api_version_resources ... success [0.007s]
2018-01-30 20:26:13,820 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:26:13.819 62 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_quotas.AccountQuotasTest ... skip: AccountQuotasTest skipped as swift is not available
2018-01-30 20:26:13,820 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:26:13.820 62 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_services.AccountTest ... skip: AccountTest skipped as swift is not available
2018-01-30 20:26:13,827 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:26:13.821 62 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest ... skip: ContainerQuotasTest skipped as swift is not available
2018-01-30 20:26:13,827 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:26:13.821 62 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_services.ContainerTest ... skip: ContainerTest skipped as swift is not available
2018-01-30 20:26:13,828 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:26:13.822 62 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_object_services.ObjectTest ... skip: ObjectTest skipped as swift is not available
2018-01-30 20:26:16,199 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:26:16.198 62 INFO opnfv-tempest [-] {0} tempest.api.volume.test_versions.VersionsTest.test_list_versions ... success [0.227s]
2018-01-30 20:26:31,680 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:26:31.680 62 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_attach_detach_volume_to_instance ... success [10.193s]
2018-01-30 20:26:43,413 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:26:43.413 62 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [6.515s]
2018-01-30 20:26:53,363 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:26:53.363 62 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [9.947s]
2018-01-30 20:27:02,296 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:27:02.295 62 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.072s]
2018-01-30 20:30:12,077 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:30:12.076 62 INFO opnfv-tempest [-] {0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops ... fail [183.020s]
2018-01-30 20:30:48,358 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:30:48.357 62 INFO opnfv-tempest [-] {0} tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basic_ops ... success [25.438s]
2018-01-30 20:31:38,518 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-30 20:31:38.517 62 INFO opnfv-tempest [-] {0} tempest.scenario.test_server_multinode.TestServerMultinode.test_schedule_to_all_nodes ... success [28.006s]
2018-01-30 20:31:55,250 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: 'rally verify show --uuid 1a9e8c92-5640-4ab0-886a-7ac6173aa5d2'.
2018-01-30 20:31:56,628 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+

2018-01-30 20:31:56,629 - functest.opnfv_tests.openstack.tempest.tempest - INFO - |                                      Verification                                       |

2018-01-30 20:31:56,629 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+

2018-01-30 20:31:56,629 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID                | 1a9e8c92-5640-4ab0-886a-7ac6173aa5d2                              |

2018-01-30 20:31:56,629 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status              | failed                                                            |

2018-01-30 20:31:56,629 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at          | 2018-01-30 20:13:23                                               |

2018-01-30 20:31:56,629 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at         | 2018-01-30 20:31:55                                               |

2018-01-30 20:31:56,630 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration            | 0:18:32                                                           |

2018-01-30 20:31:56,630 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments       | concurrency: 1                                                    |

2018-01-30 20:31:56,630 - functest.opnfv_tests.openstack.tempest.tempest - INFO - |                     | load_list: (value is too long, use 'detailed' flag to display it) |

2018-01-30 20:31:56,630 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags                | -                                                                 |

2018-01-30 20:31:56,630 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name       | opnfv-tempest (UUID: ba0bb091-9990-4427-b40c-c75e5607d028)        |

2018-01-30 20:31:56,630 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type       | tempest (platform: openstack)                                     |

2018-01-30 20:31:56,630 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name     | opnfv-rally (UUID: 0c0d4985-ed77-4a3d-9b06-d53d3c2946af)          |

2018-01-30 20:31:56,630 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count         | 109                                                               |

2018-01-30 20:31:56,630 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 1090.605                                                          |

2018-01-30 20:31:56,631 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success             | 88                                                                |

2018-01-30 20:31:56,631 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped             | 19                                                                |

2018-01-30 20:31:56,631 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures   | 0                                                                 |

2018-01-30 20:31:56,631 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success  | 0                                                                 |

2018-01-30 20:31:56,631 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures            | 2                                                                 |

2018-01-30 20:31:56,631 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+

2018-01-30 20:31:56,631 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------------------------------------------------------------------+

2018-01-30 20:31:56,740 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest tempest_smoke_serial success_rate is 97.7777777778%
2018-01-30 20:32:00,636 - functest.core.testcase - ERROR - Please set env var: 'TEST_DB_URL'
2018-01-30 20:32:00,636 - functest.ci.run_tests - INFO - Test result:

+------------------------------+------------------+------------------+----------------+
|          TEST CASE           |     PROJECT      |     DURATION     |     RESULT     |
+------------------------------+------------------+------------------+----------------+
|     tempest_smoke_serial     |     functest     |      18:54       |      FAIL      |
+------------------------------+------------------+------------------+----------------+

2018-01-30 20:32:00,641 - functest.ci.run_tests - ERROR - The test case 'tempest_smoke_serial' failed.
2018-01-30 20:32:00,641 - functest.ci.run_tests - INFO - Running test case 'rally_sanity'...
2018-01-30 20:32:00,722 - functest.energy.energy - DEBUG - Getting current scenario
2018-01-30 20:32:01,466 - functest.energy.energy - INFO - No current running scenario at http://energy.opnfv.fr/resources/recorders/environment/zte-pod3
2018-01-30 20:32:01,466 - functest.energy.energy - DEBUG - Starting recording
2018-01-30 20:32:01,467 - functest.energy.energy - DEBUG - Submitting scenario (rally_sanity/running)
2018-01-30 20:32:02,188 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment...
2018-01-30 20:32:05,868 - functest.utils.functest_utils - DEBUG - Executing command: 'rally deployment create --fromenv --name=opnfv-rally'
2018-01-30 20:32:09,524 - functest.utils.functest_utils - DEBUG - Executing command: 'rally deployment check'
2018-01-30 20:32:14,120 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating the test name...
2018-01-30 20:32:15,621 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating image 'Cirros-0.4.0-a6e57923-a4bb-4b6a-b373-e031172c7cc0'...
2018-01-30 20:32:17,292 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating network 'rally-net-a6e57923-a4bb-4b6a-b373-e031172c7cc0'...
2018-01-30 20:32:19,524 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating router 'rally-router-a6e57923-a4bb-4b6a-b373-e031172c7cc0'...
2018-01-30 20:32:25,023 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating flavor 'rally-tiny-a6e57923-a4bb-4b6a-b373-e031172c7cc0'...
2018-01-30 20:32:25,649 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating flavor 'rally-mini-a6e57923-a4bb-4b6a-b373-e031172c7cc0'...
2018-01-30 20:32:26,277 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ...
2018-01-30 20:32:26,277 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-authenticate.yaml
2018-01-30 20:32:26,278 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2018-01-30 20:32:26,319 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats']
2018-01-30 20:32:26,325 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'admin_external', 'service_list': ['authenticate'], 'concurrency': 4, 'netid': '6a7221bb-03d8-468e-b2de-eff15c54b7cb', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-a6e57923-a4bb-4b6a-b373-e031172c7cc0', 'flavor_name': 'rally-tiny-a6e57923-a4bb-4b6a-b373-e031172c7cc0', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-a6e57923-a4bb-4b6a-b373-e031172c7cc0', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"]
2018-01-30 20:33:32,448 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 14cf0cd4-7e43-43c7-b13d-267e6ffcfac5
2018-01-30 20:33:32,448 - functest.opnfv_tests.openstack.rally.rally - DEBUG - /home/opnfv/functest/results/rally does not exist, we create it.
2018-01-30 20:33:32,449 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '14cf0cd4-7e43-43c7-b13d-267e6ffcfac5']
2018-01-30 20:33:33,902 - functest.opnfv_tests.openstack.rally.rally - INFO - 
--------------------------------------------------------------------------------
Task 14cf0cd4-7e43-43c7-b13d-267e6ffcfac5: finished
--------------------------------------------------------------------------------

test scenario Authenticate.keystone
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {}, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }
  }
}

--------------------------------------------------------------------------------
Task 14cf0cd4-7e43-43c7-b13d-267e6ffcfac5 has 0 error(s)
--------------------------------------------------------------------------------

+--------------------------------------------------------------------------------------------------------------------------+
|                                                   Response Times (sec)                                                   |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| authenticate.keystone | 0.632     | 0.632        | 0.632        | 0.632        | 0.632     | 0.632     | 100.0%  | 1     |
| total                 | 0.632     | 0.632        | 0.632        | 0.632        | 0.632     | 0.632     | 100.0%  | 1     |
|  -> duration          | 0.632     | 0.632        | 0.632        | 0.632        | 0.632     | 0.632     | 100.0%  | 1     |
|  -> idle_duration     | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 0.632018
Full duration: 7.927218
--------------------------------------------------------------------------------

test scenario Authenticate.validate_cinder
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "repetitions": 2
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }
  }
}

--------------------------------------------------------------------------------
Task 14cf0cd4-7e43-43c7-b13d-267e6ffcfac5 has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------------+
|                                                      Response Times (sec)                                                       |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                       | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| authenticate.validate_cinder | 0.209     | 0.209        | 0.209        | 0.209        | 0.209     | 0.209     | 100.0%  | 1     |
| total                        | 0.84      | 0.84         | 0.84         | 0.84         | 0.84      | 0.84      | 100.0%  | 1     |
|  -> duration                 | 0.84      | 0.84         | 0.84         | 0.84         | 0.84      | 0.84      | 100.0%  | 1     |
|  -> idle_duration            | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 0.839961
Full duration: 7.655966
--------------------------------------------------------------------------------

test scenario Authenticate.validate_glance
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "repetitions": 2
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }
  }
}

--------------------------------------------------------------------------------
Task 14cf0cd4-7e43-43c7-b13d-267e6ffcfac5 has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------------+
|                                                      Response Times (sec)                                                       |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                       | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| authenticate.validate_glance | 0.245     | 0.245        | 0.245        | 0.245        | 0.245     | 0.245     | 100.0%  | 1     |
| total                        | 0.853     | 0.853        | 0.853        | 0.853        | 0.853     | 0.853     | 100.0%  | 1     |
|  -> duration                 | 0.853     | 0.853        | 0.853        | 0.853        | 0.853     | 0.853     | 100.0%  | 1     |
|  -> idle_duration            | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 0.853471
Full duration: 7.697637
--------------------------------------------------------------------------------

test scenario Authenticate.validate_heat
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "repetitions": 2
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }
  }
}

--------------------------------------------------------------------------------
Task 14cf0cd4-7e43-43c7-b13d-267e6ffcfac5 has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                      |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                     | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| authenticate.validate_heat | 0.752     | 0.752        | 0.752        | 0.752        | 0.752     | 0.752     | 100.0%  | 1     |
| total                      | 1.345     | 1.345        | 1.345        | 1.345        | 1.345     | 1.345     | 100.0%  | 1     |
|  -> duration               | 1.345     | 1.345        | 1.345        | 1.345        | 1.345     | 1.345     | 100.0%  | 1     |
|  -> idle_duration          | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 1.345377
Full duration: 8.315953
--------------------------------------------------------------------------------

test scenario Authenticate.validate_neutron
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "repetitions": 2
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }
  }
}

--------------------------------------------------------------------------------
Task 14cf0cd4-7e43-43c7-b13d-267e6ffcfac5 has 0 error(s)
--------------------------------------------------------------------------------

+----------------------------------------------------------------------------------------------------------------------------------+
|                                                       Response Times (sec)                                                       |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                        | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| authenticate.validate_neutron | 0.5       | 0.5          | 0.5          | 0.5          | 0.5       | 0.5       | 100.0%  | 1     |
| total                         | 1.082     | 1.082        | 1.082        | 1.082        | 1.082     | 1.082     | 100.0%  | 1     |
|  -> duration                  | 1.082     | 1.082        | 1.082        | 1.082        | 1.082     | 1.082     | 100.0%  | 1     |
|  -> idle_duration             | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 1.08226
Full duration: 8.07958
--------------------------------------------------------------------------------

test scenario Authenticate.validate_nova
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "repetitions": 2
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }
  }
}

--------------------------------------------------------------------------------
Task 14cf0cd4-7e43-43c7-b13d-267e6ffcfac5 has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                      |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                     | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| authenticate.validate_nova | 0.241     | 0.241        | 0.241        | 0.241        | 0.241     | 0.241     | 100.0%  | 1     |
| total                      | 0.874     | 0.874        | 0.874        | 0.874        | 0.874     | 0.874     | 100.0%  | 1     |
|  -> duration               | 0.874     | 0.874        | 0.874        | 0.874        | 0.874     | 0.874     | 100.0%  | 1     |
|  -> idle_duration          | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 0.873721
Full duration: 7.59324

HINTS:
* To plot HTML graphics with this data, run:
	rally task report 14cf0cd4-7e43-43c7-b13d-267e6ffcfac5 --out output.html

* To generate a JUnit report, run:
	rally task export 14cf0cd4-7e43-43c7-b13d-267e6ffcfac5 --type junit --to output.xml

* To get raw JSON output of task results, run:
	rally task report 14cf0cd4-7e43-43c7-b13d-267e6ffcfac5 --json --out output.json


2018-01-30 20:33:33,903 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '14cf0cd4-7e43-43c7-b13d-267e6ffcfac5']
2018-01-30 20:33:35,402 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file
2018-01-30 20:33:35,403 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '14cf0cd4-7e43-43c7-b13d-267e6ffcfac5', '--out', '/home/opnfv/functest/results/rally/opnfv-authenticate.html']
2018-01-30 20:33:35,411 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK.

2018-01-30 20:33:35,412 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ...
2018-01-30 20:33:35,412 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-glance.yaml
2018-01-30 20:33:35,412 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2018-01-30 20:33:35,449 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats']
2018-01-30 20:33:35,451 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'admin_external', 'service_list': ['glance'], 'concurrency': 4, 'netid': '6a7221bb-03d8-468e-b2de-eff15c54b7cb', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-a6e57923-a4bb-4b6a-b373-e031172c7cc0', 'flavor_name': 'rally-tiny-a6e57923-a4bb-4b6a-b373-e031172c7cc0', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-a6e57923-a4bb-4b6a-b373-e031172c7cc0', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"]
2018-01-30 20:35:05,021 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : afbba832-9afa-4733-af69-90108e9d3157
2018-01-30 20:35:05,022 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'afbba832-9afa-4733-af69-90108e9d3157']
2018-01-30 20:35:06,483 - functest.opnfv_tests.openstack.rally.rally - INFO - 
--------------------------------------------------------------------------------
Task afbba832-9afa-4733-af69-90108e9d3157: finished
--------------------------------------------------------------------------------

test scenario GlanceImages.create_and_delete_image
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "container_format": "bare", 
    "disk_format": "qcow2", 
    "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img"
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }
  }
}

--------------------------------------------------------------------------------
Task afbba832-9afa-4733-af69-90108e9d3157 has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------------+
|                                                      Response Times (sec)                                                       |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                       | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| glance_v2.create_image       | 3.241     | 3.241        | 3.241        | 3.241        | 3.241     | 3.241     | 100.0%  | 1     |
|  -> glance_v2.get_image (x2) | 0.074     | 0.074        | 0.074        | 0.074        | 0.074     | 0.074     | 100.0%  | 1     |
|  -> glance_v2.upload_data    | 0.899     | 0.899        | 0.899        | 0.899        | 0.899     | 0.899     | 100.0%  | 1     |
| glance_v2.delete_image       | 1.232     | 1.232        | 1.232        | 1.232        | 1.232     | 1.232     | 100.0%  | 1     |
| total                        | 4.474     | 4.474        | 4.474        | 4.474        | 4.474     | 4.474     | 100.0%  | 1     |
|  -> duration                 | 4.474     | 4.474        | 4.474        | 4.474        | 4.474     | 4.474     | 100.0%  | 1     |
|  -> idle_duration            | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 4.47399
Full duration: 13.065812
--------------------------------------------------------------------------------

test scenario GlanceImages.create_and_list_image
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "container_format": "bare", 
    "disk_format": "qcow2", 
    "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img"
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }
  }
}

--------------------------------------------------------------------------------
Task afbba832-9afa-4733-af69-90108e9d3157 has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------------+
|                                                      Response Times (sec)                                                       |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                       | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| glance_v2.create_image       | 4.065     | 4.065        | 4.065        | 4.065        | 4.065     | 4.065     | 100.0%  | 1     |
|  -> glance_v2.get_image (x2) | 0.074     | 0.074        | 0.074        | 0.074        | 0.074     | 0.074     | 100.0%  | 1     |
|  -> glance_v2.upload_data    | 1.742     | 1.742        | 1.742        | 1.742        | 1.742     | 1.742     | 100.0%  | 1     |
| glance_v2.list_images        | 0.061     | 0.061        | 0.061        | 0.061        | 0.061     | 0.061     | 100.0%  | 1     |
| total                        | 4.126     | 4.126        | 4.126        | 4.126        | 4.126     | 4.126     | 100.0%  | 1     |
|  -> duration                 | 4.126     | 4.126        | 4.126        | 4.126        | 4.126     | 4.126     | 100.0%  | 1     |
|  -> idle_duration            | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 4.126417
Full duration: 14.991887
--------------------------------------------------------------------------------

test scenario GlanceImages.list_images
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {}, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }
  }
}

--------------------------------------------------------------------------------
Task afbba832-9afa-4733-af69-90108e9d3157 has 0 error(s)
--------------------------------------------------------------------------------

+--------------------------------------------------------------------------------------------------------------------------+
|                                                   Response Times (sec)                                                   |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| glance_v2.list_images | 0.14      | 0.14         | 0.14         | 0.14         | 0.14      | 0.14      | 100.0%  | 1     |
| total                 | 0.14      | 0.14         | 0.14         | 0.14         | 0.14      | 0.14      | 100.0%  | 1     |
|  -> duration          | 0.14      | 0.14         | 0.14         | 0.14         | 0.14      | 0.14      | 100.0%  | 1     |
|  -> idle_duration     | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 0.140175
Full duration: 8.195155
--------------------------------------------------------------------------------

test scenario GlanceImages.create_image_and_boot_instances
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "container_format": "bare", 
    "disk_format": "qcow2", 
    "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", 
    "flavor": {
      "name": "rally-tiny-a6e57923-a4bb-4b6a-b373-e031172c7cc0"
    }, 
    "number_instances": 2, 
    "nics": [
      {
        "net-id": "6a7221bb-03d8-468e-b2de-eff15c54b7cb"
      }
    ]
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }, 
    "quotas": {
      "nova": {
        "cores": -1, 
        "floating_ips": -1, 
        "instances": -1, 
        "ram": -1, 
        "security_group_rules": -1, 
        "security_groups": -1
      }
    }
  }
}

--------------------------------------------------------------------------------
Task afbba832-9afa-4733-af69-90108e9d3157 has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------------+
|                                                      Response Times (sec)                                                       |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                       | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| glance_v2.create_image       | 3.219     | 3.219        | 3.219        | 3.219        | 3.219     | 3.219     | 100.0%  | 1     |
|  -> glance_v2.get_image (x2) | 0.073     | 0.073        | 0.073        | 0.073        | 0.073     | 0.073     | 100.0%  | 1     |
|  -> glance_v2.upload_data    | 0.814     | 0.814        | 0.814        | 0.814        | 0.814     | 0.814     | 100.0%  | 1     |
| nova.boot_servers            | 10.455    | 10.455       | 10.455       | 10.455       | 10.455    | 10.455    | 100.0%  | 1     |
| total                        | 13.675    | 13.675       | 13.675       | 13.675       | 13.675    | 13.675    | 100.0%  | 1     |
|  -> duration                 | 12.675    | 12.675       | 12.675       | 12.675       | 12.675    | 12.675    | 100.0%  | 1     |
|  -> idle_duration            | 1.0       | 1.0          | 1.0          | 1.0          | 1.0       | 1.0       | 100.0%  | 1     |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 12.675119
Full duration: 34.088331

HINTS:
* To plot HTML graphics with this data, run:
	rally task report afbba832-9afa-4733-af69-90108e9d3157 --out output.html

* To generate a JUnit report, run:
	rally task export afbba832-9afa-4733-af69-90108e9d3157 --type junit --to output.xml

* To get raw JSON output of task results, run:
	rally task report afbba832-9afa-4733-af69-90108e9d3157 --json --out output.json


2018-01-30 20:35:06,483 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'afbba832-9afa-4733-af69-90108e9d3157']
2018-01-30 20:35:07,930 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file
2018-01-30 20:35:07,931 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'afbba832-9afa-4733-af69-90108e9d3157', '--out', '/home/opnfv/functest/results/rally/opnfv-glance.html']
2018-01-30 20:35:07,938 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" OK.

2018-01-30 20:35:07,938 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "ceilometer" ...
2018-01-30 20:35:07,939 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-ceilometer.yaml
2018-01-30 20:35:07,939 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2018-01-30 20:35:07,975 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats']
2018-01-30 20:35:07,976 - functest.opnfv_tests.openstack.rally.rally - INFO - No tests for scenario "ceilometer"
2018-01-30 20:35:07,976 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ...
2018-01-30 20:35:07,976 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-cinder.yaml
2018-01-30 20:35:07,976 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2018-01-30 20:35:08,005 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats']
2018-01-30 20:35:08,010 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'admin_external', 'service_list': ['cinder'], 'concurrency': 4, 'netid': '6a7221bb-03d8-468e-b2de-eff15c54b7cb', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-a6e57923-a4bb-4b6a-b373-e031172c7cc0', 'flavor_name': 'rally-tiny-a6e57923-a4bb-4b6a-b373-e031172c7cc0', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-a6e57923-a4bb-4b6a-b373-e031172c7cc0', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"]
2018-01-30 20:38:27,263 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : d2f14a3c-abe3-4f01-b322-80bc0d6beb98
2018-01-30 20:38:27,264 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'd2f14a3c-abe3-4f01-b322-80bc0d6beb98']
2018-01-30 20:38:28,851 - functest.opnfv_tests.openstack.rally.rally - INFO - 
--------------------------------------------------------------------------------
Task d2f14a3c-abe3-4f01-b322-80bc0d6beb98: finished
--------------------------------------------------------------------------------

test scenario CinderVolumes.create_and_delete_snapshot
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "force": false
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }, 
    "quotas": {
      "cinder": {
        "gigabytes": -1, 
        "snapshots": -1, 
        "volumes": -1
      }
    }, 
    "volumes": {
      "size": 1, 
      "volumes_per_tenant": 1
    }
  }
}

--------------------------------------------------------------------------------
Task d2f14a3c-abe3-4f01-b322-80bc0d6beb98 has 0 error(s)
--------------------------------------------------------------------------------

+------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                     |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                    | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v2.create_snapshot | 3.106     | 3.106        | 3.106        | 3.106        | 3.106     | 3.106     | 100.0%  | 1     |
| cinder_v2.delete_snapshot | 2.296     | 2.296        | 2.296        | 2.296        | 2.296     | 2.296     | 100.0%  | 1     |
| total                     | 5.402     | 5.402        | 5.402        | 5.402        | 5.402     | 5.402     | 100.0%  | 1     |
|  -> duration              | 5.402     | 5.402        | 5.402        | 5.402        | 5.402     | 5.402     | 100.0%  | 1     |
|  -> idle_duration         | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 5.401956
Full duration: 23.164578
--------------------------------------------------------------------------------

test scenario CinderVolumes.create_and_delete_volume
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "size": {
      "max": 1, 
      "min": 1
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }, 
    "quotas": {
      "cinder": {
        "gigabytes": -1, 
        "snapshots": -1, 
        "volumes": -1
      }
    }
  }
}

--------------------------------------------------------------------------------
Task d2f14a3c-abe3-4f01-b322-80bc0d6beb98 has 0 error(s)
--------------------------------------------------------------------------------

+----------------------------------------------------------------------------------------------------------------------------+
|                                                    Response Times (sec)                                                    |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                  | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v2.create_volume | 3.297     | 3.297        | 3.297        | 3.297        | 3.297     | 3.297     | 100.0%  | 1     |
| cinder_v2.delete_volume | 2.292     | 2.292        | 2.292        | 2.292        | 2.292     | 2.292     | 100.0%  | 1     |
| total                   | 5.589     | 5.589        | 5.589        | 5.589        | 5.589     | 5.589     | 100.0%  | 1     |
|  -> duration            | 5.589     | 5.589        | 5.589        | 5.589        | 5.589     | 5.589     | 100.0%  | 1     |
|  -> idle_duration       | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 5.589024
Full duration: 15.58467
--------------------------------------------------------------------------------

test scenario CinderVolumes.create_and_delete_volume
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "image": {
      "name": "Cirros-0.4.0-a6e57923-a4bb-4b6a-b373-e031172c7cc0"
    }, 
    "size": 1
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }, 
    "quotas": {
      "cinder": {
        "gigabytes": -1, 
        "snapshots": -1, 
        "volumes": -1
      }
    }
  }
}

--------------------------------------------------------------------------------
Task d2f14a3c-abe3-4f01-b322-80bc0d6beb98 has 0 error(s)
--------------------------------------------------------------------------------

+----------------------------------------------------------------------------------------------------------------------------+
|                                                    Response Times (sec)                                                    |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                  | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v2.create_volume | 7.559     | 7.559        | 7.559        | 7.559        | 7.559     | 7.559     | 100.0%  | 1     |
| cinder_v2.delete_volume | 2.456     | 2.456        | 2.456        | 2.456        | 2.456     | 2.456     | 100.0%  | 1     |
| total                   | 10.015    | 10.015       | 10.015       | 10.015       | 10.015    | 10.015    | 100.0%  | 1     |
|  -> duration            | 10.015    | 10.015       | 10.015       | 10.015       | 10.015    | 10.015    | 100.0%  | 1     |
|  -> idle_duration       | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 10.014672
Full duration: 21.033776
--------------------------------------------------------------------------------

test scenario CinderVolumes.create_and_delete_volume
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "size": 1
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }, 
    "quotas": {
      "cinder": {
        "gigabytes": -1, 
        "snapshots": -1, 
        "volumes": -1
      }
    }
  }
}

--------------------------------------------------------------------------------
Task d2f14a3c-abe3-4f01-b322-80bc0d6beb98 has 0 error(s)
--------------------------------------------------------------------------------

+----------------------------------------------------------------------------------------------------------------------------+
|                                                    Response Times (sec)                                                    |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                  | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v2.create_volume | 3.293     | 3.293        | 3.293        | 3.293        | 3.293     | 3.293     | 100.0%  | 1     |
| cinder_v2.delete_volume | 2.306     | 2.306        | 2.306        | 2.306        | 2.306     | 2.306     | 100.0%  | 1     |
| total                   | 5.6       | 5.6          | 5.6          | 5.6          | 5.6       | 5.6       | 100.0%  | 1     |
|  -> duration            | 5.6       | 5.6          | 5.6          | 5.6          | 5.6       | 5.6       | 100.0%  | 1     |
|  -> idle_duration       | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 5.599856
Full duration: 15.724926
--------------------------------------------------------------------------------

test scenario CinderVolumes.create_and_extend_volume
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "new_size": 2, 
    "size": 1
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }, 
    "quotas": {
      "cinder": {
        "gigabytes": -1, 
        "snapshots": -1, 
        "volumes": -1
      }
    }
  }
}

--------------------------------------------------------------------------------
Task d2f14a3c-abe3-4f01-b322-80bc0d6beb98 has 0 error(s)
--------------------------------------------------------------------------------

+----------------------------------------------------------------------------------------------------------------------------+
|                                                    Response Times (sec)                                                    |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                  | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v2.create_volume | 3.238     | 3.238        | 3.238        | 3.238        | 3.238     | 3.238     | 100.0%  | 1     |
| cinder_v2.extend_volume | 2.358     | 2.358        | 2.358        | 2.358        | 2.358     | 2.358     | 100.0%  | 1     |
| cinder_v2.delete_volume | 2.298     | 2.298        | 2.298        | 2.298        | 2.298     | 2.298     | 100.0%  | 1     |
| total                   | 7.894     | 7.894        | 7.894        | 7.894        | 7.894     | 7.894     | 100.0%  | 1     |
|  -> duration            | 7.894     | 7.894        | 7.894        | 7.894        | 7.894     | 7.894     | 100.0%  | 1     |
|  -> idle_duration       | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 7.894317
Full duration: 18.283699
--------------------------------------------------------------------------------

test scenario CinderVolumes.create_from_volume_and_delete_volume
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "size": 1
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }, 
    "quotas": {
      "cinder": {
        "gigabytes": -1, 
        "snapshots": -1, 
        "volumes": -1
      }
    }, 
    "volumes": {
      "size": 1, 
      "volumes_per_tenant": 1
    }
  }
}

--------------------------------------------------------------------------------
Task d2f14a3c-abe3-4f01-b322-80bc0d6beb98 has 0 error(s)
--------------------------------------------------------------------------------

+----------------------------------------------------------------------------------------------------------------------------+
|                                                    Response Times (sec)                                                    |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                  | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v2.create_volume | 3.308     | 3.308        | 3.308        | 3.308        | 3.308     | 3.308     | 100.0%  | 1     |
| cinder_v2.delete_volume | 2.316     | 2.316        | 2.316        | 2.316        | 2.316     | 2.316     | 100.0%  | 1     |
| total                   | 5.624     | 5.624        | 5.624        | 5.624        | 5.624     | 5.624     | 100.0%  | 1     |
|  -> duration            | 5.624     | 5.624        | 5.624        | 5.624        | 5.624     | 5.624     | 100.0%  | 1     |
|  -> idle_duration       | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 5.623576
Full duration: 22.286684
--------------------------------------------------------------------------------

test scenario CinderQos.create_and_list_qos
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "consumer": "both", 
    "write_iops_sec": "10", 
    "read_iops_sec": "1000"
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }
  }
}

--------------------------------------------------------------------------------
Task d2f14a3c-abe3-4f01-b322-80bc0d6beb98 has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------+
|                                                  Response Times (sec)                                                   |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v2.create_qos | 0.706     | 0.706        | 0.706        | 0.706        | 0.706     | 0.706     | 100.0%  | 1     |
| cinder_v2.list_qos   | 0.036     | 0.036        | 0.036        | 0.036        | 0.036     | 0.036     | 100.0%  | 1     |
| total                | 0.742     | 0.742        | 0.742        | 0.742        | 0.742     | 0.742     | 100.0%  | 1     |
|  -> duration         | 0.742     | 0.742        | 0.742        | 0.742        | 0.742     | 0.742     | 100.0%  | 1     |
|  -> idle_duration    | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 0.742331
Full duration: 12.198525
--------------------------------------------------------------------------------

test scenario CinderQos.create_and_set_qos
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "consumer": "back-end", 
    "write_iops_sec": "10", 
    "read_iops_sec": "1000", 
    "set_consumer": "both", 
    "set_write_iops_sec": "11", 
    "set_read_iops_sec": "1001"
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }
  }
}

--------------------------------------------------------------------------------
Task d2f14a3c-abe3-4f01-b322-80bc0d6beb98 has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------+
|                                                  Response Times (sec)                                                   |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v2.create_qos | 0.659     | 0.659        | 0.659        | 0.659        | 0.659     | 0.659     | 100.0%  | 1     |
| cinder_v2.set_qos    | 0.062     | 0.062        | 0.062        | 0.062        | 0.062     | 0.062     | 100.0%  | 1     |
| total                | 0.721     | 0.721        | 0.721        | 0.721        | 0.721     | 0.721     | 100.0%  | 1     |
|  -> duration         | 0.721     | 0.721        | 0.721        | 0.721        | 0.721     | 0.721     | 100.0%  | 1     |
|  -> idle_duration    | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 0.720645
Full duration: 12.391385
--------------------------------------------------------------------------------

test scenario CinderVolumeTypes.create_and_list_volume_types
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "description": "rally tests creating types"
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }
  }
}

--------------------------------------------------------------------------------
Task d2f14a3c-abe3-4f01-b322-80bc0d6beb98 has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------------+
|                                                      Response Times (sec)                                                       |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                       | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v2.create_volume_type | 0.747     | 0.747        | 0.747        | 0.747        | 0.747     | 0.747     | 100.0%  | 1     |
| cinder_v2.list_types         | 0.038     | 0.038        | 0.038        | 0.038        | 0.038     | 0.038     | 100.0%  | 1     |
| total                        | 0.785     | 0.785        | 0.785        | 0.785        | 0.785     | 0.785     | 100.0%  | 1     |
|  -> duration                 | 0.785     | 0.785        | 0.785        | 0.785        | 0.785     | 0.785     | 100.0%  | 1     |
|  -> idle_duration            | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 0.784818
Full duration: 12.174093
--------------------------------------------------------------------------------

test scenario CinderVolumeTypes.create_volume_type_and_encryption_type
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "description": "rally tests creating types", 
    "provider": "LuksEncryptor", 
    "cipher": "aes-xts-plain64", 
    "key_size": 512, 
    "control_location": "front-end"
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }
  }
}

--------------------------------------------------------------------------------
Task d2f14a3c-abe3-4f01-b322-80bc0d6beb98 has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------------------+
|                                                        Response Times (sec)                                                         |
+----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                           | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v2.create_volume_type     | 0.725     | 0.725        | 0.725        | 0.725        | 0.725     | 0.725     | 100.0%  | 1     |
| cinder_v2.create_encryption_type | 0.095     | 0.095        | 0.095        | 0.095        | 0.095     | 0.095     | 100.0%  | 1     |
| total                            | 0.821     | 0.821        | 0.821        | 0.821        | 0.821     | 0.821     | 100.0%  | 1     |
|  -> duration                     | 0.821     | 0.821        | 0.821        | 0.821        | 0.821     | 0.821     | 100.0%  | 1     |
|  -> idle_duration                | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 0.821081
Full duration: 12.473445

HINTS:
* To plot HTML graphics with this data, run:
	rally task report d2f14a3c-abe3-4f01-b322-80bc0d6beb98 --out output.html

* To generate a JUnit report, run:
	rally task export d2f14a3c-abe3-4f01-b322-80bc0d6beb98 --type junit --to output.xml

* To get raw JSON output of task results, run:
	rally task report d2f14a3c-abe3-4f01-b322-80bc0d6beb98 --json --out output.json


2018-01-30 20:38:28,851 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'd2f14a3c-abe3-4f01-b322-80bc0d6beb98']
2018-01-30 20:38:30,399 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file
2018-01-30 20:38:30,399 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'd2f14a3c-abe3-4f01-b322-80bc0d6beb98', '--out', '/home/opnfv/functest/results/rally/opnfv-cinder.html']
2018-01-30 20:38:30,407 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK.

2018-01-30 20:38:30,407 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ...
2018-01-30 20:38:30,407 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-heat.yaml
2018-01-30 20:38:30,408 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2018-01-30 20:38:30,444 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats']
2018-01-30 20:38:30,446 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'admin_external', 'service_list': ['heat'], 'concurrency': 4, 'netid': '6a7221bb-03d8-468e-b2de-eff15c54b7cb', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-a6e57923-a4bb-4b6a-b373-e031172c7cc0', 'flavor_name': 'rally-tiny-a6e57923-a4bb-4b6a-b373-e031172c7cc0', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-a6e57923-a4bb-4b6a-b373-e031172c7cc0', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"]
2018-01-30 20:40:05,560 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : ae809f47-ff12-4353-99b0-d75b130e5294
2018-01-30 20:40:05,561 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'ae809f47-ff12-4353-99b0-d75b130e5294']
2018-01-30 20:40:07,035 - functest.opnfv_tests.openstack.rally.rally - INFO - 
--------------------------------------------------------------------------------
Task ae809f47-ff12-4353-99b0-d75b130e5294: finished
--------------------------------------------------------------------------------

test scenario HeatStacks.create_update_delete_stack
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", 
    "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template"
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }, 
    "roles": [
      "heat_stack_owner"
    ]
  }
}

--------------------------------------------------------------------------------
Task ae809f47-ff12-4353-99b0-d75b130e5294 has 0 error(s)
--------------------------------------------------------------------------------

+----------------------------------------------------------------------------------------------------------------------+
|                                                 Response Times (sec)                                                 |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| heat.create_stack | 6.163     | 6.163        | 6.163        | 6.163        | 6.163     | 6.163     | 100.0%  | 1     |
| heat.update_stack | 3.475     | 3.475        | 3.475        | 3.475        | 3.475     | 3.475     | 100.0%  | 1     |
| heat.delete_stack | 3.368     | 3.368        | 3.368        | 3.368        | 3.368     | 3.368     | 100.0%  | 1     |
| total             | 13.006    | 13.006       | 13.006       | 13.006       | 13.006    | 13.006    | 100.0%  | 1     |
|  -> duration      | 9.006     | 9.006        | 9.006        | 9.006        | 9.006     | 9.006     | 100.0%  | 1     |
|  -> idle_duration | 4.0       | 4.0          | 4.0          | 4.0          | 4.0       | 4.0       | 100.0%  | 1     |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 9.0058
Full duration: 23.749
--------------------------------------------------------------------------------

test scenario HeatStacks.create_check_delete_stack
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template"
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }, 
    "roles": [
      "heat_stack_owner"
    ]
  }
}

--------------------------------------------------------------------------------
Task ae809f47-ff12-4353-99b0-d75b130e5294 has 0 error(s)
--------------------------------------------------------------------------------

+----------------------------------------------------------------------------------------------------------------------+
|                                                 Response Times (sec)                                                 |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| heat.create_stack | 4.745     | 4.745        | 4.745        | 4.745        | 4.745     | 4.745     | 100.0%  | 1     |
| heat.check_stack  | 1.339     | 1.339        | 1.339        | 1.339        | 1.339     | 1.339     | 100.0%  | 1     |
| heat.delete_stack | 2.303     | 2.303        | 2.303        | 2.303        | 2.303     | 2.303     | 100.0%  | 1     |
| total             | 8.387     | 8.387        | 8.387        | 8.387        | 8.387     | 8.387     | 100.0%  | 1     |
|  -> duration      | 6.387     | 6.387        | 6.387        | 6.387        | 6.387     | 6.387     | 100.0%  | 1     |
|  -> idle_duration | 2.0       | 2.0          | 2.0          | 2.0          | 2.0       | 2.0       | 100.0%  | 1     |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 6.387313
Full duration: 19.278726
--------------------------------------------------------------------------------

test scenario HeatStacks.create_suspend_resume_delete_stack
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template"
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }, 
    "roles": [
      "heat_stack_owner"
    ]
  }
}

--------------------------------------------------------------------------------
Task ae809f47-ff12-4353-99b0-d75b130e5294 has 0 error(s)
--------------------------------------------------------------------------------

+-----------------------------------------------------------------------------------------------------------------------+
|                                                 Response Times (sec)                                                  |
+--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action             | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| heat.create_stack  | 4.73      | 4.73         | 4.73         | 4.73         | 4.73      | 4.73      | 100.0%  | 1     |
| heat.suspend_stack | 1.356     | 1.356        | 1.356        | 1.356        | 1.356     | 1.356     | 100.0%  | 1     |
| heat.resume_stack  | 1.302     | 1.302        | 1.302        | 1.302        | 1.302     | 1.302     | 100.0%  | 1     |
| heat.delete_stack  | 2.287     | 2.287        | 2.287        | 2.287        | 2.287     | 2.287     | 100.0%  | 1     |
| total              | 9.676     | 9.676        | 9.676        | 9.676        | 9.676     | 9.676     | 100.0%  | 1     |
|  -> duration       | 7.676     | 7.676        | 7.676        | 7.676        | 7.676     | 7.676     | 100.0%  | 1     |
|  -> idle_duration  | 2.0       | 2.0          | 2.0          | 2.0          | 2.0       | 2.0       | 100.0%  | 1     |
+--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 7.675539
Full duration: 20.689123
--------------------------------------------------------------------------------

test scenario HeatStacks.list_stacks_and_resources
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {}, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }, 
    "roles": [
      "heat_stack_owner"
    ]
  }
}

--------------------------------------------------------------------------------
Task ae809f47-ff12-4353-99b0-d75b130e5294 has 0 error(s)
--------------------------------------------------------------------------------

+----------------------------------------------------------------------------------------------------------------------+
|                                                 Response Times (sec)                                                 |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| heat.list_stacks  | 0.717     | 0.717        | 0.717        | 0.717        | 0.717     | 0.717     | 100.0%  | 1     |
| total             | 0.718     | 0.718        | 0.718        | 0.718        | 0.718     | 0.718     | 100.0%  | 1     |
|  -> duration      | 0.718     | 0.718        | 0.718        | 0.718        | 0.718     | 0.718     | 100.0%  | 1     |
|  -> idle_duration | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 0.717531
Full duration: 10.781248

HINTS:
* To plot HTML graphics with this data, run:
	rally task report ae809f47-ff12-4353-99b0-d75b130e5294 --out output.html

* To generate a JUnit report, run:
	rally task export ae809f47-ff12-4353-99b0-d75b130e5294 --type junit --to output.xml

* To get raw JSON output of task results, run:
	rally task report ae809f47-ff12-4353-99b0-d75b130e5294 --json --out output.json


2018-01-30 20:40:07,035 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'ae809f47-ff12-4353-99b0-d75b130e5294']
2018-01-30 20:40:08,478 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file
2018-01-30 20:40:08,479 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'ae809f47-ff12-4353-99b0-d75b130e5294', '--out', '/home/opnfv/functest/results/rally/opnfv-heat.html']
2018-01-30 20:40:08,486 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK.

2018-01-30 20:40:08,487 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ...
2018-01-30 20:40:08,487 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-keystone.yaml
2018-01-30 20:40:08,487 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2018-01-30 20:40:08,524 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats']
2018-01-30 20:40:08,528 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'admin_external', 'service_list': ['keystone'], 'concurrency': 4, 'netid': '6a7221bb-03d8-468e-b2de-eff15c54b7cb', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-a6e57923-a4bb-4b6a-b373-e031172c7cc0', 'flavor_name': 'rally-tiny-a6e57923-a4bb-4b6a-b373-e031172c7cc0', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-a6e57923-a4bb-4b6a-b373-e031172c7cc0', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"]
2018-01-30 20:43:24,643 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 815249c3-bb47-4af4-a4d4-5c03538bdecd
2018-01-30 20:43:24,644 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '815249c3-bb47-4af4-a4d4-5c03538bdecd']
2018-01-30 20:43:26,237 - functest.opnfv_tests.openstack.rally.rally - INFO - 
--------------------------------------------------------------------------------
Task 815249c3-bb47-4af4-a4d4-5c03538bdecd: finished
--------------------------------------------------------------------------------

test scenario KeystoneBasic.add_and_remove_user_role
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {}, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }
  }
}

--------------------------------------------------------------------------------
Task 815249c3-bb47-4af4-a4d4-5c03538bdecd has 0 error(s)
--------------------------------------------------------------------------------

+----------------------------------------------------------------------------------------------------------------------------+
|                                                    Response Times (sec)                                                    |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                  | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| keystone_v3.create_role | 0.511     | 0.511        | 0.511        | 0.511        | 0.511     | 0.511     | 100.0%  | 1     |
| keystone_v3.add_role    | 0.06      | 0.06         | 0.06         | 0.06         | 0.06      | 0.06      | 100.0%  | 1     |
| keystone_v3.revoke_role | 0.063     | 0.063        | 0.063        | 0.063        | 0.063     | 0.063     | 100.0%  | 1     |
| total                   | 0.635     | 0.635        | 0.635        | 0.635        | 0.635     | 0.635     | 100.0%  | 1     |
|  -> duration            | 0.635     | 0.635        | 0.635        | 0.635        | 0.635     | 0.635     | 100.0%  | 1     |
|  -> idle_duration       | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 0.634513
Full duration: 14.771198
--------------------------------------------------------------------------------

test scenario KeystoneBasic.create_add_and_list_user_roles
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {}, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }
  }
}

--------------------------------------------------------------------------------
Task 815249c3-bb47-4af4-a4d4-5c03538bdecd has 0 error(s)
--------------------------------------------------------------------------------

+----------------------------------------------------------------------------------------------------------------------------+
|                                                    Response Times (sec)                                                    |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                  | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| keystone_v3.create_role | 0.558     | 0.558        | 0.558        | 0.558        | 0.558     | 0.558     | 100.0%  | 1     |
| keystone_v3.add_role    | 0.067     | 0.067        | 0.067        | 0.067        | 0.067     | 0.067     | 100.0%  | 1     |
| keystone_v3.list_roles  | 0.037     | 0.037        | 0.037        | 0.037        | 0.037     | 0.037     | 100.0%  | 1     |
| total                   | 0.663     | 0.663        | 0.663        | 0.663        | 0.663     | 0.663     | 100.0%  | 1     |
|  -> duration            | 0.663     | 0.663        | 0.663        | 0.663        | 0.663     | 0.663     | 100.0%  | 1     |
|  -> idle_duration       | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 0.662662
Full duration: 15.102265
--------------------------------------------------------------------------------

test scenario KeystoneBasic.create_and_list_tenants
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {}, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }
  }
}

--------------------------------------------------------------------------------
Task 815249c3-bb47-4af4-a4d4-5c03538bdecd has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                      |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                     | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| keystone_v3.create_project | 0.607     | 0.607        | 0.607        | 0.607        | 0.607     | 0.607     | 100.0%  | 1     |
| keystone_v3.list_projects  | 0.028     | 0.028        | 0.028        | 0.028        | 0.028     | 0.028     | 100.0%  | 1     |
| total                      | 0.636     | 0.636        | 0.636        | 0.636        | 0.636     | 0.636     | 100.0%  | 1     |
|  -> duration               | 0.636     | 0.636        | 0.636        | 0.636        | 0.636     | 0.636     | 100.0%  | 1     |
|  -> idle_duration          | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 0.635617
Full duration: 15.228768
--------------------------------------------------------------------------------

test scenario KeystoneBasic.create_and_delete_role
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {}, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }
  }
}

--------------------------------------------------------------------------------
Task 815249c3-bb47-4af4-a4d4-5c03538bdecd has 0 error(s)
--------------------------------------------------------------------------------

+----------------------------------------------------------------------------------------------------------------------------+
|                                                    Response Times (sec)                                                    |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                  | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| keystone_v3.create_role | 0.522     | 0.522        | 0.522        | 0.522        | 0.522     | 0.522     | 100.0%  | 1     |
| keystone_v3.delete_role | 0.086     | 0.086        | 0.086        | 0.086        | 0.086     | 0.086     | 100.0%  | 1     |
| total                   | 0.609     | 0.609        | 0.609        | 0.609        | 0.609     | 0.609     | 100.0%  | 1     |
|  -> duration            | 0.609     | 0.609        | 0.609        | 0.609        | 0.609     | 0.609     | 100.0%  | 1     |
|  -> idle_duration       | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 0.608848
Full duration: 13.130568
--------------------------------------------------------------------------------

test scenario KeystoneBasic.create_and_delete_service
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {}, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }
  }
}

--------------------------------------------------------------------------------
Task 815249c3-bb47-4af4-a4d4-5c03538bdecd has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                      |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                     | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| keystone_v3.create_service | 0.621     | 0.621        | 0.621        | 0.621        | 0.621     | 0.621     | 100.0%  | 1     |
| keystone_v3.delete_service | 0.076     | 0.076        | 0.076        | 0.076        | 0.076     | 0.076     | 100.0%  | 1     |
| total                      | 0.698     | 0.698        | 0.698        | 0.698        | 0.698     | 0.698     | 100.0%  | 1     |
|  -> duration               | 0.698     | 0.698        | 0.698        | 0.698        | 0.698     | 0.698     | 100.0%  | 1     |
|  -> idle_duration          | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 0.697647
Full duration: 13.134354
--------------------------------------------------------------------------------

test scenario KeystoneBasic.get_entities
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {}, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }
  }
}

--------------------------------------------------------------------------------
Task 815249c3-bb47-4af4-a4d4-5c03538bdecd has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                      |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                     | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| keystone_v3.create_project | 0.568     | 0.568        | 0.568        | 0.568        | 0.568     | 0.568     | 100.0%  | 1     |
| keystone_v3.create_user    | 0.254     | 0.254        | 0.254        | 0.254        | 0.254     | 0.254     | 100.0%  | 1     |
|  -> keystone_v3.list_roles | 0.03      | 0.03         | 0.03         | 0.03         | 0.03      | 0.03      | 100.0%  | 1     |
|  -> keystone_v3.add_role   | 0.092     | 0.092        | 0.092        | 0.092        | 0.092     | 0.092     | 100.0%  | 1     |
| keystone_v3.create_role    | 0.053     | 0.053        | 0.053        | 0.053        | 0.053     | 0.053     | 100.0%  | 1     |
| keystone_v3.get_project    | 0.034     | 0.034        | 0.034        | 0.034        | 0.034     | 0.034     | 100.0%  | 1     |
| keystone_v3.get_user       | 0.027     | 0.027        | 0.027        | 0.027        | 0.027     | 0.027     | 100.0%  | 1     |
| keystone_v3.get_role       | 0.03      | 0.03         | 0.03         | 0.03         | 0.03      | 0.03      | 100.0%  | 1     |
| keystone_v3.list_services  | 0.033     | 0.033        | 0.033        | 0.033        | 0.033     | 0.033     | 100.0%  | 1     |
| keystone_v3.get_services   | 0.029     | 0.029        | 0.029        | 0.029        | 0.029     | 0.029     | 100.0%  | 1     |
| total                      | 1.055     | 1.055        | 1.055        | 1.055        | 1.055     | 1.055     | 100.0%  | 1     |
|  -> duration               | 1.055     | 1.055        | 1.055        | 1.055        | 1.055     | 1.055     | 100.0%  | 1     |
|  -> idle_duration          | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 1.055319
Full duration: 19.663843
--------------------------------------------------------------------------------

test scenario KeystoneBasic.create_update_and_delete_tenant
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {}, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }
  }
}

--------------------------------------------------------------------------------
Task 815249c3-bb47-4af4-a4d4-5c03538bdecd has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                      |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                     | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| keystone_v3.create_project | 0.583     | 0.583        | 0.583        | 0.583        | 0.583     | 0.583     | 100.0%  | 1     |
| keystone_v3.update_project | 0.062     | 0.062        | 0.062        | 0.062        | 0.062     | 0.062     | 100.0%  | 1     |
| keystone_v3.delete_project | 0.154     | 0.154        | 0.154        | 0.154        | 0.154     | 0.154     | 100.0%  | 1     |
| total                      | 0.799     | 0.799        | 0.799        | 0.799        | 0.799     | 0.799     | 100.0%  | 1     |
|  -> duration               | 0.799     | 0.799        | 0.799        | 0.799        | 0.799     | 0.799     | 100.0%  | 1     |
|  -> idle_duration          | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 0.799231
Full duration: 12.81809
--------------------------------------------------------------------------------

test scenario KeystoneBasic.create_user
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {}, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {}
}

--------------------------------------------------------------------------------
Task 815249c3-bb47-4af4-a4d4-5c03538bdecd has 0 error(s)
--------------------------------------------------------------------------------

+----------------------------------------------------------------------------------------------------------------------------+
|                                                    Response Times (sec)                                                    |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                  | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| keystone_v3.create_user | 0.63      | 0.63         | 0.63         | 0.63         | 0.63      | 0.63      | 100.0%  | 1     |
| total                   | 0.686     | 0.686        | 0.686        | 0.686        | 0.686     | 0.686     | 100.0%  | 1     |
|  -> duration            | 0.686     | 0.686        | 0.686        | 0.686        | 0.686     | 0.686     | 100.0%  | 1     |
|  -> idle_duration       | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 0.685618
Full duration: 15.017181
--------------------------------------------------------------------------------

test scenario KeystoneBasic.create_tenant
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {}, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {}
}

--------------------------------------------------------------------------------
Task 815249c3-bb47-4af4-a4d4-5c03538bdecd has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                      |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                     | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| keystone_v3.create_project | 0.586     | 0.586        | 0.586        | 0.586        | 0.586     | 0.586     | 100.0%  | 1     |
| total                      | 0.586     | 0.586        | 0.586        | 0.586        | 0.586     | 0.586     | 100.0%  | 1     |
|  -> duration               | 0.586     | 0.586        | 0.586        | 0.586        | 0.586     | 0.586     | 100.0%  | 1     |
|  -> idle_duration          | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 0.586225
Full duration: 15.05808
--------------------------------------------------------------------------------

test scenario KeystoneBasic.create_and_list_users
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {}, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {}
}

--------------------------------------------------------------------------------
Task 815249c3-bb47-4af4-a4d4-5c03538bdecd has 0 error(s)
--------------------------------------------------------------------------------

+----------------------------------------------------------------------------------------------------------------------------+
|                                                    Response Times (sec)                                                    |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                  | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| keystone_v3.create_user | 0.561     | 0.561        | 0.561        | 0.561        | 0.561     | 0.561     | 100.0%  | 1     |
| keystone_v3.list_users  | 0.053     | 0.053        | 0.053        | 0.053        | 0.053     | 0.053     | 100.0%  | 1     |
| total                   | 0.673     | 0.673        | 0.673        | 0.673        | 0.673     | 0.673     | 100.0%  | 1     |
|  -> duration            | 0.673     | 0.673        | 0.673        | 0.673        | 0.673     | 0.673     | 100.0%  | 1     |
|  -> idle_duration       | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 0.672725
Full duration: 14.729132
--------------------------------------------------------------------------------

test scenario KeystoneBasic.create_tenant_with_users
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "users_per_tenant": 10
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {}
}

--------------------------------------------------------------------------------
Task 815249c3-bb47-4af4-a4d4-5c03538bdecd has 0 error(s)
--------------------------------------------------------------------------------

+--------------------------------------------------------------------------------------------------------------------------------------+
|                                                         Response Times (sec)                                                         |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| keystone_v3.create_project        | 0.676     | 0.676        | 0.676        | 0.676        | 0.676     | 0.676     | 100.0%  | 1     |
| keystone_v3.create_users          | 2.518     | 2.518        | 2.518        | 2.518        | 2.518     | 2.518     | 100.0%  | 1     |
|  -> keystone_v3.create_user (x10) | 2.517     | 2.517        | 2.517        | 2.517        | 2.517     | 2.517     | 100.0%  | 1     |
|  --> keystone_v3.list_roles (x10) | 0.299     | 0.299        | 0.299        | 0.299        | 0.299     | 0.299     | 100.0%  | 1     |
|  --> keystone_v3.add_role (x10)   | 0.93      | 0.93         | 0.93         | 0.93         | 0.93      | 0.93      | 100.0%  | 1     |
| total                             | 3.474     | 3.474        | 3.474        | 3.474        | 3.474     | 3.474     | 100.0%  | 1     |
|  -> duration                      | 3.474     | 3.474        | 3.474        | 3.474        | 3.474     | 3.474     | 100.0%  | 1     |
|  -> idle_duration                 | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 3.474245
Full duration: 21.421929

HINTS:
* To plot HTML graphics with this data, run:
	rally task report 815249c3-bb47-4af4-a4d4-5c03538bdecd --out output.html

* To generate a JUnit report, run:
	rally task export 815249c3-bb47-4af4-a4d4-5c03538bdecd --type junit --to output.xml

* To get raw JSON output of task results, run:
	rally task report 815249c3-bb47-4af4-a4d4-5c03538bdecd --json --out output.json


2018-01-30 20:43:26,238 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '815249c3-bb47-4af4-a4d4-5c03538bdecd']
2018-01-30 20:43:27,858 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file
2018-01-30 20:43:27,858 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '815249c3-bb47-4af4-a4d4-5c03538bdecd', '--out', '/home/opnfv/functest/results/rally/opnfv-keystone.html']
2018-01-30 20:43:27,866 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK.

2018-01-30 20:43:27,866 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ...
2018-01-30 20:43:27,867 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-neutron.yaml
2018-01-30 20:43:27,867 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2018-01-30 20:43:27,897 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats']
2018-01-30 20:43:27,903 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'admin_external', 'service_list': ['neutron'], 'concurrency': 4, 'netid': '6a7221bb-03d8-468e-b2de-eff15c54b7cb', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-a6e57923-a4bb-4b6a-b373-e031172c7cc0', 'flavor_name': 'rally-tiny-a6e57923-a4bb-4b6a-b373-e031172c7cc0', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-a6e57923-a4bb-4b6a-b373-e031172c7cc0', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"]
2018-01-30 20:48:54,159 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : f7cbce95-23df-45c8-8432-fb34a5ebda64
2018-01-30 20:48:54,159 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'f7cbce95-23df-45c8-8432-fb34a5ebda64']
2018-01-30 20:48:55,745 - functest.opnfv_tests.openstack.rally.rally - INFO - 
--------------------------------------------------------------------------------
Task f7cbce95-23df-45c8-8432-fb34a5ebda64: finished
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_delete_networks
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "network_create_args": {}
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }, 
    "quotas": {
      "neutron": {
        "network": -1
      }
    }
  }
}

--------------------------------------------------------------------------------
Task f7cbce95-23df-45c8-8432-fb34a5ebda64 has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------+
|                                                   Response Times (sec)                                                    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 1.483     | 1.483        | 1.483        | 1.483        | 1.483     | 1.483     | 100.0%  | 1     |
| neutron.delete_network | 1.213     | 1.213        | 1.213        | 1.213        | 1.213     | 1.213     | 100.0%  | 1     |
| total                  | 2.696     | 2.696        | 2.696        | 2.696        | 2.696     | 2.696     | 100.0%  | 1     |
|  -> duration           | 2.696     | 2.696        | 2.696        | 2.696        | 2.696     | 2.696     | 100.0%  | 1     |
|  -> idle_duration      | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 2.695772
Full duration: 15.644472
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_delete_ports
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "network_create_args": {}, 
    "port_create_args": {}, 
    "ports_per_network": 1
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }, 
    "network": {}, 
    "quotas": {
      "neutron": {
        "network": -1, 
        "port": -1
      }
    }
  }
}

--------------------------------------------------------------------------------
Task f7cbce95-23df-45c8-8432-fb34a5ebda64 has 0 error(s)
--------------------------------------------------------------------------------

+------------------------------------------------------------------------------------------------------------------------+
|                                                  Response Times (sec)                                                  |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_port | 1.878     | 1.878        | 1.878        | 1.878        | 1.878     | 1.878     | 100.0%  | 1     |
| neutron.delete_port | 0.865     | 0.865        | 0.865        | 0.865        | 0.865     | 0.865     | 100.0%  | 1     |
| total               | 2.744     | 2.744        | 2.744        | 2.744        | 2.744     | 2.744     | 100.0%  | 1     |
|  -> duration        | 2.744     | 2.744        | 2.744        | 2.744        | 2.744     | 2.744     | 100.0%  | 1     |
|  -> idle_duration   | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 2.743651
Full duration: 30.549162
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_delete_routers
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "network_create_args": {}, 
    "router_create_args": {}, 
    "subnet_cidr_start": "1.1.0.0/30", 
    "subnet_create_args": {}, 
    "subnets_per_network": 1
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }, 
    "network": {}, 
    "quotas": {
      "neutron": {
        "network": -1, 
        "subnet": -1, 
        "port": -1, 
        "router": -1
      }
    }
  }
}

--------------------------------------------------------------------------------
Task f7cbce95-23df-45c8-8432-fb34a5ebda64 has 0 error(s)
--------------------------------------------------------------------------------

+------------------------------------------------------------------------------------------------------------------------------------+
|                                                        Response Times (sec)                                                        |
+---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                          | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network          | 1.095     | 1.095        | 1.095        | 1.095        | 1.095     | 1.095     | 100.0%  | 1     |
| neutron.create_subnet           | 1.049     | 1.049        | 1.049        | 1.049        | 1.049     | 1.049     | 100.0%  | 1     |
| neutron.create_router           | 0.784     | 0.784        | 0.784        | 0.784        | 0.784     | 0.784     | 100.0%  | 1     |
| neutron.add_interface_router    | 2.403     | 2.403        | 2.403        | 2.403        | 2.403     | 2.403     | 100.0%  | 1     |
| neutron.remove_interface_router | 1.677     | 1.677        | 1.677        | 1.677        | 1.677     | 1.677     | 100.0%  | 1     |
| neutron.delete_router           | 0.635     | 0.635        | 0.635        | 0.635        | 0.635     | 0.635     | 100.0%  | 1     |
| total                           | 7.642     | 7.642        | 7.642        | 7.642        | 7.642     | 7.642     | 100.0%  | 1     |
|  -> duration                    | 7.642     | 7.642        | 7.642        | 7.642        | 7.642     | 7.642     | 100.0%  | 1     |
|  -> idle_duration               | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 7.642269
Full duration: 41.044809
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_delete_subnets
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "network_create_args": {}, 
    "subnet_cidr_start": "1.1.0.0/30", 
    "subnet_create_args": {}, 
    "subnets_per_network": 1
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }, 
    "network": {}, 
    "quotas": {
      "neutron": {
        "network": -1, 
        "subnet": -1
      }
    }
  }
}

--------------------------------------------------------------------------------
Task f7cbce95-23df-45c8-8432-fb34a5ebda64 has 0 error(s)
--------------------------------------------------------------------------------

+--------------------------------------------------------------------------------------------------------------------------+
|                                                   Response Times (sec)                                                   |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_subnet | 1.625     | 1.625        | 1.625        | 1.625        | 1.625     | 1.625     | 100.0%  | 1     |
| neutron.delete_subnet | 0.779     | 0.779        | 0.779        | 0.779        | 0.779     | 0.779     | 100.0%  | 1     |
| total                 | 2.405     | 2.405        | 2.405        | 2.405        | 2.405     | 2.405     | 100.0%  | 1     |
|  -> duration          | 2.405     | 2.405        | 2.405        | 2.405        | 2.405     | 2.405     | 100.0%  | 1     |
|  -> idle_duration     | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 2.404872
Full duration: 30.155938
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_list_networks
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "network_create_args": {}
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }, 
    "quotas": {
      "neutron": {
        "network": -1
      }
    }
  }
}

--------------------------------------------------------------------------------
Task f7cbce95-23df-45c8-8432-fb34a5ebda64 has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------+
|                                                   Response Times (sec)                                                    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 1.523     | 1.523        | 1.523        | 1.523        | 1.523     | 1.523     | 100.0%  | 1     |
| neutron.list_networks  | 0.217     | 0.217        | 0.217        | 0.217        | 0.217     | 0.217     | 100.0%  | 1     |
| total                  | 1.74      | 1.74         | 1.74         | 1.74         | 1.74      | 1.74      | 100.0%  | 1     |
|  -> duration           | 1.74      | 1.74         | 1.74         | 1.74         | 1.74      | 1.74      | 100.0%  | 1     |
|  -> idle_duration      | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 1.740326
Full duration: 16.963376
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_list_ports
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "network_create_args": {}, 
    "port_create_args": {}, 
    "ports_per_network": 1
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }, 
    "network": {}, 
    "quotas": {
      "neutron": {
        "network": -1, 
        "port": -1
      }
    }
  }
}

--------------------------------------------------------------------------------
Task f7cbce95-23df-45c8-8432-fb34a5ebda64 has 0 error(s)
--------------------------------------------------------------------------------

+------------------------------------------------------------------------------------------------------------------------+
|                                                  Response Times (sec)                                                  |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_port | 1.977     | 1.977        | 1.977        | 1.977        | 1.977     | 1.977     | 100.0%  | 1     |
| neutron.list_ports  | 0.137     | 0.137        | 0.137        | 0.137        | 0.137     | 0.137     | 100.0%  | 1     |
| total               | 2.115     | 2.115        | 2.115        | 2.115        | 2.115     | 2.115     | 100.0%  | 1     |
|  -> duration        | 2.115     | 2.115        | 2.115        | 2.115        | 2.115     | 2.115     | 100.0%  | 1     |
|  -> idle_duration   | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 2.114535
Full duration: 30.066174
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_list_routers
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "network_create_args": {}, 
    "router_create_args": {}, 
    "subnet_cidr_start": "1.1.0.0/30", 
    "subnet_create_args": {}, 
    "subnets_per_network": 1
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }, 
    "network": {}, 
    "quotas": {
      "neutron": {
        "network": -1, 
        "subnet": -1, 
        "router": -1
      }
    }
  }
}

--------------------------------------------------------------------------------
Task f7cbce95-23df-45c8-8432-fb34a5ebda64 has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------------+
|                                                      Response Times (sec)                                                       |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                       | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network       | 1.139     | 1.139        | 1.139        | 1.139        | 1.139     | 1.139     | 100.0%  | 1     |
| neutron.create_subnet        | 0.808     | 0.808        | 0.808        | 0.808        | 0.808     | 0.808     | 100.0%  | 1     |
| neutron.create_router        | 0.353     | 0.353        | 0.353        | 0.353        | 0.353     | 0.353     | 100.0%  | 1     |
| neutron.add_interface_router | 2.321     | 2.321        | 2.321        | 2.321        | 2.321     | 2.321     | 100.0%  | 1     |
| neutron.list_routers         | 0.109     | 0.109        | 0.109        | 0.109        | 0.109     | 0.109     | 100.0%  | 1     |
| total                        | 4.732     | 4.732        | 4.732        | 4.732        | 4.732     | 4.732     | 100.0%  | 1     |
|  -> duration                 | 4.732     | 4.732        | 4.732        | 4.732        | 4.732     | 4.732     | 100.0%  | 1     |
|  -> idle_duration            | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 4.731773
Full duration: 41.294913
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_list_subnets
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "network_create_args": {}, 
    "subnet_cidr_start": "1.1.0.0/30", 
    "subnet_create_args": {}, 
    "subnets_per_network": 1
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }, 
    "network": {}, 
    "quotas": {
      "neutron": {
        "network": -1, 
        "subnet": -1
      }
    }
  }
}

--------------------------------------------------------------------------------
Task f7cbce95-23df-45c8-8432-fb34a5ebda64 has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------+
|                                                   Response Times (sec)                                                    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 1.097     | 1.097        | 1.097        | 1.097        | 1.097     | 1.097     | 100.0%  | 1     |
| neutron.create_subnet  | 0.778     | 0.778        | 0.778        | 0.778        | 0.778     | 0.778     | 100.0%  | 1     |
| neutron.list_subnets   | 0.107     | 0.107        | 0.107        | 0.107        | 0.107     | 0.107     | 100.0%  | 1     |
| total                  | 1.982     | 1.982        | 1.982        | 1.982        | 1.982     | 1.982     | 100.0%  | 1     |
|  -> duration           | 1.982     | 1.982        | 1.982        | 1.982        | 1.982     | 1.982     | 100.0%  | 1     |
|  -> idle_duration      | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 1.982396
Full duration: 34.948576
--------------------------------------------------------------------------------

test scenario NeutronSecurityGroup.create_and_delete_security_groups
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {}, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }, 
    "quotas": {
      "neutron": {
        "security_group": -1
      }
    }
  }
}

--------------------------------------------------------------------------------
Task f7cbce95-23df-45c8-8432-fb34a5ebda64 has 0 error(s)
--------------------------------------------------------------------------------

+----------------------------------------------------------------------------------------------------------------------------------+
|                                                       Response Times (sec)                                                       |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                        | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_security_group | 1.434     | 1.434        | 1.434        | 1.434        | 1.434     | 1.434     | 100.0%  | 1     |
| neutron.delete_security_group | 0.248     | 0.248        | 0.248        | 0.248        | 0.248     | 0.248     | 100.0%  | 1     |
| total                         | 1.682     | 1.682        | 1.682        | 1.682        | 1.682     | 1.682     | 100.0%  | 1     |
|  -> duration                  | 1.682     | 1.682        | 1.682        | 1.682        | 1.682     | 1.682     | 100.0%  | 1     |
|  -> idle_duration             | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 1.681679
Full duration: 14.587281
--------------------------------------------------------------------------------

test scenario NeutronSecurityGroup.create_and_delete_security_group_rule
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {}, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }, 
    "quotas": {
      "neutron": {
        "security_group": -1
      }
    }
  }
}

--------------------------------------------------------------------------------
Task f7cbce95-23df-45c8-8432-fb34a5ebda64 has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------------------+
|                                                         Response Times (sec)                                                          |
+------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                             | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_security_group      | 1.27      | 1.27         | 1.27         | 1.27         | 1.27      | 1.27      | 100.0%  | 1     |
| neutron.create_security_group_rule | 0.453     | 0.453        | 0.453        | 0.453        | 0.453     | 0.453     | 100.0%  | 1     |
| neutron.delete_security_group_rule | 0.172     | 0.172        | 0.172        | 0.172        | 0.172     | 0.172     | 100.0%  | 1     |
| neutron.delete_security_group      | 0.274     | 0.274        | 0.274        | 0.274        | 0.274     | 0.274     | 100.0%  | 1     |
| total                              | 2.17      | 2.17         | 2.17         | 2.17         | 2.17      | 2.17      | 100.0%  | 1     |
|  -> duration                       | 2.17      | 2.17         | 2.17         | 2.17         | 2.17      | 2.17      | 100.0%  | 1     |
|  -> idle_duration                  | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 2.169764
Full duration: 14.951264
--------------------------------------------------------------------------------

test scenario NeutronNetworks.set_and_clear_router_gateway
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "network_create_args": {
      "router:external": true
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }, 
    "quotas": {
      "neutron": {
        "network": -1, 
        "router": -1
      }
    }, 
    "roles": [
      "admin"
    ]
  }
}

--------------------------------------------------------------------------------
Task f7cbce95-23df-45c8-8432-fb34a5ebda64 has 0 error(s)
--------------------------------------------------------------------------------

+----------------------------------------------------------------------------------------------------------------------------------+
|                                                       Response Times (sec)                                                       |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                        | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network        | 1.366     | 1.366        | 1.366        | 1.366        | 1.366     | 1.366     | 100.0%  | 1     |
| neutron.create_router         | 0.37      | 0.37         | 0.37         | 0.37         | 0.37      | 0.37      | 100.0%  | 1     |
| neutron.add_gateway_router    | 1.683     | 1.683        | 1.683        | 1.683        | 1.683     | 1.683     | 100.0%  | 1     |
| neutron.remove_gateway_router | 1.224     | 1.224        | 1.224        | 1.224        | 1.224     | 1.224     | 100.0%  | 1     |
| total                         | 4.643     | 4.643        | 4.643        | 4.643        | 4.643     | 4.643     | 100.0%  | 1     |
|  -> duration                  | 4.643     | 4.643        | 4.643        | 4.643        | 4.643     | 4.643     | 100.0%  | 1     |
|  -> idle_duration             | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 4.643206
Full duration: 25.648138

HINTS:
* To plot HTML graphics with this data, run:
	rally task report f7cbce95-23df-45c8-8432-fb34a5ebda64 --out output.html

* To generate a JUnit report, run:
	rally task export f7cbce95-23df-45c8-8432-fb34a5ebda64 --type junit --to output.xml

* To get raw JSON output of task results, run:
	rally task report f7cbce95-23df-45c8-8432-fb34a5ebda64 --json --out output.json


2018-01-30 20:48:55,745 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'f7cbce95-23df-45c8-8432-fb34a5ebda64']
2018-01-30 20:48:57,364 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file
2018-01-30 20:48:57,364 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'f7cbce95-23df-45c8-8432-fb34a5ebda64', '--out', '/home/opnfv/functest/results/rally/opnfv-neutron.html']
2018-01-30 20:48:57,373 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK.

2018-01-30 20:48:57,373 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ...
2018-01-30 20:48:57,373 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-nova.yaml
2018-01-30 20:48:57,373 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2018-01-30 20:48:57,410 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats']
2018-01-30 20:48:57,415 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'admin_external', 'service_list': ['nova'], 'concurrency': 4, 'netid': '6a7221bb-03d8-468e-b2de-eff15c54b7cb', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-a6e57923-a4bb-4b6a-b373-e031172c7cc0', 'flavor_name': 'rally-tiny-a6e57923-a4bb-4b6a-b373-e031172c7cc0', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-a6e57923-a4bb-4b6a-b373-e031172c7cc0', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"]
2018-01-30 20:56:20,815 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 7de9e894-3a07-41fe-90dd-0dc795765e8a
2018-01-30 20:56:20,816 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '7de9e894-3a07-41fe-90dd-0dc795765e8a']
2018-01-30 20:56:22,394 - functest.opnfv_tests.openstack.rally.rally - INFO - 
--------------------------------------------------------------------------------
Task 7de9e894-3a07-41fe-90dd-0dc795765e8a: finished
--------------------------------------------------------------------------------

test scenario NovaServers.boot_and_live_migrate_server
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "flavor": {
      "name": "rally-tiny-a6e57923-a4bb-4b6a-b373-e031172c7cc0"
    }, 
    "image": {
      "name": "Cirros-0.4.0-a6e57923-a4bb-4b6a-b373-e031172c7cc0"
    }, 
    "block_migration": false, 
    "nics": [
      {
        "net-id": "6a7221bb-03d8-468e-b2de-eff15c54b7cb"
      }
    ]
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }
  }
}

--------------------------------------------------------------------------------
Task 7de9e894-3a07-41fe-90dd-0dc795765e8a has 0 error(s)
--------------------------------------------------------------------------------

+------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                     |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                    | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.boot_server          | 12.386    | 12.386       | 12.386       | 12.386       | 12.386    | 12.386    | 100.0%  | 1     |
| nova.find_host_to_migrate | 0.928     | 0.928        | 0.928        | 0.928        | 0.928     | 0.928     | 100.0%  | 1     |
| nova.live_migrate         | 9.475     | 9.475        | 9.475        | 9.475        | 9.475     | 9.475     | 100.0%  | 1     |
| nova.delete_server        | 2.558     | 2.558        | 2.558        | 2.558        | 2.558     | 2.558     | 100.0%  | 1     |
| total                     | 25.348    | 25.348       | 25.348       | 25.348       | 25.348    | 25.348    | 100.0%  | 1     |
|  -> duration              | 24.348    | 24.348       | 24.348       | 24.348       | 24.348    | 24.348    | 100.0%  | 1     |
|  -> idle_duration         | 1.0       | 1.0          | 1.0          | 1.0          | 1.0       | 1.0       | 100.0%  | 1     |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 24.347636
Full duration: 33.91155
--------------------------------------------------------------------------------

test scenario NovaServers.boot_server_attach_created_volume_and_live_migrate
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "flavor": {
      "name": "rally-tiny-a6e57923-a4bb-4b6a-b373-e031172c7cc0"
    }, 
    "image": {
      "name": "Cirros-0.4.0-a6e57923-a4bb-4b6a-b373-e031172c7cc0"
    }, 
    "size": 10, 
    "block_migration": false, 
    "boot_server_kwargs": {
      "nics": [
        {
          "net-id": "6a7221bb-03d8-468e-b2de-eff15c54b7cb"
        }
      ]
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }
  }
}

--------------------------------------------------------------------------------
Task 7de9e894-3a07-41fe-90dd-0dc795765e8a has 0 error(s)
--------------------------------------------------------------------------------

+------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                     |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                    | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.boot_server          | 12.12     | 12.12        | 12.12        | 12.12        | 12.12     | 12.12     | 100.0%  | 1     |
| cinder_v2.create_volume   | 2.724     | 2.724        | 2.724        | 2.724        | 2.724     | 2.724     | 100.0%  | 1     |
| nova.attach_volume        | 4.18      | 4.18         | 4.18         | 4.18         | 4.18      | 4.18      | 100.0%  | 1     |
| nova.find_host_to_migrate | 0.983     | 0.983        | 0.983        | 0.983        | 0.983     | 0.983     | 100.0%  | 1     |
| nova.live_migrate         | 13.867    | 13.867       | 13.867       | 13.867       | 13.867    | 13.867    | 100.0%  | 1     |
| nova.detach_volume        | 3.725     | 3.725        | 3.725        | 3.725        | 3.725     | 3.725     | 100.0%  | 1     |
| cinder_v2.delete_volume   | 2.32      | 2.32         | 2.32         | 2.32         | 2.32      | 2.32      | 100.0%  | 1     |
| nova.delete_server        | 2.629     | 2.629        | 2.629        | 2.629        | 2.629     | 2.629     | 100.0%  | 1     |
| total                     | 42.548    | 42.548       | 42.548       | 42.548       | 42.548    | 42.548    | 100.0%  | 1     |
|  -> duration              | 41.548    | 41.548       | 41.548       | 41.548       | 41.548    | 41.548    | 100.0%  | 1     |
|  -> idle_duration         | 1.0       | 1.0          | 1.0          | 1.0          | 1.0       | 1.0       | 100.0%  | 1     |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 41.548418
Full duration: 54.019174
--------------------------------------------------------------------------------

test scenario NovaServers.boot_server_from_volume_and_live_migrate
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "flavor": {
      "name": "rally-tiny-a6e57923-a4bb-4b6a-b373-e031172c7cc0"
    }, 
    "image": {
      "name": "Cirros-0.4.0-a6e57923-a4bb-4b6a-b373-e031172c7cc0"
    }, 
    "block_migration": false, 
    "volume_size": 10, 
    "force_delete": false, 
    "nics": [
      {
        "net-id": "6a7221bb-03d8-468e-b2de-eff15c54b7cb"
      }
    ]
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }
  }
}

--------------------------------------------------------------------------------
Task 7de9e894-3a07-41fe-90dd-0dc795765e8a has 0 error(s)
--------------------------------------------------------------------------------

+------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                     |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                    | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v2.create_volume   | 7.864     | 7.864        | 7.864        | 7.864        | 7.864     | 7.864     | 100.0%  | 1     |
| nova.boot_server          | 12.171    | 12.171       | 12.171       | 12.171       | 12.171    | 12.171    | 100.0%  | 1     |
| nova.find_host_to_migrate | 1.032     | 1.032        | 1.032        | 1.032        | 1.032     | 1.032     | 100.0%  | 1     |
| nova.live_migrate         | 11.302    | 11.302       | 11.302       | 11.302       | 11.302    | 11.302    | 100.0%  | 1     |
| nova.delete_server        | 4.948     | 4.948        | 4.948        | 4.948        | 4.948     | 4.948     | 100.0%  | 1     |
| total                     | 37.318    | 37.318       | 37.318       | 37.318       | 37.318    | 37.318    | 100.0%  | 1     |
|  -> duration              | 36.318    | 36.318       | 36.318       | 36.318       | 36.318    | 36.318    | 100.0%  | 1     |
|  -> idle_duration         | 1.0       | 1.0          | 1.0          | 1.0          | 1.0       | 1.0       | 100.0%  | 1     |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 36.317887
Full duration: 48.544451
--------------------------------------------------------------------------------

test scenario NovaKeypair.boot_and_delete_server_with_keypair
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "flavor": {
      "name": "rally-tiny-a6e57923-a4bb-4b6a-b373-e031172c7cc0"
    }, 
    "image": {
      "name": "Cirros-0.4.0-a6e57923-a4bb-4b6a-b373-e031172c7cc0"
    }, 
    "server_kwargs": {
      "nics": [
        {
          "net-id": "6a7221bb-03d8-468e-b2de-eff15c54b7cb"
        }
      ]
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }, 
    "network": {
      "networks_per_tenant": 1, 
      "start_cidr": "100.1.0.0/25"
    }, 
    "quotas": {
      "neutron": {
        "network": -1, 
        "port": -1, 
        "subnet": -1
      }, 
      "nova": {
        "cores": -1, 
        "floating_ips": -1, 
        "instances": -1, 
        "key_pairs": -1, 
        "ram": -1, 
        "security_group_rules": -1, 
        "security_groups": -1
      }
    }
  }
}

--------------------------------------------------------------------------------
Task 7de9e894-3a07-41fe-90dd-0dc795765e8a has 0 error(s)
--------------------------------------------------------------------------------

+------------------------------------------------------------------------------------------------------------------------+
|                                                  Response Times (sec)                                                  |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.create_keypair | 1.103     | 1.103        | 1.103        | 1.103        | 1.103     | 1.103     | 100.0%  | 1     |
| nova.boot_server    | 8.888     | 8.888        | 8.888        | 8.888        | 8.888     | 8.888     | 100.0%  | 1     |
| nova.delete_server  | 2.624     | 2.624        | 2.624        | 2.624        | 2.624     | 2.624     | 100.0%  | 1     |
| nova.delete_keypair | 0.074     | 0.074        | 0.074        | 0.074        | 0.074     | 0.074     | 100.0%  | 1     |
| total               | 12.692    | 12.692       | 12.692       | 12.692       | 12.692    | 12.692    | 100.0%  | 1     |
|  -> duration        | 11.692    | 11.692       | 11.692       | 11.692       | 11.692    | 11.692    | 100.0%  | 1     |
|  -> idle_duration   | 1.0       | 1.0          | 1.0          | 1.0          | 1.0       | 1.0       | 100.0%  | 1     |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 11.692139
Full duration: 36.332878
--------------------------------------------------------------------------------

test scenario NovaServers.boot_server_from_volume_and_delete
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "flavor": {
      "name": "rally-tiny-a6e57923-a4bb-4b6a-b373-e031172c7cc0"
    }, 
    "image": {
      "name": "Cirros-0.4.0-a6e57923-a4bb-4b6a-b373-e031172c7cc0"
    }, 
    "volume_size": 5, 
    "nics": [
      {
        "net-id": "6a7221bb-03d8-468e-b2de-eff15c54b7cb"
      }
    ]
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }, 
    "network": {
      "networks_per_tenant": 1, 
      "start_cidr": "100.1.0.0/25"
    }, 
    "quotas": {
      "cinder": {
        "gigabytes": -1, 
        "snapshots": -1, 
        "volumes": -1
      }, 
      "neutron": {
        "network": -1, 
        "port": -1, 
        "subnet": -1
      }, 
      "nova": {
        "cores": -1, 
        "floating_ips": -1, 
        "instances": -1, 
        "ram": -1, 
        "security_group_rules": -1, 
        "security_groups": -1
      }
    }
  }
}

--------------------------------------------------------------------------------
Task 7de9e894-3a07-41fe-90dd-0dc795765e8a has 0 error(s)
--------------------------------------------------------------------------------

+----------------------------------------------------------------------------------------------------------------------------+
|                                                    Response Times (sec)                                                    |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                  | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v2.create_volume | 7.573     | 7.573        | 7.573        | 7.573        | 7.573     | 7.573     | 100.0%  | 1     |
| nova.boot_server        | 11.419    | 11.419       | 11.419       | 11.419       | 11.419    | 11.419    | 100.0%  | 1     |
| nova.delete_server      | 4.834     | 4.834        | 4.834        | 4.834        | 4.834     | 4.834     | 100.0%  | 1     |
| total                   | 23.826    | 23.826       | 23.826       | 23.826       | 23.826    | 23.826    | 100.0%  | 1     |
|  -> duration            | 22.826    | 22.826       | 22.826       | 22.826       | 22.826    | 22.826    | 100.0%  | 1     |
|  -> idle_duration       | 1.0       | 1.0          | 1.0          | 1.0          | 1.0       | 1.0       | 100.0%  | 1     |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 22.826099
Full duration: 49.318153
--------------------------------------------------------------------------------

test scenario NovaServers.pause_and_unpause_server
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "flavor": {
      "name": "rally-tiny-a6e57923-a4bb-4b6a-b373-e031172c7cc0"
    }, 
    "image": {
      "name": "Cirros-0.4.0-a6e57923-a4bb-4b6a-b373-e031172c7cc0"
    }, 
    "force_delete": false, 
    "nics": [
      {
        "net-id": "6a7221bb-03d8-468e-b2de-eff15c54b7cb"
      }
    ]
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }, 
    "network": {
      "networks_per_tenant": 1, 
      "start_cidr": "100.1.0.0/25"
    }, 
    "quotas": {
      "neutron": {
        "network": -1, 
        "port": -1, 
        "subnet": -1
      }, 
      "nova": {
        "cores": -1, 
        "floating_ips": -1, 
        "instances": -1, 
        "ram": -1, 
        "security_group_rules": -1, 
        "security_groups": -1
      }
    }
  }
}

--------------------------------------------------------------------------------
Task 7de9e894-3a07-41fe-90dd-0dc795765e8a has 0 error(s)
--------------------------------------------------------------------------------

+------------------------------------------------------------------------------------------------------------------------+
|                                                  Response Times (sec)                                                  |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.boot_server    | 9.833     | 9.833        | 9.833        | 9.833        | 9.833     | 9.833     | 100.0%  | 1     |
| nova.pause_server   | 2.792     | 2.792        | 2.792        | 2.792        | 2.792     | 2.792     | 100.0%  | 1     |
| nova.unpause_server | 2.561     | 2.561        | 2.561        | 2.561        | 2.561     | 2.561     | 100.0%  | 1     |
| nova.delete_server  | 2.598     | 2.598        | 2.598        | 2.598        | 2.598     | 2.598     | 100.0%  | 1     |
| total               | 17.784    | 17.784       | 17.784       | 17.784       | 17.784    | 17.784    | 100.0%  | 1     |
|  -> duration        | 12.784    | 12.784       | 12.784       | 12.784       | 12.784    | 12.784    | 100.0%  | 1     |
|  -> idle_duration   | 5.0       | 5.0          | 5.0          | 5.0          | 5.0       | 5.0       | 100.0%  | 1     |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 12.783597
Full duration: 41.005026
--------------------------------------------------------------------------------

test scenario NovaServers.boot_and_migrate_server
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "flavor": {
      "name": "rally-tiny-a6e57923-a4bb-4b6a-b373-e031172c7cc0"
    }, 
    "image": {
      "name": "Cirros-0.4.0-a6e57923-a4bb-4b6a-b373-e031172c7cc0"
    }, 
    "nics": [
      {
        "net-id": "6a7221bb-03d8-468e-b2de-eff15c54b7cb"
      }
    ]
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }
  }
}

--------------------------------------------------------------------------------
Task 7de9e894-3a07-41fe-90dd-0dc795765e8a has 0 error(s)
--------------------------------------------------------------------------------

+------------------------------------------------------------------------------------------------------------------------+
|                                                  Response Times (sec)                                                  |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.boot_server    | 11.667    | 11.667       | 11.667       | 11.667       | 11.667    | 11.667    | 100.0%  | 1     |
| nova.migrate        | 70.147    | 70.147       | 70.147       | 70.147       | 70.147    | 70.147    | 100.0%  | 1     |
| nova.resize_confirm | 2.924     | 2.924        | 2.924        | 2.924        | 2.924     | 2.924     | 100.0%  | 1     |
| nova.delete_server  | 2.588     | 2.588        | 2.588        | 2.588        | 2.588     | 2.588     | 100.0%  | 1     |
| total               | 87.327    | 87.327       | 87.327       | 87.327       | 87.327    | 87.327    | 100.0%  | 1     |
|  -> duration        | 86.327    | 86.327       | 86.327       | 86.327       | 86.327    | 86.327    | 100.0%  | 1     |
|  -> idle_duration   | 1.0       | 1.0          | 1.0          | 1.0          | 1.0       | 1.0       | 100.0%  | 1     |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 86.326807
Full duration: 98.199849
--------------------------------------------------------------------------------

test scenario NovaServers.boot_server_and_list_interfaces
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "flavor": {
      "name": "rally-tiny-a6e57923-a4bb-4b6a-b373-e031172c7cc0"
    }, 
    "image": {
      "name": "Cirros-0.4.0-a6e57923-a4bb-4b6a-b373-e031172c7cc0"
    }, 
    "auto_assign_nic": true
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }, 
    "network": {}
  }
}

--------------------------------------------------------------------------------
Task 7de9e894-3a07-41fe-90dd-0dc795765e8a has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------+
|                                                  Response Times (sec)                                                   |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.boot_server     | 11.878    | 11.878       | 11.878       | 11.878       | 11.878    | 11.878    | 100.0%  | 1     |
| nova.list_interfaces | 0.183     | 0.183        | 0.183        | 0.183        | 0.183     | 0.183     | 100.0%  | 1     |
| total                | 12.061    | 12.061       | 12.061       | 12.061       | 12.061    | 12.061    | 100.0%  | 1     |
|  -> duration         | 11.061    | 11.061       | 11.061       | 11.061       | 11.061    | 11.061    | 100.0%  | 1     |
|  -> idle_duration    | 1.0       | 1.0          | 1.0          | 1.0          | 1.0       | 1.0       | 100.0%  | 1     |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 11.06149
Full duration: 39.338299
--------------------------------------------------------------------------------

test scenario NovaServerGroups.create_and_delete_server_group
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "policies": [
      "affinity"
    ]
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }
  }
}

--------------------------------------------------------------------------------
Task 7de9e894-3a07-41fe-90dd-0dc795765e8a has 0 error(s)
--------------------------------------------------------------------------------

+-----------------------------------------------------------------------------------------------------------------------------+
|                                                    Response Times (sec)                                                     |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                   | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.create_server_group | 0.822     | 0.822        | 0.822        | 0.822        | 0.822     | 0.822     | 100.0%  | 1     |
| nova.delete_server_group | 0.132     | 0.132        | 0.132        | 0.132        | 0.132     | 0.132     | 100.0%  | 1     |
| total                    | 0.955     | 0.955        | 0.955        | 0.955        | 0.955     | 0.955     | 100.0%  | 1     |
|  -> duration             | 0.955     | 0.955        | 0.955        | 0.955        | 0.955     | 0.955     | 100.0%  | 1     |
|  -> idle_duration        | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 0.954584
Full duration: 9.644627

HINTS:
* To plot HTML graphics with this data, run:
	rally task report 7de9e894-3a07-41fe-90dd-0dc795765e8a --out output.html

* To generate a JUnit report, run:
	rally task export 7de9e894-3a07-41fe-90dd-0dc795765e8a --type junit --to output.xml

* To get raw JSON output of task results, run:
	rally task report 7de9e894-3a07-41fe-90dd-0dc795765e8a --json --out output.json


2018-01-30 20:56:22,395 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '7de9e894-3a07-41fe-90dd-0dc795765e8a']
2018-01-30 20:56:23,961 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file
2018-01-30 20:56:23,961 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '7de9e894-3a07-41fe-90dd-0dc795765e8a', '--out', '/home/opnfv/functest/results/rally/opnfv-nova.html']
2018-01-30 20:56:23,970 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" OK.

2018-01-30 20:56:23,971 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ...
2018-01-30 20:56:23,971 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-quotas.yaml
2018-01-30 20:56:23,971 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2018-01-30 20:56:24,008 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats']
2018-01-30 20:56:24,010 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'admin_external', 'service_list': ['quotas'], 'concurrency': 4, 'netid': '6a7221bb-03d8-468e-b2de-eff15c54b7cb', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-a6e57923-a4bb-4b6a-b373-e031172c7cc0', 'flavor_name': 'rally-tiny-a6e57923-a4bb-4b6a-b373-e031172c7cc0', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-a6e57923-a4bb-4b6a-b373-e031172c7cc0', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"]
2018-01-30 20:57:29,632 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : b6a068e5-23ae-47e3-a179-ca1c1cd402b4
2018-01-30 20:57:29,632 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'b6a068e5-23ae-47e3-a179-ca1c1cd402b4']
2018-01-30 20:57:31,089 - functest.opnfv_tests.openstack.rally.rally - INFO - 
--------------------------------------------------------------------------------
Task b6a068e5-23ae-47e3-a179-ca1c1cd402b4: finished
--------------------------------------------------------------------------------

test scenario Quotas.cinder_update_and_delete
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "max_quota": 1024
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }
  }
}

--------------------------------------------------------------------------------
Task b6a068e5-23ae-47e3-a179-ca1c1cd402b4 has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------+
|                                                  Response Times (sec)                                                   |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| quotas.update_quotas | 0.999     | 0.999        | 0.999        | 0.999        | 0.999     | 0.999     | 100.0%  | 1     |
| quotas.delete_quotas | 0.054     | 0.054        | 0.054        | 0.054        | 0.054     | 0.054     | 100.0%  | 1     |
| total                | 1.053     | 1.053        | 1.053        | 1.053        | 1.053     | 1.053     | 100.0%  | 1     |
|  -> duration         | 1.053     | 1.053        | 1.053        | 1.053        | 1.053     | 1.053     | 100.0%  | 1     |
|  -> idle_duration    | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 1.05341
Full duration: 8.811343
--------------------------------------------------------------------------------

test scenario Quotas.cinder_update
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "max_quota": 1024
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }
  }
}

--------------------------------------------------------------------------------
Task b6a068e5-23ae-47e3-a179-ca1c1cd402b4 has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------+
|                                                  Response Times (sec)                                                   |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| quotas.update_quotas | 0.867     | 0.867        | 0.867        | 0.867        | 0.867     | 0.867     | 100.0%  | 1     |
| total                | 0.867     | 0.867        | 0.867        | 0.867        | 0.867     | 0.867     | 100.0%  | 1     |
|  -> duration         | 0.867     | 0.867        | 0.867        | 0.867        | 0.867     | 0.867     | 100.0%  | 1     |
|  -> idle_duration    | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 0.867208
Full duration: 8.748233
--------------------------------------------------------------------------------

test scenario Quotas.neutron_update
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "max_quota": 1024
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }
  }
}

--------------------------------------------------------------------------------
Task b6a068e5-23ae-47e3-a179-ca1c1cd402b4 has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------+
|                                                  Response Times (sec)                                                   |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| quotas.update_quotas | 0.504     | 0.504        | 0.504        | 0.504        | 0.504     | 0.504     | 100.0%  | 1     |
| total                | 1.012     | 1.012        | 1.012        | 1.012        | 1.012     | 1.012     | 100.0%  | 1     |
|  -> duration         | 1.012     | 1.012        | 1.012        | 1.012        | 1.012     | 1.012     | 100.0%  | 1     |
|  -> idle_duration    | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 1.011831
Full duration: 8.941864
--------------------------------------------------------------------------------

test scenario Quotas.nova_update_and_delete
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "max_quota": 1024
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }
  }
}

--------------------------------------------------------------------------------
Task b6a068e5-23ae-47e3-a179-ca1c1cd402b4 has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------+
|                                                  Response Times (sec)                                                   |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| quotas.update_quotas | 1.074     | 1.074        | 1.074        | 1.074        | 1.074     | 1.074     | 100.0%  | 1     |
| quotas.delete_quotas | 0.045     | 0.045        | 0.045        | 0.045        | 0.045     | 0.045     | 100.0%  | 1     |
| total                | 1.119     | 1.119        | 1.119        | 1.119        | 1.119     | 1.119     | 100.0%  | 1     |
|  -> duration         | 1.119     | 1.119        | 1.119        | 1.119        | 1.119     | 1.119     | 100.0%  | 1     |
|  -> idle_duration    | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 1.118941
Full duration: 9.290321
--------------------------------------------------------------------------------

test scenario Quotas.nova_update
args position 0
args values:
{
  "runner": {
    "concurrency": 1, 
    "times": 1
  }, 
  "hooks": [], 
  "args": {
    "max_quota": 1024
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "context": {
    "users": {
      "tenants": 1, 
      "users_per_tenant": 1
    }
  }
}

--------------------------------------------------------------------------------
Task b6a068e5-23ae-47e3-a179-ca1c1cd402b4 has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------+
|                                                  Response Times (sec)                                                   |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| quotas.update_quotas | 1.04      | 1.04         | 1.04         | 1.04         | 1.04      | 1.04      | 100.0%  | 1     |
| total                | 1.04      | 1.04         | 1.04         | 1.04         | 1.04      | 1.04      | 100.0%  | 1     |
|  -> duration         | 1.04      | 1.04         | 1.04         | 1.04         | 1.04      | 1.04      | 100.0%  | 1     |
|  -> idle_duration    | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 1     |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 1.039835
Full duration: 8.84043

HINTS:
* To plot HTML graphics with this data, run:
	rally task report b6a068e5-23ae-47e3-a179-ca1c1cd402b4 --out output.html

* To generate a JUnit report, run:
	rally task export b6a068e5-23ae-47e3-a179-ca1c1cd402b4 --type junit --to output.xml

* To get raw JSON output of task results, run:
	rally task report b6a068e5-23ae-47e3-a179-ca1c1cd402b4 --json --out output.json


2018-01-30 20:57:31,089 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'b6a068e5-23ae-47e3-a179-ca1c1cd402b4']
2018-01-30 20:57:32,553 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file
2018-01-30 20:57:32,554 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'b6a068e5-23ae-47e3-a179-ca1c1cd402b4', '--out', '/home/opnfv/functest/results/rally/opnfv-quotas.html']
2018-01-30 20:57:32,561 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK.

2018-01-30 20:57:32,565 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report:

+----------------+------------+----------------+-----------+
|  Module        |  Duration  |  nb. Test Run  |  Success  |
+----------------+------------+----------------+-----------+
|  authenticate  |     00:47  |       6        |  100.00%  |
|  glance        |     01:10  |       4        |  100.00%  |
|  cinder        |     02:45  |       10       |  100.00%  |
|  heat          |     01:14  |       4        |  100.00%  |
|  keystone      |     02:50  |       11       |  100.00%  |
|  neutron       |     04:55  |       11       |  100.00%  |
|  nova          |     06:50  |       9        |  100.00%  |
|  quotas        |     00:44  |       5        |  100.00%  |
|                |            |                |           |
|  TOTAL:        |  00:21:18  |       60       |  100.00%  |
+----------------+------------+----------------+-----------+

2018-01-30 20:57:32,565 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_sanity' success_rate is 100.00%
2018-01-30 20:57:40,439 - functest.energy.energy - DEBUG - Stopping recording
2018-01-30 20:57:41,224 - functest.core.testcase - ERROR - Please set env var: 'TEST_DB_URL'
2018-01-30 20:57:41,225 - functest.ci.run_tests - INFO - Test result:

+----------------------+------------------+------------------+----------------+
|      TEST CASE       |     PROJECT      |     DURATION     |     RESULT     |
+----------------------+------------------+------------------+----------------+
|     rally_sanity     |     functest     |      25:38       |      PASS      |
+----------------------+------------------+------------------+----------------+

2018-01-30 20:57:41,229 - functest.ci.run_tests - INFO - Running test case 'refstack_defcore'...
2018-01-30 20:57:41,311 - functest.energy.energy - DEBUG - Getting current scenario
2018-01-30 20:57:41,949 - functest.energy.energy - INFO - No current running scenario at http://energy.opnfv.fr/resources/recorders/environment/zte-pod3
2018-01-30 20:57:41,949 - functest.energy.energy - DEBUG - Starting recording
2018-01-30 20:57:41,949 - functest.energy.energy - DEBUG - Submitting scenario (refstack_defcore/running)
2018-01-30 20:57:42,663 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment...
2018-01-30 20:57:46,337 - functest.utils.functest_utils - DEBUG - Executing command: 'rally deployment create --fromenv --name=opnfv-rally'
2018-01-30 20:57:50,077 - functest.utils.functest_utils - DEBUG - Executing command: 'rally deployment check'
2018-01-30 20:57:54,742 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo...
2018-01-30 20:57:58,408 - functest.utils.functest_utils - DEBUG - Executing command: 'rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide'
2018-01-30 20:58:08,065 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating project (tenant) for Tempest suite
2018-01-30 20:58:08,661 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating user for Tempest suite
2018-01-30 20:58:09,634 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite
2018-01-30 20:58:13,925 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating image for Tempest suite
2018-01-30 20:58:13,925 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating image for Tempest suite
2018-01-30 20:58:15,872 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating 2nd image for Tempest suite
2018-01-30 20:58:15,873 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating 2nd image for Tempest suite
2018-01-30 20:58:17,919 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating flavor for Tempest suite
2018-01-30 20:58:18,529 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating 2nd flavor for Tempest suite
2018-01-30 20:58:19,163 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Configuring the verifier...
2018-01-30 20:58:19,164 - functest.utils.functest_utils - DEBUG - Executing command: 'rally verify configure-verifier'
2018-01-30 20:58:23,524 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file...
2018-01-30 20:58:23,524 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters...
2018-01-30 20:58:23,527 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file
2018-01-30 20:58:23,529 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters for defcore...
2018-01-30 20:58:23,531 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add needed params into test_accounts.yaml...
2018-01-30 20:58:23,534 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - Starting Refstack_defcore test case: '['refstack-client', 'test', '-c', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/refstack_client/refstack_tempest.conf', '-v', '--test-list', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/refstack_client/defcore.txt']'.
2018-01-30 21:32:42,281 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors [0.146370s] ... ok
2018-01-30 21:32:42,282 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_with_detail [0.092394s] ... ok
2018-01-30 21:32:42,282 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image [8.047139s] ... ok
2018-01-30 21:32:42,282 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name [0.722752s] ... ok
2018-01-30 21:32:42,282 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_availability_zone.AZV2TestJSON.test_get_availability_zone_list_with_non_admin_user [0.235472s] ... ok
2018-01-30 21:32:42,283 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name [187.275707s] ... FAILED
2018-01-30 21:32:42,283 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers [0.113014s] ... ok
2018-01-30 21:32:42,283 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail [0.460255s] ... ok
2018-01-30 21:32:42,283 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus [187.468929s] ... FAILED
2018-01-30 21:32:42,283 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details [0.001156s] ... ok
2018-01-30 21:32:42,283 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name [187.318269s] ... FAILED
2018-01-30 21:32:42,283 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers [0.115728s] ... ok
2018-01-30 21:32:42,283 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail [0.396486s] ... ok
2018-01-30 21:32:42,283 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus [187.462817s] ... FAILED
2018-01-30 21:32:42,283 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details [0.001144s] ... ok
2018-01-30 21:32:42,284 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_active_server [7.361090s] ... ok
2018-01-30 21:32:42,284 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action [0.090528s] ... ok
2018-01-30 21:32:42,284 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions [3.021389s] ... ok
2018-01-30 21:32:42,284 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor [0.395531s] ... ok
2018-01-30 21:32:42,284 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image [0.428205s] ... ok
2018-01-30 21:32:42,284 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name [0.859361s] ... ok
2018-01-30 21:32:42,284 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status [0.482745s] ... ok
2018-01-30 21:32:42,284 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results [0.374035s] ... ok
2018-01-30 21:32:42,284 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_active_status [0.123740s] ... ok
2018-01-30 21:32:42,285 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor [0.126667s] ... ok
2018-01-30 21:32:42,285 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image [0.115172s] ... ok
2018-01-30 21:32:42,285 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit [0.111228s] ... ok
2018-01-30 21:32:42,285 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name [0.119365s] ... ok
2018-01-30 21:32:42,285 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard [0.243280s] ... ok
2018-01-30 21:32:42,285 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date [0.107399s] ... ok
2018-01-30 21:32:42,285 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date [0.021033s] ... ok
2018-01-30 21:32:42,285 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count [0.224969s] ... ok
2018-01-30 21:32:42,285 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value [0.017520s] ... ok
2018-01-30 21:32:42,285 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string [0.017426s] ... ok
2018-01-30 21:32:42,286 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor [0.054353s] ... ok
2018-01-30 21:32:42,286 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image [0.112286s] ... ok
2018-01-30 21:32:42,286 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name [0.106496s] ... ok
2018-01-30 21:32:42,286 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted [0.364537s] ... ok
2018-01-30 21:32:42,286 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing [0.026781s] ... ok
2018-01-30 21:32:42,286 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server [0.115346s] ... ok
2018-01-30 21:32:42,286 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server [66.982797s] ... ok
2018-01-30 21:32:42,286 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard [188.624596s] ... FAILED
2018-01-30 21:32:42,286 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server [281.386004s] ... FAILED
2018-01-30 21:32:42,286 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server [66.249511s] ... ok
2018-01-30 21:32:42,287 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item [0.567615s] ... ok
2018-01-30 21:32:42,287 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item [0.304942s] ... ok
2018-01-30 21:32:42,287 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata [0.468311s] ... ok
2018-01-30 21:32:42,287 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata [0.747281s] ... ok
2018-01-30 21:32:42,287 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item [0.605211s] ... ok
2018-01-30 21:32:42,287 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata [0.638804s] ... ok
2018-01-30 21:32:42,287 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password [1.580776s] ... ok
2018-01-30 21:32:42,287 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair [8.456155s] ... ok
2018-01-30 21:32:42,287 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name [13.646545s] ... ok
2018-01-30 21:32:42,287 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address [8.781116s] ... ok
2018-01-30 21:32:42,288 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name [56.034265s] ... ok
2018-01-30 21:32:42,288 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name [1.067677s] ... ok
2018-01-30 21:32:42,288 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit [1.032645s] ... ok
2018-01-30 21:32:42,288 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 [1.052448s] ... ok
2018-01-30 21:32:42,288 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor [1.172727s] ... ok
2018-01-30 21:32:42,288 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image [1.075258s] ... ok
2018-01-30 21:32:42,288 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid [1.094153s] ... ok
2018-01-30 21:32:42,288 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit [0.527539s] ... ok
2018-01-30 21:32:42,288 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id [0.370907s] ... ok
2018-01-30 21:32:42,289 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server [0.408485s] ... ok
2018-01-30 21:32:42,289 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address [1.065260s] ... ok
2018-01-30 21:32:42,289 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server [0.384562s] ... ok
2018-01-30 21:32:42,289 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_deleted_server [0.396463s] ... ok
2018-01-30 21:32:42,289 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server [0.397505s] ... ok
2018-01-30 21:32:42,289 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank [1.044901s] ... ok
2018-01-30 21:32:42,289 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server [0.521515s] ... ok
2018-01-30 21:32:42,289 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server [0.389629s] ... ok
2018-01-30 21:32:42,289 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 [0.364914s] ... ok
2018-01-30 21:32:42,289 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name [0.384826s] ... ok
2018-01-30 21:32:42,289 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas [0.189752s] ... ok
2018-01-30 21:32:42,290 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas [0.358732s] ... ok
2018-01-30 21:32:42,290 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.test_versions.TestVersions.test_list_api_versions [0.012380s] ... ok
2018-01-30 21:32:42,290 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_list_get_volume_attachments [27.153530s] ... ok
2018-01-30 21:32:42,290 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types [0.079093s] ... ok
2018-01-30 21:32:42,290 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources [0.028414s] ... ok
2018-01-30 21:32:42,290 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses [0.017884s] ... ok
2018-01-30 21:32:42,290 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.identity.v3.test_tokens.TokensV3Test.test_create_token [0.411382s] ... ok
2018-01-30 21:32:42,290 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image [0.941017s] ... ok
2018-01-30 21:32:42,290 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image [0.856008s] ... ok
2018-01-30 21:32:42,290 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_image_schema [0.012387s] ... ok
2018-01-30 21:32:42,291 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_images_schema [0.011449s] ... ok
2018-01-30 21:32:42,291 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_container_format [0.071115s] ... ok
2018-01-30 21:32:42,291 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_disk_format [0.056629s] ... ok
2018-01-30 21:32:42,291 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_limit [0.051219s] ... ok
2018-01-30 21:32:42,291 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_min_max_size [0.083967s] ... ok
2018-01-30 21:32:42,291 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_size [0.076645s] ... ok
2018-01-30 21:32:42,291 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_status [0.082983s] ... ok
2018-01-30 21:32:42,291 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_visibility [0.073916s] ... ok
2018-01-30 21:32:42,291 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_no_params [0.079090s] ... ok
2018-01-30 21:32:42,291 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_image_null_id [0.572128s] ... ok
2018-01-30 21:32:42,291 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_non_existing_image [0.022005s] ... ok
2018-01-30 21:32:42,292 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_delete_deleted_image [0.360751s] ... ok
2018-01-30 21:32:42,292 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_image_null_id [0.011638s] ... ok
2018-01-30 21:32:42,292 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_non_existent_image [0.020755s] ... ok
2018-01-30 21:32:42,292 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images_tags.ImagesTagsTest.test_update_delete_tags_for_image [1.079141s] ... ok
2018-01-30 21:32:42,292 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_delete_non_existing_tag [0.804806s] ... ok
2018-01-30 21:32:42,292 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_update_tags_for_non_existing_image [0.034007s] ... ok
2018-01-30 21:32:42,292 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_all_attributes [4.419911s] ... ok
2018-01-30 21:32:42,292 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_allocation_pools [3.818580s] ... ok
2018-01-30 21:32:42,292 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_dhcp_enabled [3.645628s] ... ok
2018-01-30 21:32:42,292 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw [3.676777s] ... ok
2018-01-30 21:32:42,292 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw_and_allocation_pools [5.353988s] ... ok
2018-01-30 21:32:42,293 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_host_routes_and_dns_nameservers [5.867323s] ... ok
2018-01-30 21:32:42,293 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_without_gateway [5.325493s] ... ok
2018-01-30 21:32:42,293 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet [5.009961s] ... ok
2018-01-30 21:32:42,293 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_delete_network_with_subnet [5.979955s] ... ok
2018-01-30 21:32:42,293 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_list_networks [0.234987s] ... ok
2018-01-30 21:32:42,293 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_list_networks_fields [0.185366s] ... ok
2018-01-30 21:32:42,293 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets [0.086370s] ... ok
2018-01-30 21:32:42,293 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets_fields [0.102491s] ... ok
2018-01-30 21:32:42,293 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_show_network [0.186573s] ... ok
2018-01-30 21:32:42,293 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_show_network_fields [0.174543s] ... ok
2018-01-30 21:32:42,294 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet [0.092239s] ... ok
2018-01-30 21:32:42,294 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet_fields [0.111175s] ... ok
2018-01-30 21:32:42,294 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_update_subnet_gw_dns_host_routes_dhcp [4.797788s] ... ok
2018-01-30 21:32:42,294 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_ports.PortsTestJSON.test_create_bulk_port [3.742816s] ... ok
2018-01-30 21:32:42,294 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools [4.887938s] ... ok
2018-01-30 21:32:42,294 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port [2.178785s] ... ok
2018-01-30 21:32:42,294 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_ports.PortsTestJSON.test_list_ports [0.129238s] ... ok
2018-01-30 21:32:42,294 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_ports.PortsTestJSON.test_list_ports_fields [0.092232s] ... ok
2018-01-30 21:32:42,294 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_ports.PortsTestJSON.test_show_port [0.233733s] ... ok
2018-01-30 21:32:42,294 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_ports.PortsTestJSON.test_show_port_fields [0.075027s] ... ok
2018-01-30 21:32:42,294 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group [1.644282s] ... ok
2018-01-30 21:32:42,295 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_additional_args [1.346787s] ... ok
2018-01-30 21:32:42,295 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_icmp_type_code [3.729360s] ... ok
2018-01-30 21:32:42,295 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_protocol_integer_value [1.068429s] ... ok
2018-01-30 21:32:42,295 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_group_id [2.516919s] ... ok
2018-01-30 21:32:42,295 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_ip_prefix [1.639288s] ... ok
2018-01-30 21:32:42,295 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule [2.084210s] ... ok
2018-01-30 21:32:42,295 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups [0.089639s] ... ok
2018-01-30 21:32:42,295 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_additional_default_security_group_fails [0.134024s] ... ok
2018-01-30 21:32:42,295 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_duplicate_security_group_rule_fails [1.565078s] ... ok
2018-01-30 21:32:42,295 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_ethertype [0.834120s] ... ok
2018-01-30 21:32:42,296 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_protocol [0.938214s] ... ok
2018-01-30 21:32:42,296 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_remote_ip_prefix [1.008109s] ... ok
2018-01-30 21:32:42,296 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_invalid_ports [1.433922s] ... ok
2018-01-30 21:32:42,296 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_remote_groupid [1.010619s] ... ok
2018-01-30 21:32:42,296 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_security_group [0.172296s] ... ok
2018-01-30 21:32:42,296 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_delete_non_existent_security_group [0.035220s] ... ok
2018-01-30 21:32:42,296 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group [0.034905s] ... ok
2018-01-30 21:32:42,296 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group_rule [0.029915s] ... ok
2018-01-30 21:32:42,296 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools [0.650100s] ... ok
2018-01-30 21:32:42,296 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_availability_zone.AvailabilityZoneTestJSON.test_get_availability_zone_list [0.727177s] ... ok
2018-01-30 21:32:42,296 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_extensions.ExtensionsTestJSON.test_list_extensions [0.646756s] ... ok
2018-01-30 21:32:42,297 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_crud_snapshot_metadata [0.814348s] ... ok
2018-01-30 21:32:42,297 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_update_show_snapshot_metadata_item [0.606444s] ... ok
2018-01-30 21:32:42,297 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_crud_volume_metadata [0.810001s] ... ok
2018-01-30 21:32:42,297 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_update_show_volume_metadata_item [0.519861s] ... ok
2018-01-30 21:32:42,297 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_reserve_unreserve_volume [0.539192s] ... ok
2018-01-30 21:32:42,297 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_bootable [0.385893s] ... ok
2018-01-30 21:32:42,297 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_readonly_update [0.401882s] ... ok
2018-01-30 21:32:42,297 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_upload [3.248572s] ... ok
2018-01-30 21:32:42,297 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete [6.889192s] ... ok
2018-01-30 21:32:42,297 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_as_clone [9.028912s] ... ok
2018-01-30 21:32:42,297 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image [9.758198s] ... ok
2018-01-30 21:32:42,298 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list [0.082908s] ... ok
2018-01-30 21:32:42,298 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_by_name [0.068905s] ... ok
2018-01-30 21:32:42,298 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_by_name [0.075306s] ... ok
2018-01-30 21:32:42,298 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_pagination [0.473762s] ... ok
2018-01-30 21:32:42,298 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_with_multiple_params [0.168718s] ... ok
2018-01-30 21:32:42,298 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_pagination [0.392227s] ... ok
2018-01-30 21:32:42,298 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_param_display_name_and_status [0.068393s] ... ok
2018-01-30 21:32:42,298 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_display_name_and_status [0.084575s] ... ok
2018-01-30 21:32:42,298 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_metadata [0.094683s] ... ok
2018-01-30 21:32:42,298 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_details [0.114382s] ... ok
2018-01-30 21:32:42,299 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_param_metadata [0.073515s] ... ok
2018-01-30 21:32:42,299 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_availability_zone [0.160621s] ... ok
2018-01-30 21:32:42,299 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_status [0.139401s] ... ok
2018-01-30 21:32:42,299 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_availability_zone [0.087245s] ... ok
2018-01-30 21:32:42,299 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_status [0.218697s] ... ok
2018-01-30 21:32:42,299 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_invalid_size [0.020589s] ... ok
2018-01-30 21:32:42,299 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_snapshot_id [0.042903s] ... ok
2018-01-30 21:32:42,299 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_source_volid [0.065708s] ... ok
2018-01-30 21:32:42,299 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_volume_type [0.029998s] ... ok
2018-01-30 21:32:42,299 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_negative [0.022531s] ... ok
2018-01-30 21:32:42,299 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_zero [0.020419s] ... ok
2018-01-30 21:32:42,299 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_without_passing_size [0.064082s] ... ok
2018-01-30 21:32:42,300 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_invalid_volume_id [0.058388s] ... ok
2018-01-30 21:32:42,300 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_volume_without_passing_volume_id [0.014657s] ... ok
2018-01-30 21:32:42,300 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id [0.068137s] ... ok
2018-01-30 21:32:42,300 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id [0.015791s] ... ok
2018-01-30 21:32:42,300 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_invalid_status [0.085340s] ... ok
2018-01-30 21:32:42,300 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_nonexistent_name [0.081053s] ... ok
2018-01-30 21:32:42,300 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_invalid_status [0.065370s] ... ok
2018-01-30 21:32:42,300 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_nonexistent_name [0.064205s] ... ok
2018-01-30 21:32:42,300 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_reserve_volume_with_negative_volume_status [0.328218s] ... ok
2018-01-30 21:32:42,300 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_reserve_volume_with_nonexistent_volume_id [0.058862s] ... ok
2018-01-30 21:32:42,300 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_unreserve_volume_with_nonexistent_volume_id [0.063946s] ... ok
2018-01-30 21:32:42,301 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_empty_volume_id [0.014593s] ... ok
2018-01-30 21:32:42,301 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_invalid_volume_id [0.063042s] ... ok
2018-01-30 21:32:42,301 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_nonexistent_volume_id [0.057996s] ... ok
2018-01-30 21:32:42,301 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_delete_nonexistent_volume_id [0.063191s] ... ok
2018-01-30 21:32:42,301 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_get_nonexistent_volume_id [0.079987s] ... ok
2018-01-30 21:32:42,301 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_snapshot_create_get_list_update_delete [4.037243s] ... ok
2018-01-30 21:32:42,301 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_volume_from_snapshot [5.801947s] ... ok
2018-01-30 21:32:42,301 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_details_with_params [0.136468s] ... ok
2018-01-30 21:32:42,301 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_with_params [0.109164s] ... ok
2018-01-30 21:32:42,301 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_with_nonexistent_volume_id [0.649750s] ... ok
2018-01-30 21:32:42,301 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_without_passing_volume_id [0.056906s] ... ok
2018-01-30 21:32:42,312 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - Ran: 203 tests in 2053.0000 sec.
2018-01-30 21:32:42,320 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - - Passed: 197
2018-01-30 21:32:42,328 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - - Skipped: 0
2018-01-30 21:32:42,335 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - - Failed: 6
2018-01-30 21:32:42,341 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - Testcase refstack_defcore success_rate is 97.0443349754%
2018-01-30 21:32:49,674 - functest.energy.energy - DEBUG - Stopping recording
2018-01-30 21:32:50,391 - functest.core.testcase - ERROR - Please set env var: 'TEST_DB_URL'
2018-01-30 21:32:50,393 - functest.ci.run_tests - INFO - Test result:

+--------------------------+------------------+------------------+----------------+
|        TEST CASE         |     PROJECT      |     DURATION     |     RESULT     |
+--------------------------+------------------+------------------+----------------+
|     refstack_defcore     |     functest     |      35:07       |      FAIL      |
+--------------------------+------------------+------------------+----------------+

2018-01-30 21:32:50,397 - functest.ci.run_tests - ERROR - The test case 'refstack_defcore' failed.
2018-01-30 21:32:50,398 - functest.ci.run_tests - INFO - Running test case 'odl'...
2018-01-30 21:33:11,087 - functest.core.robotframework - INFO - 
==============================================================================
Basic & Neutron                                                               
==============================================================================
Basic & Neutron.Basic                                                         
==============================================================================
Basic & Neutron.Basic.Restconf Modules :: Test suite to verify Restconf is OK.
==============================================================================
Get Controller Modules :: Get the restconf modules, check 200 stat... | PASS |
------------------------------------------------------------------------------
Basic & Neutron.Basic.Restconf Modules :: Test suite to verify Res... | PASS |
1 critical test, 1 passed, 0 failed
1 test total, 1 passed, 0 failed
==============================================================================
Basic & Neutron.Basic                                                 | PASS |
1 critical test, 1 passed, 0 failed
1 test total, 1 passed, 0 failed
==============================================================================
Basic & Neutron.Neutron :: Test suite for Neutron Plugin                      
==============================================================================
Basic & Neutron.Neutron.Reachability                                          
==============================================================================
Get the complete list of networks :: Get the complete list of netw... | PASS |
------------------------------------------------------------------------------
Get the complete list of subnets :: Get the complete list of subnets  | PASS |
------------------------------------------------------------------------------
Get the complete list of ports :: Get the complete list of ports      | PASS |
------------------------------------------------------------------------------
Basic & Neutron.Neutron.Reachability                                  | PASS |
3 critical tests, 3 passed, 0 failed
3 tests total, 3 passed, 0 failed
==============================================================================
Basic & Neutron.Neutron.Networks :: Checking Network created in OpenStack a...
==============================================================================
Check OpenStack Networks :: Checking OpenStack Neutron for known n... | PASS |
------------------------------------------------------------------------------
Check OpenDaylight Networks :: Checking OpenDaylight Neutron API f... | PASS |
------------------------------------------------------------------------------
Create Network :: Create new network in OpenStack                     | PASS |
------------------------------------------------------------------------------
Check Network :: Check network created in OpenDaylight                | PASS |
------------------------------------------------------------------------------
Basic & Neutron.Neutron.Networks :: Checking Network created in Op... | PASS |
4 critical tests, 4 passed, 0 failed
4 tests total, 4 passed, 0 failed
==============================================================================
Basic & Neutron.Neutron.Subnets :: Checking Subnets created in OpenStack ar...
==============================================================================
Check OpenStack Subnets :: Checking OpenStack Neutron for known su... | PASS |
------------------------------------------------------------------------------
Check OpenDaylight subnets :: Checking OpenDaylight Neutron API fo... | PASS |
------------------------------------------------------------------------------
Create New subnet :: Create new subnet in OpenStack                   | PASS |
------------------------------------------------------------------------------
Check New subnet :: Check new subnet created in OpenDaylight          | PASS |
------------------------------------------------------------------------------
Basic & Neutron.Neutron.Subnets :: Checking Subnets created in Ope... | PASS |
4 critical tests, 4 passed, 0 failed
4 tests total, 4 passed, 0 failed
==============================================================================
Basic & Neutron.Neutron.Ports :: Checking Port created in OpenStack are pus...
==============================================================================
Check OpenStack ports :: Checking OpenStack Neutron for known ports   | PASS |
------------------------------------------------------------------------------
Check OpenDaylight ports :: Checking OpenDaylight Neutron API for ... | PASS |
------------------------------------------------------------------------------
Create New Port :: Create new port in OpenStack                       | PASS |
------------------------------------------------------------------------------
Check New Port :: Check new port created in OpenDaylight              | PASS |
------------------------------------------------------------------------------
Basic & Neutron.Neutron.Ports :: Checking Port created in OpenStac... | PASS |
4 critical tests, 4 passed, 0 failed
4 tests total, 4 passed, 0 failed
==============================================================================
Basic & Neutron.Neutron.Delete Ports :: Checking Port deleted in OpenStack ...
==============================================================================
Delete New Port :: Delete previously created port in OpenStack        | PASS |
------------------------------------------------------------------------------
Check Port Deleted :: Check port deleted in OpenDaylight              | PASS |
------------------------------------------------------------------------------
Basic & Neutron.Neutron.Delete Ports :: Checking Port deleted in O... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Basic & Neutron.Neutron.Delete Subnets :: Checking Subnets deleted in OpenS...
==============================================================================
Delete New subnet :: Delete previously created subnet in OpenStack    | PASS |
------------------------------------------------------------------------------
Check New subnet deleted :: Check subnet deleted in OpenDaylight      | PASS |
------------------------------------------------------------------------------
Basic & Neutron.Neutron.Delete Subnets :: Checking Subnets deleted... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Basic & Neutron.Neutron.Delete Networks :: Checking Network deleted in Open...
==============================================================================
Delete Network :: Delete network in OpenStack                         | PASS |
------------------------------------------------------------------------------
Check Network deleted :: Check network deleted in OpenDaylight        | PASS |
------------------------------------------------------------------------------
Basic & Neutron.Neutron.Delete Networks :: Checking Network delete... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Basic & Neutron.Neutron :: Test suite for Neutron Plugin              | PASS |
21 critical tests, 21 passed, 0 failed
21 tests total, 21 passed, 0 failed
==============================================================================
Basic & Neutron                                                       | PASS |
22 critical tests, 22 passed, 0 failed
22 tests total, 22 passed, 0 failed
==============================================================================
Output:  /home/opnfv/functest/results/odl/output.xml

2018-01-30 21:33:11,088 - functest.core.robotframework - INFO - Results were successfully generated
2018-01-30 21:33:11,116 - functest.core.robotframework - INFO - Results were successfully parsed
2018-01-30 21:33:11,116 - functest.core.testcase - ERROR - Please set env var: 'TEST_DB_URL'
2018-01-30 21:33:11,116 - functest.ci.run_tests - INFO - Test result:

+-------------------+------------------+------------------+----------------+
|     TEST CASE     |     PROJECT      |     DURATION     |     RESULT     |
+-------------------+------------------+------------------+----------------+
|        odl        |     functest     |      00:20       |      PASS      |
+-------------------+------------------+------------------+----------------+

2018-01-30 21:33:11,119 - functest.ci.run_tests - INFO - Running test case 'snaps_smoke'...
2018-01-30 21:33:12,003 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None'
2018-01-30 22:34:40,638 - functest.core.testcase - ERROR - Please set env var: 'TEST_DB_URL'
2018-01-30 22:34:40,639 - functest.ci.run_tests - INFO - Test result:

+---------------------+------------------+------------------+----------------+
|      TEST CASE      |     PROJECT      |     DURATION     |     RESULT     |
+---------------------+------------------+------------------+----------------+
|     snaps_smoke     |     functest     |      61:29       |      FAIL      |
+---------------------+------------------+------------------+----------------+

2018-01-30 22:34:40,643 - functest.ci.run_tests - ERROR - The test case 'snaps_smoke' failed.
2018-01-30 22:34:40,643 - functest.ci.run_tests - INFO - Deployment description:

+-------------------------+-----------------------------------------------------------+
|         ENV VAR         |                           VALUE                           |
+-------------------------+-----------------------------------------------------------+
|      INSTALLER_TYPE     |                           daisy                           |
|     DEPLOY_SCENARIO     |                    os-odl-nofeature-ha                    |
|        BUILD_TAG        |     jenkins-functest-daisy-baremetal-daily-master-279     |
|         CI_LOOP         |                           daily                           |
+-------------------------+-----------------------------------------------------------+

2018-01-30 22:34:40,646 - functest.ci.run_tests - INFO - FUNCTEST REPORT:

+------------------------------+------------------+---------------+------------------+----------------+
|          TEST CASE           |     PROJECT      |      TIER     |     DURATION     |     RESULT     |
+------------------------------+------------------+---------------+------------------+----------------+
|          vping_ssh           |     functest     |     smoke     |      00:49       |      PASS      |
|        vping_userdata        |     functest     |     smoke     |      00:37       |      PASS      |
|     tempest_smoke_serial     |     functest     |     smoke     |      18:54       |      FAIL      |
|         rally_sanity         |     functest     |     smoke     |      25:38       |      PASS      |
|       refstack_defcore       |     functest     |     smoke     |      35:07       |      FAIL      |
|             odl              |     functest     |     smoke     |      00:20       |      PASS      |
|         snaps_smoke          |     functest     |     smoke     |      61:29       |      FAIL      |
|         odl_netvirt          |     functest     |     smoke     |      00:00       |      SKIP      |
+------------------------------+------------------+---------------+------------------+----------------+

2018-01-30 22:34:40,652 - functest.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR
2018-01-30 22:35:31,158 - functest.ci.run_tests - DEBUG - Sourcing the OpenStack RC file...
2018-01-30 22:35:31,158 - functest.ci.run_tests - DEBUG - Test args: all
2018-01-30 22:35:31,159 - functest.ci.run_tests - INFO - TESTS TO BE EXECUTED:

+---------------+---------------+-----------------+---------------------+-------------------+
|     TIERS     |     ORDER     |     CI LOOP     |     DESCRIPTION     |     TESTCASES     |
+---------------+---------------+-----------------+---------------------+-------------------+
+---------------+---------------+-----------------+---------------------+-------------------+

2018-01-30 22:35:31,160 - functest.ci.run_tests - INFO - Deployment description:

+-------------------------+-----------------------------------------------------------+
|         ENV VAR         |                           VALUE                           |
+-------------------------+-----------------------------------------------------------+
|      INSTALLER_TYPE     |                           daisy                           |
|     DEPLOY_SCENARIO     |                    os-odl-nofeature-ha                    |
|        BUILD_TAG        |     jenkins-functest-daisy-baremetal-daily-master-279     |
|         CI_LOOP         |                           daily                           |
+-------------------------+-----------------------------------------------------------+

2018-01-30 22:35:31,161 - functest.ci.run_tests - INFO - FUNCTEST REPORT:

+-----------------------------+------------------------+------------------+------------------+----------------+
|          TEST CASE          |        PROJECT         |       TIER       |     DURATION     |     RESULT     |
+-----------------------------+------------------------+------------------+------------------+----------------+
|     doctor-notification     |         doctor         |     features     |      00:00       |      SKIP      |
|            bgpvpn           |         sdnvpn         |     features     |      00:00       |      SKIP      |
|       functest-odl-sfc      |          sfc           |     features     |      00:00       |      SKIP      |
|      barometercollectd      |       barometer        |     features     |      00:00       |      SKIP      |
|             fds             |     fastdatastacks     |     features     |      00:00       |      SKIP      |
+-----------------------------+------------------------+------------------+------------------+----------------+

2018-01-30 22:35:31,164 - functest.ci.run_tests - INFO - Execution exit value: Result.EX_OK
2018-01-30 22:36:07,656 - functest.ci.run_tests - DEBUG - Sourcing the OpenStack RC file...
2018-01-30 22:36:07,657 - functest.ci.run_tests - DEBUG - Test args: all
2018-01-30 22:36:07,657 - functest.ci.run_tests - INFO - TESTS TO BE EXECUTED:

+---------------+---------------+-----------------+---------------------+-------------------+
|     TIERS     |     ORDER     |     CI LOOP     |     DESCRIPTION     |     TESTCASES     |
+---------------+---------------+-----------------+---------------------+-------------------+
+---------------+---------------+-----------------+---------------------+-------------------+

2018-01-30 22:36:07,658 - functest.ci.run_tests - INFO - Deployment description:

+-------------------------+-----------------------------------------------------------+
|         ENV VAR         |                           VALUE                           |
+-------------------------+-----------------------------------------------------------+
|      INSTALLER_TYPE     |                           daisy                           |
|     DEPLOY_SCENARIO     |                    os-odl-nofeature-ha                    |
|        BUILD_TAG        |     jenkins-functest-daisy-baremetal-daily-master-279     |
|         CI_LOOP         |                           daily                           |
+-------------------------+-----------------------------------------------------------+

2018-01-30 22:36:07,659 - functest.ci.run_tests - INFO - FUNCTEST REPORT:

+---------------------------------+-------------------+--------------+------------------+----------------+
|            TEST CASE            |      PROJECT      |     TIER     |     DURATION     |     RESULT     |
+---------------------------------+-------------------+--------------+------------------+----------------+
|           cloudify_ims          |      functest     |     vnf      |      00:00       |      SKIP      |
|           vyos_vrouter          |      functest     |     vnf      |      00:00       |      SKIP      |
|        orchestra_openims        |     orchestra     |     vnf      |      00:00       |      SKIP      |
|     orchestra_clearwaterims     |     orchestra     |     vnf      |      00:00       |      SKIP      |
|             juju_epc            |      functest     |     vnf      |      00:00       |      SKIP      |
+---------------------------------+-------------------+--------------+------------------+----------------+

2018-01-30 22:36:07,662 - functest.ci.run_tests - INFO - Execution exit value: Result.EX_OK
2018-01-30 22:36:16,703 - functest.ci.run_tests - DEBUG - Sourcing the OpenStack RC file...
2018-01-30 22:36:16,704 - functest.ci.run_tests - DEBUG - Test args: all
2018-01-30 22:36:16,705 - functest.ci.run_tests - INFO - TESTS TO BE EXECUTED:

+------------------+---------------+--------------------------+-------------------------------------------+-----------------------+
|      TIERS       |     ORDER     |         CI LOOP          |                DESCRIPTION                |       TESTCASES       |
+------------------+---------------+--------------------------+-------------------------------------------+-----------------------+
|     features     |       2       |     (daily)|(weekly)     |     Test suites from feature projects     |     parser-basics     |
|                  |               |                          |           integrated in functest          |                       |
+------------------+---------------+--------------------------+-------------------------------------------+-----------------------+

2018-01-30 22:36:16,707 - functest.ci.run_tests - INFO - Running tier 'features'
2018-01-30 22:36:16,707 - functest.ci.run_tests - INFO - Running test case 'parser-basics'...
2018-01-30 22:37:33,423 - functest.core.feature - ERROR - Execute command: /src/nfv-parser/tests/functest_run.sh failed
2018-01-30 22:37:33,424 - functest.core.feature - INFO - Test result is stored in '/home/opnfv/functest/results/parser-basics.log'
2018-01-30 22:37:33,425 - functest.core.testcase - ERROR - Please set env var: 'TEST_DB_URL'
2018-01-30 22:37:33,425 - functest.ci.run_tests - INFO - Test result:

+-----------------------+-----------------+------------------+----------------+
|       TEST CASE       |     PROJECT     |     DURATION     |     RESULT     |
+-----------------------+-----------------+------------------+----------------+
|     parser-basics     |      parser     |      01:17       |      FAIL      |
+-----------------------+-----------------+------------------+----------------+

2018-01-30 22:37:33,429 - functest.ci.run_tests - ERROR - The test case 'parser-basics' failed.
2018-01-30 22:37:33,429 - functest.ci.run_tests - INFO - Deployment description:

+-------------------------+-----------------------------------------------------------+
|         ENV VAR         |                           VALUE                           |
+-------------------------+-----------------------------------------------------------+
|      INSTALLER_TYPE     |                           daisy                           |
|     DEPLOY_SCENARIO     |                    os-odl-nofeature-ha                    |
|        BUILD_TAG        |     jenkins-functest-daisy-baremetal-daily-master-279     |
|         CI_LOOP         |                           daily                           |
+-------------------------+-----------------------------------------------------------+

2018-01-30 22:37:33,431 - functest.ci.run_tests - INFO - FUNCTEST REPORT:

+-----------------------+-----------------+------------------+------------------+----------------+
|       TEST CASE       |     PROJECT     |       TIER       |     DURATION     |     RESULT     |
+-----------------------+-----------------+------------------+------------------+----------------+
|     parser-basics     |      parser     |     features     |      01:17       |      FAIL      |
+-----------------------+-----------------+------------------+------------------+----------------+

2018-01-30 22:37:33,433 - functest.ci.run_tests - INFO - Execution exit value: Result.EX_OK