2020-07-08 09:19:34,275 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | k8-nosdn-nofeature-noha | | INSTALLER_TYPE | unknown | | BUILD_TAG | 2TQPVA3SREEI | | NODE_NAME | lf-virtual1-4 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/functest-kubernetes/2TQPVA3SREEI/functest-kubernetes-opnfv-functest-kubernetes-cnf-kali-k8s_vims-run-79 | | HTTP_DST_URL | http://artifacts.opnfv.org/functest-kubernetes/2TQPVA3SREEI/functest-kubernetes-opnfv-functest-kubernetes-cnf-kali-k8s_vims-run-79 | +-------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+ 2020-07-08 09:19:34,280 - xtesting.ci.run_tests - DEBUG - No env file /var/lib/xtesting/conf/env_file found 2020-07-08 09:19:34,280 - xtesting.ci.run_tests - DEBUG - Test args: k8s_vims 2020-07-08 09:19:34,284 - xtesting.ci.run_tests - INFO - Loading test case 'k8s_vims'... 2020-07-08 09:19:34,578 - xtesting.ci.run_tests - INFO - Running test case 'k8s_vims'... 2020-07-08 09:19:34,600 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_config_map: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': [{'api_version': 'v1', 'fields': None, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal())}], 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1118914', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'f8423acd-ba66-4dca-95d4-d5beccf54ac2'}} 2020-07-08 09:19:34,639 - functest_kubernetes.ims.ims - INFO - Deployment astaire created 2020-07-08 09:19:34,639 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': [{'api_version': 'v1', 'fields': None, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal())}], 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1118914', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'f8423acd-ba66-4dca-95d4-d5beccf54ac2'}} 2020-07-08 09:19:34,742 - functest_kubernetes.ims.ims - INFO - Deployment bono created 2020-07-08 09:19:34,742 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': [{'api_version': 'v1', 'fields': None, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal())}], 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1118914', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'f8423acd-ba66-4dca-95d4-d5beccf54ac2'}} 2020-07-08 09:19:34,816 - functest_kubernetes.ims.ims - INFO - Deployment cassandra created 2020-07-08 09:19:34,816 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': [{'api_version': 'v1', 'fields': None, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal())}], 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1118914', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'f8423acd-ba66-4dca-95d4-d5beccf54ac2'}} 2020-07-08 09:19:34,869 - functest_kubernetes.ims.ims - INFO - Deployment chronos created 2020-07-08 09:19:34,869 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': [{'api_version': 'v1', 'fields': None, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal())}], 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1118914', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'f8423acd-ba66-4dca-95d4-d5beccf54ac2'}} 2020-07-08 09:19:34,924 - functest_kubernetes.ims.ims - INFO - Deployment ellis created 2020-07-08 09:19:34,924 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': [{'api_version': 'v1', 'fields': None, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal())}], 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1118914', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'f8423acd-ba66-4dca-95d4-d5beccf54ac2'}} 2020-07-08 09:19:35,026 - functest_kubernetes.ims.ims - INFO - Deployment etcd created 2020-07-08 09:19:35,026 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': [{'api_version': 'v1', 'fields': None, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal())}], 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1118914', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'f8423acd-ba66-4dca-95d4-d5beccf54ac2'}} 2020-07-08 09:19:35,074 - functest_kubernetes.ims.ims - INFO - Deployment homer created 2020-07-08 09:19:35,074 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': [{'api_version': 'v1', 'fields': None, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal())}], 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1118914', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'f8423acd-ba66-4dca-95d4-d5beccf54ac2'}} 2020-07-08 09:19:35,167 - functest_kubernetes.ims.ims - INFO - Deployment homestead created 2020-07-08 09:19:35,167 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': [{'api_version': 'v1', 'fields': None, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal())}], 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1118914', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'f8423acd-ba66-4dca-95d4-d5beccf54ac2'}} 2020-07-08 09:19:35,230 - functest_kubernetes.ims.ims - INFO - Deployment homestead-prov created 2020-07-08 09:19:35,231 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': [{'api_version': 'v1', 'fields': None, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal())}], 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1118914', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'f8423acd-ba66-4dca-95d4-d5beccf54ac2'}} 2020-07-08 09:19:35,321 - functest_kubernetes.ims.ims - INFO - Deployment ralf created 2020-07-08 09:19:35,321 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': [{'api_version': 'v1', 'fields': None, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal())}], 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1118914', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'f8423acd-ba66-4dca-95d4-d5beccf54ac2'}} 2020-07-08 09:19:35,370 - functest_kubernetes.ims.ims - INFO - Deployment sprout created 2020-07-08 09:19:35,370 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': [{'api_version': 'v1', 'fields': None, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal())}], 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1118914', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'f8423acd-ba66-4dca-95d4-d5beccf54ac2'}} 2020-07-08 09:19:35,488 - functest_kubernetes.ims.ims - INFO - Service astaire created 2020-07-08 09:19:35,489 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': [{'api_version': 'v1', 'fields': None, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal())}], 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1118914', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'f8423acd-ba66-4dca-95d4-d5beccf54ac2'}} 2020-07-08 09:19:35,506 - functest_kubernetes.ims.ims - INFO - Service bono created 2020-07-08 09:19:35,506 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': [{'api_version': 'v1', 'fields': None, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal())}], 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1118914', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'f8423acd-ba66-4dca-95d4-d5beccf54ac2'}} 2020-07-08 09:19:35,542 - functest_kubernetes.ims.ims - INFO - Service cassandra created 2020-07-08 09:19:35,542 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': [{'api_version': 'v1', 'fields': None, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal())}], 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1118914', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'f8423acd-ba66-4dca-95d4-d5beccf54ac2'}} 2020-07-08 09:19:35,622 - functest_kubernetes.ims.ims - INFO - Service chronos created 2020-07-08 09:19:35,622 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': [{'api_version': 'v1', 'fields': None, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal())}], 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1118914', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'f8423acd-ba66-4dca-95d4-d5beccf54ac2'}} 2020-07-08 09:19:35,641 - functest_kubernetes.ims.ims - INFO - Service ellis created 2020-07-08 09:19:35,652 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': [{'api_version': 'v1', 'fields': None, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal())}], 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1118914', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'f8423acd-ba66-4dca-95d4-d5beccf54ac2'}} 2020-07-08 09:19:35,700 - functest_kubernetes.ims.ims - INFO - Service etcd created 2020-07-08 09:19:35,700 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': [{'api_version': 'v1', 'fields': None, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal())}], 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1118914', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'f8423acd-ba66-4dca-95d4-d5beccf54ac2'}} 2020-07-08 09:19:35,759 - functest_kubernetes.ims.ims - INFO - Service homer created 2020-07-08 09:19:35,759 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': [{'api_version': 'v1', 'fields': None, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal())}], 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1118914', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'f8423acd-ba66-4dca-95d4-d5beccf54ac2'}} 2020-07-08 09:19:35,802 - functest_kubernetes.ims.ims - INFO - Service homestead created 2020-07-08 09:19:35,802 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': [{'api_version': 'v1', 'fields': None, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal())}], 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1118914', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'f8423acd-ba66-4dca-95d4-d5beccf54ac2'}} 2020-07-08 09:19:35,843 - functest_kubernetes.ims.ims - INFO - Service homestead-prov created 2020-07-08 09:19:35,843 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': [{'api_version': 'v1', 'fields': None, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal())}], 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1118914', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'f8423acd-ba66-4dca-95d4-d5beccf54ac2'}} 2020-07-08 09:19:35,902 - functest_kubernetes.ims.ims - INFO - Service ralf created 2020-07-08 09:19:35,902 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': [{'api_version': 'v1', 'fields': None, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal())}], 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1118914', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'f8423acd-ba66-4dca-95d4-d5beccf54ac2'}} 2020-07-08 09:19:35,938 - functest_kubernetes.ims.ims - INFO - Service sprout created 2020-07-08 09:19:35,938 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': [{'api_version': 'v1', 'fields': None, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal())}], 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1118914', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'f8423acd-ba66-4dca-95d4-d5beccf54ac2'}} 2020-07-08 09:19:35,944 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'ellis', 'namespace': 'default', 'owner_references': None, 'resource_version': '1119046', 'self_link': '/apis/apps/v1/namespaces/default/deployments/ellis', 'uid': 'cab81990-1908-4a3b-9c66-11e61e015dd1'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'ellis'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'ellis'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-ellis:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 80}, 'timeout_seconds': 1}, 'name': 'ellis', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 80, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 80}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'preemption_policy': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'message': 'ReplicaSet "ellis-64f544db5b" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'ellis', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/ellis', 'uid': 'cab81990-1908-4a3b-9c66-11e61e015dd1', 'resourceVersion': '1119046', 'generation': 1, 'creationTimestamp': '2020-07-08T09:19:34Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'ellis'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'ellis'}}, 'spec': {'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'ellis', 'image': 'ollivier/clearwater-ellis:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 80, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'tcpSocket': {'port': 80}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 80}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-08T09:19:35Z', 'lastTransitionTime': '2020-07-08T09:19:35Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:19:35Z', 'lastTransitionTime': '2020-07-08T09:19:34Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "ellis-64f544db5b" is progressing.'}]}}} 2020-07-08 09:19:35,963 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'etcd', 'namespace': 'default', 'owner_references': None, 'resource_version': '1119021', 'self_link': '/apis/apps/v1/namespaces/default/deployments/etcd', 'uid': '853d1398-c468-48d4-a0f6-47592d5d9b24'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'instance-type': 'etcd-pod'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'instance-type': 'etcd-pod'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': ['--name', '$(MY_POD_NAME)', '--advertise-client-urls', 'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', '--listen-client-urls', 'http://0.0.0.0:2379,http://0.0.0.0:4001', '--initial-advertise-peer-urls', 'http://$(MY_POD_IP):2380', '--listen-peer-urls', 'http://0.0.0.0:2380', '--initial-cluster', '$(MY_POD_NAME)=http://$(MY_POD_IP):2380', '--initial-cluster-state', 'new'], 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}, {'name': 'MY_POD_NAME', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'metadata.name'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': None, 'image': 'quay.io/coreos/etcd:v2.2.5', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 300, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 4001}, 'timeout_seconds': 1}, 'name': 'etcd', 'ports': [{'container_port': 2379, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 2380, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 4001, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 4001}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': None, 'node_name': None, 'node_selector': None, 'preemption_policy': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'message': 'ReplicaSet "etcd-596fb59b77" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'etcd', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/etcd', 'uid': '853d1398-c468-48d4-a0f6-47592d5d9b24', 'resourceVersion': '1119021', 'generation': 1, 'creationTimestamp': '2020-07-08T09:19:34Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'instance-type': 'etcd-pod'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'instance-type': 'etcd-pod'}}, 'spec': {'containers': [{'name': 'etcd', 'image': 'quay.io/coreos/etcd:v2.2.5', 'args': ['--name', '$(MY_POD_NAME)', '--advertise-client-urls', 'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', '--listen-client-urls', 'http://0.0.0.0:2379,http://0.0.0.0:4001', '--initial-advertise-peer-urls', 'http://$(MY_POD_IP):2380', '--listen-peer-urls', 'http://0.0.0.0:2380', '--initial-cluster', '$(MY_POD_NAME)=http://$(MY_POD_IP):2380', '--initial-cluster-state', 'new'], 'ports': [{'containerPort': 2379, 'protocol': 'TCP'}, {'containerPort': 2380, 'protocol': 'TCP'}, {'containerPort': 4001, 'protocol': 'TCP'}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}, {'name': 'MY_POD_NAME', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'metadata.name'}}}], 'resources': {}, 'livenessProbe': {'tcpSocket': {'port': 4001}, 'initialDelaySeconds': 300, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 4001}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-08T09:19:35Z', 'lastTransitionTime': '2020-07-08T09:19:35Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:19:35Z', 'lastTransitionTime': '2020-07-08T09:19:35Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "etcd-596fb59b77" is progressing.'}]}}} 2020-07-08 09:19:35,990 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homer', 'namespace': 'default', 'owner_references': None, 'resource_version': '1119039', 'self_link': '/apis/apps/v1/namespaces/default/deployments/homer', 'uid': '12b09fa3-f659-4785-92cf-bd776560faf9'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'homer'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'homer'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homer:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'name': 'homer', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'sprout; do ' 'echo waiting ' 'for sprout ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'preemption_policy': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'message': 'Created new replica set ' '"homer-85c5d4d87d"', 'reason': 'NewReplicaSetCreated', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': None, 'unavailable_replicas': 1, 'updated_replicas': None}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homer', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/homer', 'uid': '12b09fa3-f659-4785-92cf-bd776560faf9', 'resourceVersion': '1119039', 'generation': 1, 'creationTimestamp': '2020-07-08T09:19:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homer'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homer'}}, 'spec': {'initContainers': [{'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homer', 'image': 'ollivier/clearwater-homer:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'tcpSocket': {'port': 7888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 7888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:19:35Z', 'lastTransitionTime': '2020-07-08T09:19:35Z', 'reason': 'NewReplicaSetCreated', 'message': 'Created new replica set "homer-85c5d4d87d"'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-08T09:19:35Z', 'lastTransitionTime': '2020-07-08T09:19:35Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-08 09:19:36,028 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'bono', 'namespace': 'default', 'owner_references': None, 'resource_version': '1118949', 'self_link': '/apis/apps/v1/namespaces/default/deployments/bono', 'uid': 'a751ae0c-4e93-45a3-8f61-e936eeed743d'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'bono'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'bono', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-bono:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 ' '5060 ' '5062']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'bono', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 3478, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5060, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5062, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5060, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'UDP'}, {'container_port': 5062, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'UDP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 ' '5060 ' '5062']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/bono', 'mount_propagation': None, 'name': 'bonologs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/bono/bono_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/bono', 'mount_propagation': None, 'name': 'bonologs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'sprout; do ' 'echo waiting ' 'for sprout ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'preemption_policy': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'bonologs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'message': 'ReplicaSet "bono-69fbbd8646" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'bono', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/bono', 'uid': 'a751ae0c-4e93-45a3-8f61-e936eeed743d', 'resourceVersion': '1118949', 'generation': 1, 'creationTimestamp': '2020-07-08T09:19:34Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'bono'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'bono', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'bonologs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'bono', 'image': 'ollivier/clearwater-bono:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 3478, 'protocol': 'TCP'}, {'containerPort': 5060, 'protocol': 'TCP'}, {'containerPort': 5062, 'protocol': 'TCP'}, {'containerPort': 5060, 'protocol': 'UDP'}, {'containerPort': 5062, 'protocol': 'UDP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'bonologs', 'mountPath': '/var/log/bono'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 5062']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 5062']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/bono/bono_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'bonologs', 'mountPath': '/var/log/bono'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-08T09:19:34Z', 'lastTransitionTime': '2020-07-08T09:19:34Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:19:34Z', 'lastTransitionTime': '2020-07-08T09:19:34Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "bono-69fbbd8646" is progressing.'}]}}} 2020-07-08 09:19:36,052 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'ralf', 'namespace': 'default', 'owner_references': None, 'resource_version': '1119053', 'self_link': '/apis/apps/v1/namespaces/default/deployments/ralf', 'uid': '46af59da-36f6-459d-bbfa-eb62d2690b5d'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'ralf'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'ralf', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-ralf:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'name': 'ralf', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 10888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'sprout; do ' 'echo waiting ' 'for sprout ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'preemption_policy': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'ralflogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'message': 'Created new replica set ' '"ralf-5d845cff75"', 'reason': 'NewReplicaSetCreated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': None, 'ready_replicas': None, 'replicas': None, 'unavailable_replicas': None, 'updated_replicas': None}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'ralf', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/ralf', 'uid': '46af59da-36f6-459d-bbfa-eb62d2690b5d', 'resourceVersion': '1119053', 'generation': 1, 'creationTimestamp': '2020-07-08T09:19:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'ralf'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'ralf', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'ralflogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'ralf', 'image': 'ollivier/clearwater-ralf:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 10888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}], 'livenessProbe': {'tcpSocket': {'port': 10888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 10888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:19:35Z', 'lastTransitionTime': '2020-07-08T09:19:35Z', 'reason': 'NewReplicaSetCreated', 'message': 'Created new replica set "ralf-5d845cff75"'}]}}} 2020-07-08 09:19:36,092 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'sprout', 'namespace': 'default', 'owner_references': None, 'resource_version': '1119016', 'self_link': '/apis/apps/v1/namespaces/default/deployments/sprout', 'uid': '8b2db2f4-6475-4bd9-9f22-9afbc5239ee6'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'sprout'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'sprout', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-sprout:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 3, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'sprout', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'preemption_policy': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'sproutlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': None, 'observed_generation': None, 'ready_replicas': None, 'replicas': None, 'unavailable_replicas': None, 'updated_replicas': None}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'sprout', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/sprout', 'uid': '8b2db2f4-6475-4bd9-9f22-9afbc5239ee6', 'resourceVersion': '1119016', 'generation': 1, 'creationTimestamp': '2020-07-08T09:19:35Z'}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'sprout'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'sprout', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'sproutlogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'sprout', 'image': 'ollivier/clearwater-sprout:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 3, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {}}} 2020-07-08 09:19:36,118 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'astaire', 'namespace': 'default', 'owner_references': None, 'resource_version': '1118945', 'self_link': '/apis/apps/v1/namespaces/default/deployments/astaire', 'uid': '68995dc6-e4d2-45b2-877e-2da5b83dc39a'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'astaire'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'astaire'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-astaire:latest', 'image_pull_policy': 'Always', 'lifecycle': {'post_start': None, 'pre_stop': {'_exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}, 'http_get': None, 'tcp_socket': None}}, 'liveness_probe': {'_exec': None, 'failure_threshold': 9, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 11311}, 'timeout_seconds': 1}, 'name': 'astaire', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 11211, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 11311, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 11311}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/astaire', 'mount_propagation': None, 'name': 'astairelogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/astaire/astaire_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/astaire', 'mount_propagation': None, 'name': 'astairelogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'preemption_policy': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 120, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'astairelogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'message': 'ReplicaSet "astaire-7666ff5885" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'astaire', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/astaire', 'uid': '68995dc6-e4d2-45b2-877e-2da5b83dc39a', 'resourceVersion': '1118945', 'generation': 1, 'creationTimestamp': '2020-07-08T09:19:34Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'astaire'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'astaire'}}, 'spec': {'volumes': [{'name': 'astairelogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'astaire', 'image': 'ollivier/clearwater-astaire:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 11211, 'protocol': 'TCP'}, {'containerPort': 11311, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'astairelogs', 'mountPath': '/var/log/astaire'}], 'livenessProbe': {'tcpSocket': {'port': 11311}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 9}, 'readinessProbe': {'tcpSocket': {'port': 11311}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'lifecycle': {'preStop': {'exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}}}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/astaire/astaire_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'astairelogs', 'mountPath': '/var/log/astaire'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 120, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-08T09:19:34Z', 'lastTransitionTime': '2020-07-08T09:19:34Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:19:34Z', 'lastTransitionTime': '2020-07-08T09:19:34Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "astaire-7666ff5885" is progressing.'}]}}} 2020-07-08 09:19:36,143 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homestead', 'namespace': 'default', 'owner_references': None, 'resource_version': '1119075', 'self_link': '/apis/apps/v1/namespaces/default/deployments/homestead', 'uid': '2990f5b7-ff0c-493d-81e1-d2b266aa1435'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'homestead'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'homestead', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/homestead', 'mount_propagation': None, 'name': 'homesteadlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/homestead/homestead_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/homestead', 'mount_propagation': None, 'name': 'homesteadlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'sprout; do ' 'echo waiting ' 'for sprout ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'preemption_policy': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'homesteadlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'message': 'Created new replica set ' '"homestead-fc79cc977"', 'reason': 'NewReplicaSetCreated', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': None, 'unavailable_replicas': 1, 'updated_replicas': None}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homestead', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/homestead', 'uid': '2990f5b7-ff0c-493d-81e1-d2b266aa1435', 'resourceVersion': '1119075', 'generation': 1, 'creationTimestamp': '2020-07-08T09:19:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homestead'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homestead', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'homesteadlogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead', 'image': 'ollivier/clearwater-homestead:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'homesteadlogs', 'mountPath': '/var/log/homestead'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/homestead/homestead_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'homesteadlogs', 'mountPath': '/var/log/homestead'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:19:35Z', 'lastTransitionTime': '2020-07-08T09:19:35Z', 'reason': 'NewReplicaSetCreated', 'message': 'Created new replica set "homestead-fc79cc977"'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-08T09:19:35Z', 'lastTransitionTime': '2020-07-08T09:19:35Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-08 09:19:36,165 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'cassandra', 'namespace': 'default', 'owner_references': None, 'resource_version': '1118993', 'self_link': '/apis/apps/v1/namespaces/default/deployments/cassandra', 'uid': '8f5f8720-db5f-48bb-8c57-6e903c983396'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'cassandra'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'cassandra'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-cassandra:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 ' '9042 ' '9160']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 600, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'cassandra', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7001, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 9042, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 9160, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 ' '9042 ' '9160']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'etcd; do ' 'echo waiting ' 'for etcd to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-etcd', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'preemption_policy': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'message': 'ReplicaSet "cassandra-7fbf8bb9cf" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'cassandra', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/cassandra', 'uid': '8f5f8720-db5f-48bb-8c57-6e903c983396', 'resourceVersion': '1118993', 'generation': 1, 'creationTimestamp': '2020-07-08T09:19:34Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'cassandra'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'cassandra'}}, 'spec': {'initContainers': [{'name': 'wait-on-etcd', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup etcd; do echo waiting for etcd to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'cassandra', 'image': 'ollivier/clearwater-cassandra:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7001, 'protocol': 'TCP'}, {'containerPort': 9042, 'protocol': 'TCP'}, {'containerPort': 9160, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 9160']}, 'initialDelaySeconds': 600, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 9160']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-08T09:19:35Z', 'lastTransitionTime': '2020-07-08T09:19:35Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:19:35Z', 'lastTransitionTime': '2020-07-08T09:19:34Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "cassandra-7fbf8bb9cf" is progressing.'}]}}} 2020-07-08 09:19:36,183 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'service': 'chronos'}, 'managed_fields': None, 'name': 'chronos', 'namespace': 'default', 'owner_references': None, 'resource_version': '1118992', 'self_link': '/apis/apps/v1/namespaces/default/deployments/chronos', 'uid': '8f3898f8-5e27-429e-adc1-c917f18e0bce'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'chronos'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'chronos'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-chronos:latest', 'image_pull_policy': 'Always', 'lifecycle': {'post_start': None, 'pre_stop': {'_exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}, 'http_get': None, 'tcp_socket': None}}, 'liveness_probe': {'_exec': None, 'failure_threshold': 9, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7253}, 'timeout_seconds': 1}, 'name': 'chronos', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7253, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7253}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/chronos', 'mount_propagation': None, 'name': 'chronoslogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/chronos/chronos_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/chronos', 'mount_propagation': None, 'name': 'chronoslogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'preemption_policy': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 120, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'chronoslogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'message': 'ReplicaSet "chronos-c55b4b9ff" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'chronos', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/chronos', 'uid': '8f3898f8-5e27-429e-adc1-c917f18e0bce', 'resourceVersion': '1118992', 'generation': 1, 'creationTimestamp': '2020-07-08T09:19:34Z', 'labels': {'service': 'chronos'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'chronos'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'chronos'}}, 'spec': {'volumes': [{'name': 'chronoslogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'chronos', 'image': 'ollivier/clearwater-chronos:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7253, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'chronoslogs', 'mountPath': '/var/log/chronos'}], 'livenessProbe': {'tcpSocket': {'port': 7253}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 9}, 'readinessProbe': {'tcpSocket': {'port': 7253}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'lifecycle': {'preStop': {'exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}}}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/chronos/chronos_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'chronoslogs', 'mountPath': '/var/log/chronos'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 120, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-08T09:19:35Z', 'lastTransitionTime': '2020-07-08T09:19:35Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:19:35Z', 'lastTransitionTime': '2020-07-08T09:19:34Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "chronos-c55b4b9ff" is progressing.'}]}}} 2020-07-08 09:19:36,207 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homestead-prov', 'namespace': 'default', 'owner_references': None, 'resource_version': '1119026', 'self_link': '/apis/apps/v1/namespaces/default/deployments/homestead-prov', 'uid': '3724a68c-af0c-49cb-ba4b-4d6458de1e73'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'homestead-prov'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'homestead-prov', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead-prov:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead-prov', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8889, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'homestead; ' 'do echo ' 'waiting for ' 'homestead to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'preemption_policy': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'message': 'Created new replica set ' '"homestead-prov-555fbf67b"', 'reason': 'NewReplicaSetCreated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': None, 'ready_replicas': None, 'replicas': None, 'unavailable_replicas': None, 'updated_replicas': None}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homestead-prov', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/homestead-prov', 'uid': '3724a68c-af0c-49cb-ba4b-4d6458de1e73', 'resourceVersion': '1119026', 'generation': 1, 'creationTimestamp': '2020-07-08T09:19:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homestead-prov'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homestead-prov', 'snmp': 'enabled'}}, 'spec': {'initContainers': [{'name': 'wait-on-homestead', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead-prov', 'image': 'ollivier/clearwater-homestead-prov:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8889, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:19:35Z', 'lastTransitionTime': '2020-07-08T09:19:35Z', 'reason': 'NewReplicaSetCreated', 'message': 'Created new replica set "homestead-prov-555fbf67b"'}]}}} 2020-07-08 09:19:36,223 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homer', 'namespace': 'default', 'owner_references': None, 'resource_version': '1119086', 'self_link': '/apis/apps/v1/namespaces/default/deployments/homer', 'uid': '12b09fa3-f659-4785-92cf-bd776560faf9'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'homer'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'homer'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homer:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'name': 'homer', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'sprout; do ' 'echo waiting ' 'for sprout ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'preemption_policy': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'message': 'ReplicaSet "homer-85c5d4d87d" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homer', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/homer', 'uid': '12b09fa3-f659-4785-92cf-bd776560faf9', 'resourceVersion': '1119086', 'generation': 1, 'creationTimestamp': '2020-07-08T09:19:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homer'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homer'}}, 'spec': {'initContainers': [{'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homer', 'image': 'ollivier/clearwater-homer:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'tcpSocket': {'port': 7888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 7888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-08T09:19:35Z', 'lastTransitionTime': '2020-07-08T09:19:35Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:19:35Z', 'lastTransitionTime': '2020-07-08T09:19:35Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "homer-85c5d4d87d" is progressing.'}]}}} 2020-07-08 09:19:36,238 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'sprout', 'namespace': 'default', 'owner_references': None, 'resource_version': '1119091', 'self_link': '/apis/apps/v1/namespaces/default/deployments/sprout', 'uid': '8b2db2f4-6475-4bd9-9f22-9afbc5239ee6'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'sprout'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'sprout', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-sprout:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 3, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'sprout', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'preemption_policy': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'sproutlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'message': 'Created new replica set ' '"sprout-595c745f77"', 'reason': 'NewReplicaSetCreated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': None, 'ready_replicas': None, 'replicas': None, 'unavailable_replicas': None, 'updated_replicas': None}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'sprout', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/sprout', 'uid': '8b2db2f4-6475-4bd9-9f22-9afbc5239ee6', 'resourceVersion': '1119091', 'generation': 1, 'creationTimestamp': '2020-07-08T09:19:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'sprout'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'sprout', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'sproutlogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'sprout', 'image': 'ollivier/clearwater-sprout:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 3, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:19:35Z', 'lastTransitionTime': '2020-07-08T09:19:35Z', 'reason': 'NewReplicaSetCreated', 'message': 'Created new replica set "sprout-595c745f77"'}]}}} 2020-07-08 09:19:36,259 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homestead-prov', 'namespace': 'default', 'owner_references': None, 'resource_version': '1119094', 'self_link': '/apis/apps/v1/namespaces/default/deployments/homestead-prov', 'uid': '3724a68c-af0c-49cb-ba4b-4d6458de1e73'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'homestead-prov'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'homestead-prov', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead-prov:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead-prov', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8889, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'homestead; ' 'do echo ' 'waiting for ' 'homestead to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'preemption_policy': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'message': 'ReplicaSet "homestead-prov-555fbf67b" ' 'is progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homestead-prov', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/homestead-prov', 'uid': '3724a68c-af0c-49cb-ba4b-4d6458de1e73', 'resourceVersion': '1119094', 'generation': 1, 'creationTimestamp': '2020-07-08T09:19:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homestead-prov'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homestead-prov', 'snmp': 'enabled'}}, 'spec': {'initContainers': [{'name': 'wait-on-homestead', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead-prov', 'image': 'ollivier/clearwater-homestead-prov:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8889, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-08T09:19:35Z', 'lastTransitionTime': '2020-07-08T09:19:35Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:19:35Z', 'lastTransitionTime': '2020-07-08T09:19:35Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "homestead-prov-555fbf67b" is progressing.'}]}}} 2020-07-08 09:19:36,276 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homestead', 'namespace': 'default', 'owner_references': None, 'resource_version': '1119097', 'self_link': '/apis/apps/v1/namespaces/default/deployments/homestead', 'uid': '2990f5b7-ff0c-493d-81e1-d2b266aa1435'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'homestead'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'homestead', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/homestead', 'mount_propagation': None, 'name': 'homesteadlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/homestead/homestead_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/homestead', 'mount_propagation': None, 'name': 'homesteadlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'sprout; do ' 'echo waiting ' 'for sprout ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'preemption_policy': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'homesteadlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'message': 'ReplicaSet "homestead-fc79cc977" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homestead', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/homestead', 'uid': '2990f5b7-ff0c-493d-81e1-d2b266aa1435', 'resourceVersion': '1119097', 'generation': 1, 'creationTimestamp': '2020-07-08T09:19:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homestead'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homestead', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'homesteadlogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead', 'image': 'ollivier/clearwater-homestead:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'homesteadlogs', 'mountPath': '/var/log/homestead'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/homestead/homestead_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'homesteadlogs', 'mountPath': '/var/log/homestead'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-08T09:19:35Z', 'lastTransitionTime': '2020-07-08T09:19:35Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:19:35Z', 'lastTransitionTime': '2020-07-08T09:19:35Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "homestead-fc79cc977" is progressing.'}]}}} 2020-07-08 09:19:36,298 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'ralf', 'namespace': 'default', 'owner_references': None, 'resource_version': '1119098', 'self_link': '/apis/apps/v1/namespaces/default/deployments/ralf', 'uid': '46af59da-36f6-459d-bbfa-eb62d2690b5d'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'ralf'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'ralf', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-ralf:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'name': 'ralf', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 10888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'sprout; do ' 'echo waiting ' 'for sprout ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'preemption_policy': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'ralflogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'message': 'ReplicaSet "ralf-5d845cff75" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'ralf', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/ralf', 'uid': '46af59da-36f6-459d-bbfa-eb62d2690b5d', 'resourceVersion': '1119098', 'generation': 1, 'creationTimestamp': '2020-07-08T09:19:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'ralf'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'ralf', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'ralflogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'ralf', 'image': 'ollivier/clearwater-ralf:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 10888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}], 'livenessProbe': {'tcpSocket': {'port': 10888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 10888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-08T09:19:35Z', 'lastTransitionTime': '2020-07-08T09:19:35Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:19:35Z', 'lastTransitionTime': '2020-07-08T09:19:35Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "ralf-5d845cff75" is progressing.'}]}}} 2020-07-08 09:19:36,347 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'sprout', 'namespace': 'default', 'owner_references': None, 'resource_version': '1119099', 'self_link': '/apis/apps/v1/namespaces/default/deployments/sprout', 'uid': '8b2db2f4-6475-4bd9-9f22-9afbc5239ee6'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'sprout'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'sprout', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-sprout:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 3, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'sprout', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'preemption_policy': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'sproutlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 36, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 19, 36, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 19, 36, tzinfo=tzlocal()), 'message': 'ReplicaSet "sprout-595c745f77" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'sprout', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/sprout', 'uid': '8b2db2f4-6475-4bd9-9f22-9afbc5239ee6', 'resourceVersion': '1119099', 'generation': 1, 'creationTimestamp': '2020-07-08T09:19:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'sprout'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'sprout', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'sproutlogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'sprout', 'image': 'ollivier/clearwater-sprout:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 3, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-08T09:19:36Z', 'lastTransitionTime': '2020-07-08T09:19:36Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:19:36Z', 'lastTransitionTime': '2020-07-08T09:19:35Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "sprout-595c745f77" is progressing.'}]}}} 2020-07-08 09:19:48,732 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'etcd', 'namespace': 'default', 'owner_references': None, 'resource_version': '1119179', 'self_link': '/apis/apps/v1/namespaces/default/deployments/etcd', 'uid': '853d1398-c468-48d4-a0f6-47592d5d9b24'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'instance-type': 'etcd-pod'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'instance-type': 'etcd-pod'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': ['--name', '$(MY_POD_NAME)', '--advertise-client-urls', 'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', '--listen-client-urls', 'http://0.0.0.0:2379,http://0.0.0.0:4001', '--initial-advertise-peer-urls', 'http://$(MY_POD_IP):2380', '--listen-peer-urls', 'http://0.0.0.0:2380', '--initial-cluster', '$(MY_POD_NAME)=http://$(MY_POD_IP):2380', '--initial-cluster-state', 'new'], 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}, {'name': 'MY_POD_NAME', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'metadata.name'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': None, 'image': 'quay.io/coreos/etcd:v2.2.5', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 300, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 4001}, 'timeout_seconds': 1}, 'name': 'etcd', 'ports': [{'container_port': 2379, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 2380, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 4001, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 4001}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': None, 'node_name': None, 'node_selector': None, 'preemption_policy': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 48, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 19, 48, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 19, 48, tzinfo=tzlocal()), 'message': 'ReplicaSet "etcd-596fb59b77" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'etcd', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/etcd', 'uid': '853d1398-c468-48d4-a0f6-47592d5d9b24', 'resourceVersion': '1119179', 'generation': 1, 'creationTimestamp': '2020-07-08T09:19:34Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'instance-type': 'etcd-pod'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'instance-type': 'etcd-pod'}}, 'spec': {'containers': [{'name': 'etcd', 'image': 'quay.io/coreos/etcd:v2.2.5', 'args': ['--name', '$(MY_POD_NAME)', '--advertise-client-urls', 'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', '--listen-client-urls', 'http://0.0.0.0:2379,http://0.0.0.0:4001', '--initial-advertise-peer-urls', 'http://$(MY_POD_IP):2380', '--listen-peer-urls', 'http://0.0.0.0:2380', '--initial-cluster', '$(MY_POD_NAME)=http://$(MY_POD_IP):2380', '--initial-cluster-state', 'new'], 'ports': [{'containerPort': 2379, 'protocol': 'TCP'}, {'containerPort': 2380, 'protocol': 'TCP'}, {'containerPort': 4001, 'protocol': 'TCP'}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}, {'name': 'MY_POD_NAME', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'metadata.name'}}}], 'resources': {}, 'livenessProbe': {'tcpSocket': {'port': 4001}, 'initialDelaySeconds': 300, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 4001}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:19:48Z', 'lastTransitionTime': '2020-07-08T09:19:48Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:19:48Z', 'lastTransitionTime': '2020-07-08T09:19:35Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "etcd-596fb59b77" has successfully progressed.'}]}}} 2020-07-08 09:19:48,749 - functest_kubernetes.ims.ims - INFO - etcd started in 14.17 sec 2020-07-08 09:21:33,555 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'cassandra', 'namespace': 'default', 'owner_references': None, 'resource_version': '1119516', 'self_link': '/apis/apps/v1/namespaces/default/deployments/cassandra', 'uid': '8f5f8720-db5f-48bb-8c57-6e903c983396'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'cassandra'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'cassandra'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-cassandra:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 ' '9042 ' '9160']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 600, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'cassandra', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7001, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 9042, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 9160, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 ' '9042 ' '9160']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'etcd; do ' 'echo waiting ' 'for etcd to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-etcd', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'preemption_policy': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 8, 9, 21, 33, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 21, 33, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 21, 33, tzinfo=tzlocal()), 'message': 'ReplicaSet "cassandra-7fbf8bb9cf" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'cassandra', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/cassandra', 'uid': '8f5f8720-db5f-48bb-8c57-6e903c983396', 'resourceVersion': '1119516', 'generation': 1, 'creationTimestamp': '2020-07-08T09:19:34Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'cassandra'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'cassandra'}}, 'spec': {'initContainers': [{'name': 'wait-on-etcd', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup etcd; do echo waiting for etcd to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'cassandra', 'image': 'ollivier/clearwater-cassandra:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7001, 'protocol': 'TCP'}, {'containerPort': 9042, 'protocol': 'TCP'}, {'containerPort': 9160, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 9160']}, 'initialDelaySeconds': 600, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 9160']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:21:33Z', 'lastTransitionTime': '2020-07-08T09:21:33Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:21:33Z', 'lastTransitionTime': '2020-07-08T09:19:34Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "cassandra-7fbf8bb9cf" has successfully progressed.'}]}}} 2020-07-08 09:21:33,576 - functest_kubernetes.ims.ims - INFO - cassandra started in 119.00 sec 2020-07-08 09:22:01,282 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'service': 'chronos'}, 'managed_fields': None, 'name': 'chronos', 'namespace': 'default', 'owner_references': None, 'resource_version': '1119621', 'self_link': '/apis/apps/v1/namespaces/default/deployments/chronos', 'uid': '8f3898f8-5e27-429e-adc1-c917f18e0bce'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'chronos'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'chronos'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-chronos:latest', 'image_pull_policy': 'Always', 'lifecycle': {'post_start': None, 'pre_stop': {'_exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}, 'http_get': None, 'tcp_socket': None}}, 'liveness_probe': {'_exec': None, 'failure_threshold': 9, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7253}, 'timeout_seconds': 1}, 'name': 'chronos', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7253, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7253}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/chronos', 'mount_propagation': None, 'name': 'chronoslogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/chronos/chronos_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/chronos', 'mount_propagation': None, 'name': 'chronoslogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'preemption_policy': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 120, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'chronoslogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 8, 9, 22, 1, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 22, 1, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 22, 1, tzinfo=tzlocal()), 'message': 'ReplicaSet "chronos-c55b4b9ff" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'chronos', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/chronos', 'uid': '8f3898f8-5e27-429e-adc1-c917f18e0bce', 'resourceVersion': '1119621', 'generation': 1, 'creationTimestamp': '2020-07-08T09:19:34Z', 'labels': {'service': 'chronos'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'chronos'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'chronos'}}, 'spec': {'volumes': [{'name': 'chronoslogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'chronos', 'image': 'ollivier/clearwater-chronos:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7253, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'chronoslogs', 'mountPath': '/var/log/chronos'}], 'livenessProbe': {'tcpSocket': {'port': 7253}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 9}, 'readinessProbe': {'tcpSocket': {'port': 7253}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'lifecycle': {'preStop': {'exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}}}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/chronos/chronos_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'chronoslogs', 'mountPath': '/var/log/chronos'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 120, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:22:01Z', 'lastTransitionTime': '2020-07-08T09:22:01Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:22:01Z', 'lastTransitionTime': '2020-07-08T09:19:34Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "chronos-c55b4b9ff" has successfully progressed.'}]}}} 2020-07-08 09:22:01,317 - functest_kubernetes.ims.ims - INFO - chronos started in 146.74 sec 2020-07-08 09:22:06,926 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'ellis', 'namespace': 'default', 'owner_references': None, 'resource_version': '1119648', 'self_link': '/apis/apps/v1/namespaces/default/deployments/ellis', 'uid': 'cab81990-1908-4a3b-9c66-11e61e015dd1'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'ellis'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'ellis'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-ellis:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 80}, 'timeout_seconds': 1}, 'name': 'ellis', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 80, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 80}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'preemption_policy': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 8, 9, 22, 6, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 22, 6, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 22, 6, tzinfo=tzlocal()), 'message': 'ReplicaSet "ellis-64f544db5b" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'ellis', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/ellis', 'uid': 'cab81990-1908-4a3b-9c66-11e61e015dd1', 'resourceVersion': '1119648', 'generation': 1, 'creationTimestamp': '2020-07-08T09:19:34Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'ellis'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'ellis'}}, 'spec': {'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'ellis', 'image': 'ollivier/clearwater-ellis:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 80, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'tcpSocket': {'port': 80}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 80}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:22:06Z', 'lastTransitionTime': '2020-07-08T09:22:06Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:22:06Z', 'lastTransitionTime': '2020-07-08T09:19:34Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "ellis-64f544db5b" has successfully progressed.'}]}}} 2020-07-08 09:22:06,947 - functest_kubernetes.ims.ims - INFO - ellis started in 152.37 sec 2020-07-08 09:22:12,941 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'sprout', 'namespace': 'default', 'owner_references': None, 'resource_version': '1119671', 'self_link': '/apis/apps/v1/namespaces/default/deployments/sprout', 'uid': '8b2db2f4-6475-4bd9-9f22-9afbc5239ee6'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'sprout'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'sprout', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-sprout:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 3, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'sprout', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'preemption_policy': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'sproutlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 8, 9, 22, 12, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 22, 12, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 22, 12, tzinfo=tzlocal()), 'message': 'ReplicaSet "sprout-595c745f77" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'sprout', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/sprout', 'uid': '8b2db2f4-6475-4bd9-9f22-9afbc5239ee6', 'resourceVersion': '1119671', 'generation': 1, 'creationTimestamp': '2020-07-08T09:19:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'sprout'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'sprout', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'sproutlogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'sprout', 'image': 'ollivier/clearwater-sprout:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 3, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:22:12Z', 'lastTransitionTime': '2020-07-08T09:22:12Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:22:12Z', 'lastTransitionTime': '2020-07-08T09:19:35Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "sprout-595c745f77" has successfully progressed.'}]}}} 2020-07-08 09:22:12,969 - functest_kubernetes.ims.ims - INFO - sprout started in 158.39 sec 2020-07-08 09:22:41,814 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'ralf', 'namespace': 'default', 'owner_references': None, 'resource_version': '1119778', 'self_link': '/apis/apps/v1/namespaces/default/deployments/ralf', 'uid': '46af59da-36f6-459d-bbfa-eb62d2690b5d'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'ralf'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'ralf', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-ralf:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'name': 'ralf', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 10888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'sprout; do ' 'echo waiting ' 'for sprout ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'preemption_policy': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'ralflogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 8, 9, 22, 41, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 22, 41, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 22, 41, tzinfo=tzlocal()), 'message': 'ReplicaSet "ralf-5d845cff75" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'ralf', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/ralf', 'uid': '46af59da-36f6-459d-bbfa-eb62d2690b5d', 'resourceVersion': '1119778', 'generation': 1, 'creationTimestamp': '2020-07-08T09:19:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'ralf'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'ralf', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'ralflogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'ralf', 'image': 'ollivier/clearwater-ralf:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 10888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}], 'livenessProbe': {'tcpSocket': {'port': 10888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 10888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:22:41Z', 'lastTransitionTime': '2020-07-08T09:22:41Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:22:41Z', 'lastTransitionTime': '2020-07-08T09:19:35Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "ralf-5d845cff75" has successfully progressed.'}]}}} 2020-07-08 09:22:41,835 - functest_kubernetes.ims.ims - INFO - ralf started in 187.26 sec 2020-07-08 09:22:44,637 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homestead', 'namespace': 'default', 'owner_references': None, 'resource_version': '1119795', 'self_link': '/apis/apps/v1/namespaces/default/deployments/homestead', 'uid': '2990f5b7-ff0c-493d-81e1-d2b266aa1435'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'homestead'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'homestead', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/homestead', 'mount_propagation': None, 'name': 'homesteadlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/homestead/homestead_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/homestead', 'mount_propagation': None, 'name': 'homesteadlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'sprout; do ' 'echo waiting ' 'for sprout ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'preemption_policy': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'homesteadlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 8, 9, 22, 44, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 22, 44, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 22, 44, tzinfo=tzlocal()), 'message': 'ReplicaSet "homestead-fc79cc977" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homestead', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/homestead', 'uid': '2990f5b7-ff0c-493d-81e1-d2b266aa1435', 'resourceVersion': '1119795', 'generation': 1, 'creationTimestamp': '2020-07-08T09:19:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homestead'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homestead', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'homesteadlogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead', 'image': 'ollivier/clearwater-homestead:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'homesteadlogs', 'mountPath': '/var/log/homestead'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/homestead/homestead_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'homesteadlogs', 'mountPath': '/var/log/homestead'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:22:44Z', 'lastTransitionTime': '2020-07-08T09:22:44Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:22:44Z', 'lastTransitionTime': '2020-07-08T09:19:35Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "homestead-fc79cc977" has successfully progressed.'}]}}} 2020-07-08 09:22:44,671 - functest_kubernetes.ims.ims - INFO - homestead started in 190.09 sec 2020-07-08 09:22:46,592 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homer', 'namespace': 'default', 'owner_references': None, 'resource_version': '1119802', 'self_link': '/apis/apps/v1/namespaces/default/deployments/homer', 'uid': '12b09fa3-f659-4785-92cf-bd776560faf9'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'homer'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'homer'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homer:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'name': 'homer', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'sprout; do ' 'echo waiting ' 'for sprout ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'preemption_policy': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 8, 9, 22, 46, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 22, 46, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 22, 46, tzinfo=tzlocal()), 'message': 'ReplicaSet "homer-85c5d4d87d" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homer', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/homer', 'uid': '12b09fa3-f659-4785-92cf-bd776560faf9', 'resourceVersion': '1119802', 'generation': 1, 'creationTimestamp': '2020-07-08T09:19:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homer'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homer'}}, 'spec': {'initContainers': [{'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homer', 'image': 'ollivier/clearwater-homer:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'tcpSocket': {'port': 7888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 7888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:22:46Z', 'lastTransitionTime': '2020-07-08T09:22:46Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:22:46Z', 'lastTransitionTime': '2020-07-08T09:19:35Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "homer-85c5d4d87d" has successfully progressed.'}]}}} 2020-07-08 09:22:46,610 - functest_kubernetes.ims.ims - INFO - homer started in 192.03 sec 2020-07-08 09:22:49,263 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'bono', 'namespace': 'default', 'owner_references': None, 'resource_version': '1119819', 'self_link': '/apis/apps/v1/namespaces/default/deployments/bono', 'uid': 'a751ae0c-4e93-45a3-8f61-e936eeed743d'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'bono'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'bono', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-bono:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 ' '5060 ' '5062']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'bono', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 3478, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5060, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5062, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5060, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'UDP'}, {'container_port': 5062, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'UDP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 ' '5060 ' '5062']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/bono', 'mount_propagation': None, 'name': 'bonologs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/bono/bono_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/bono', 'mount_propagation': None, 'name': 'bonologs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'sprout; do ' 'echo waiting ' 'for sprout ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'preemption_policy': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'bonologs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 8, 9, 22, 49, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 22, 49, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 22, 49, tzinfo=tzlocal()), 'message': 'ReplicaSet "bono-69fbbd8646" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'bono', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/bono', 'uid': 'a751ae0c-4e93-45a3-8f61-e936eeed743d', 'resourceVersion': '1119819', 'generation': 1, 'creationTimestamp': '2020-07-08T09:19:34Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'bono'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'bono', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'bonologs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'bono', 'image': 'ollivier/clearwater-bono:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 3478, 'protocol': 'TCP'}, {'containerPort': 5060, 'protocol': 'TCP'}, {'containerPort': 5062, 'protocol': 'TCP'}, {'containerPort': 5060, 'protocol': 'UDP'}, {'containerPort': 5062, 'protocol': 'UDP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'bonologs', 'mountPath': '/var/log/bono'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 5062']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 5062']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/bono/bono_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'bonologs', 'mountPath': '/var/log/bono'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:22:49Z', 'lastTransitionTime': '2020-07-08T09:22:49Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:22:49Z', 'lastTransitionTime': '2020-07-08T09:19:34Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "bono-69fbbd8646" has successfully progressed.'}]}}} 2020-07-08 09:22:49,293 - functest_kubernetes.ims.ims - INFO - bono started in 194.72 sec 2020-07-08 09:22:55,823 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'astaire', 'namespace': 'default', 'owner_references': None, 'resource_version': '1119841', 'self_link': '/apis/apps/v1/namespaces/default/deployments/astaire', 'uid': '68995dc6-e4d2-45b2-877e-2da5b83dc39a'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'astaire'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'astaire'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-astaire:latest', 'image_pull_policy': 'Always', 'lifecycle': {'post_start': None, 'pre_stop': {'_exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}, 'http_get': None, 'tcp_socket': None}}, 'liveness_probe': {'_exec': None, 'failure_threshold': 9, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 11311}, 'timeout_seconds': 1}, 'name': 'astaire', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 11211, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 11311, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 11311}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/astaire', 'mount_propagation': None, 'name': 'astairelogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/astaire/astaire_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/astaire', 'mount_propagation': None, 'name': 'astairelogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'preemption_policy': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 120, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'astairelogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 8, 9, 22, 55, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 22, 55, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 22, 55, tzinfo=tzlocal()), 'message': 'ReplicaSet "astaire-7666ff5885" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'astaire', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/astaire', 'uid': '68995dc6-e4d2-45b2-877e-2da5b83dc39a', 'resourceVersion': '1119841', 'generation': 1, 'creationTimestamp': '2020-07-08T09:19:34Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'astaire'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'astaire'}}, 'spec': {'volumes': [{'name': 'astairelogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'astaire', 'image': 'ollivier/clearwater-astaire:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 11211, 'protocol': 'TCP'}, {'containerPort': 11311, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'astairelogs', 'mountPath': '/var/log/astaire'}], 'livenessProbe': {'tcpSocket': {'port': 11311}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 9}, 'readinessProbe': {'tcpSocket': {'port': 11311}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'lifecycle': {'preStop': {'exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}}}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/astaire/astaire_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'astairelogs', 'mountPath': '/var/log/astaire'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 120, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:22:55Z', 'lastTransitionTime': '2020-07-08T09:22:55Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:22:55Z', 'lastTransitionTime': '2020-07-08T09:19:34Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "astaire-7666ff5885" has successfully progressed.'}]}}} 2020-07-08 09:22:55,846 - functest_kubernetes.ims.ims - INFO - astaire started in 201.27 sec 2020-07-08 09:23:08,012 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homestead-prov', 'namespace': 'default', 'owner_references': None, 'resource_version': '1119884', 'self_link': '/apis/apps/v1/namespaces/default/deployments/homestead-prov', 'uid': '3724a68c-af0c-49cb-ba4b-4d6458de1e73'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'homestead-prov'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'homestead-prov', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead-prov:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead-prov', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8889, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'homestead; ' 'do echo ' 'waiting for ' 'homestead to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'preemption_policy': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 8, 9, 23, 7, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 23, 7, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 8, 9, 23, 7, tzinfo=tzlocal()), 'message': 'ReplicaSet "homestead-prov-555fbf67b" ' 'has successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homestead-prov', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/homestead-prov', 'uid': '3724a68c-af0c-49cb-ba4b-4d6458de1e73', 'resourceVersion': '1119884', 'generation': 1, 'creationTimestamp': '2020-07-08T09:19:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homestead-prov'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homestead-prov', 'snmp': 'enabled'}}, 'spec': {'initContainers': [{'name': 'wait-on-homestead', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead-prov', 'image': 'ollivier/clearwater-homestead-prov:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8889, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:23:07Z', 'lastTransitionTime': '2020-07-08T09:23:07Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-08T09:23:07Z', 'lastTransitionTime': '2020-07-08T09:19:35Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "homestead-prov-555fbf67b" has successfully progressed.'}]}}} 2020-07-08 09:23:08,033 - functest_kubernetes.ims.ims - INFO - homestead-prov started in 213.46 sec 2020-07-08 09:23:08,057 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'chronos-c55b4b9ff-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': 'c55b4b9ff', 'service': 'chronos'}, 'managed_fields': None, 'name': 'chronos-c55b4b9ff-bwcwx', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'chronos-c55b4b9ff', 'uid': 'af648131-8061-4a3e-b822-43eb9968ee80'}], 'resource_version': '1119617', 'self_link': '/api/v1/namespaces/default/pods/chronos-c55b4b9ff-bwcwx', 'uid': '6375a070-539b-45bc-971b-1951b5867e2f'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-chronos:latest', 'image_pull_policy': 'Always', 'lifecycle': {'post_start': None, 'pre_stop': {'_exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}, 'http_get': None, 'tcp_socket': None}}, 'liveness_probe': {'_exec': None, 'failure_threshold': 9, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7253}, 'timeout_seconds': 1}, 'name': 'chronos', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7253, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7253}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/chronos', 'mount_propagation': None, 'name': 'chronoslogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-dclt7', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/chronos/chronos_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/chronos', 'mount_propagation': None, 'name': 'chronoslogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-dclt7', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup cassandra; do echo ' 'waiting for cassandra to start ' '...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-dclt7', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'kali-worker', 'node_selector': None, 'preemption_policy': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 120, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'chronoslogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}, {'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-dclt7', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-dclt7'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 21, 45, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 22, 1, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 22, 1, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://43d422340fecd6c0fb11d377a27e3d7c212c51e8d239695f6105742f3f7dcf86', 'image': 'docker.io/ollivier/clearwater-chronos:latest', 'image_id': 'docker.io/ollivier/clearwater-chronos@sha256:8ddcfa68c82ebf0b4ce6add019a8f57c024aec453f47a37017cf7dff8680268a', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'chronos', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 8, 9, 21, 50, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}, {'container_id': 'containerd://1c2ca3f47b7257c8c741ea157056e08742e4d182278c8303437cf19e31ffa13d', 'image': 'docker.io/library/busybox:latest', 'image_id': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'tailer', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 8, 9, 21, 58, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.17.0.11', 'init_container_statuses': [{'container_id': 'containerd://277c9f8d0639a8be41aeae73bf117aaa3f965e7bf86be845463696185b7cff0d', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-cassandra', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://277c9f8d0639a8be41aeae73bf117aaa3f965e7bf86be845463696185b7cff0d', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 8, 9, 21, 43, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 8, 9, 19, 43, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.153', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'chronos-c55b4b9ff-bwcwx', 'generateName': 'chronos-c55b4b9ff-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/chronos-c55b4b9ff-bwcwx', 'uid': '6375a070-539b-45bc-971b-1951b5867e2f', 'resourceVersion': '1119617', 'creationTimestamp': '2020-07-08T09:19:34Z', 'labels': {'pod-template-hash': 'c55b4b9ff', 'service': 'chronos'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'chronos-c55b4b9ff', 'uid': 'af648131-8061-4a3e-b822-43eb9968ee80', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'chronoslogs', 'emptyDir': {}}, {'name': 'default-token-dclt7', 'secret': {'secretName': 'default-token-dclt7', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-dclt7', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'chronos', 'image': 'ollivier/clearwater-chronos:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7253, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'chronoslogs', 'mountPath': '/var/log/chronos'}, {'name': 'default-token-dclt7', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'tcpSocket': {'port': 7253}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 9}, 'readinessProbe': {'tcpSocket': {'port': 7253}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'lifecycle': {'preStop': {'exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}}}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/chronos/chronos_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'chronoslogs', 'mountPath': '/var/log/chronos'}, {'name': 'default-token-dclt7', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 120, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'kali-worker', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:21:45Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:22:01Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:22:01Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:19:35Z'}], 'hostIP': '172.17.0.11', 'podIP': '10.244.1.153', 'podIPs': [{'ip': '10.244.1.153'}], 'startTime': '2020-07-08T09:19:35Z', 'initContainerStatuses': [{'name': 'wait-on-cassandra', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-08T09:19:43Z', 'finishedAt': '2020-07-08T09:21:43Z', 'containerID': 'containerd://277c9f8d0639a8be41aeae73bf117aaa3f965e7bf86be845463696185b7cff0d'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://277c9f8d0639a8be41aeae73bf117aaa3f965e7bf86be845463696185b7cff0d'}], 'containerStatuses': [{'name': 'chronos', 'state': {'running': {'startedAt': '2020-07-08T09:21:50Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-chronos:latest', 'imageID': 'docker.io/ollivier/clearwater-chronos@sha256:8ddcfa68c82ebf0b4ce6add019a8f57c024aec453f47a37017cf7dff8680268a', 'containerID': 'containerd://43d422340fecd6c0fb11d377a27e3d7c212c51e8d239695f6105742f3f7dcf86', 'started': True}, {'name': 'tailer', 'state': {'running': {'startedAt': '2020-07-08T09:21:58Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:latest', 'imageID': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'containerID': 'containerd://1c2ca3f47b7257c8c741ea157056e08742e4d182278c8303437cf19e31ffa13d', 'started': True}], 'qosClass': 'BestEffort'}}} 2020-07-08 09:23:08,089 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'homer-85c5d4d87d-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '85c5d4d87d', 'service': 'homer'}, 'managed_fields': None, 'name': 'homer-85c5d4d87d-lsmj9', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'homer-85c5d4d87d', 'uid': '0a2ed6ef-544a-43d9-af3e-6f0cba903c22'}], 'resource_version': '1119798', 'self_link': '/api/v1/namespaces/default/pods/homer-85c5d4d87d-lsmj9', 'uid': '59c12f21-6b70-4de5-9656-a15a20e7328b'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homer:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'name': 'homer', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-dclt7', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup sprout; do echo ' 'waiting for sprout to start ...; ' 'sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-dclt7', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'kali-worker2', 'node_selector': None, 'preemption_policy': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-dclt7', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-dclt7'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 22, 19, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 22, 45, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 22, 45, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://b1c6775452695c98429eaacdc3f626f6f6dc99966fd5b3e1301d66d66924642b', 'image': 'docker.io/ollivier/clearwater-homer:latest', 'image_id': 'docker.io/ollivier/clearwater-homer@sha256:19c6d11d2678c44822f07c01c574fed426e3c99003b6af0410f0911d57939d5a', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'homer', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 8, 9, 22, 32, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.17.0.12', 'init_container_statuses': [{'container_id': 'containerd://ec0ea9e52bc25a5c69d7dfee9362446022e98aab5a48fccbf24102197ae40b54', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-sprout', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://ec0ea9e52bc25a5c69d7dfee9362446022e98aab5a48fccbf24102197ae40b54', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 8, 9, 22, 16, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 8, 9, 19, 43, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.67', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'homer-85c5d4d87d-lsmj9', 'generateName': 'homer-85c5d4d87d-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/homer-85c5d4d87d-lsmj9', 'uid': '59c12f21-6b70-4de5-9656-a15a20e7328b', 'resourceVersion': '1119798', 'creationTimestamp': '2020-07-08T09:19:35Z', 'labels': {'pod-template-hash': '85c5d4d87d', 'service': 'homer'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'homer-85c5d4d87d', 'uid': '0a2ed6ef-544a-43d9-af3e-6f0cba903c22', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-dclt7', 'secret': {'secretName': 'default-token-dclt7', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-dclt7', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homer', 'image': 'ollivier/clearwater-homer:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'default-token-dclt7', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'tcpSocket': {'port': 7888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 7888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'kali-worker2', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:22:19Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:22:45Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:22:45Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:19:35Z'}], 'hostIP': '172.17.0.12', 'podIP': '10.244.2.67', 'podIPs': [{'ip': '10.244.2.67'}], 'startTime': '2020-07-08T09:19:35Z', 'initContainerStatuses': [{'name': 'wait-on-sprout', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-08T09:19:43Z', 'finishedAt': '2020-07-08T09:22:16Z', 'containerID': 'containerd://ec0ea9e52bc25a5c69d7dfee9362446022e98aab5a48fccbf24102197ae40b54'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://ec0ea9e52bc25a5c69d7dfee9362446022e98aab5a48fccbf24102197ae40b54'}], 'containerStatuses': [{'name': 'homer', 'state': {'running': {'startedAt': '2020-07-08T09:22:32Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-homer:latest', 'imageID': 'docker.io/ollivier/clearwater-homer@sha256:19c6d11d2678c44822f07c01c574fed426e3c99003b6af0410f0911d57939d5a', 'containerID': 'containerd://b1c6775452695c98429eaacdc3f626f6f6dc99966fd5b3e1301d66d66924642b', 'started': True}], 'qosClass': 'BestEffort'}}} 2020-07-08 09:23:08,111 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'sprout-595c745f77-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '595c745f77', 'service': 'sprout', 'snmp': 'enabled'}, 'managed_fields': None, 'name': 'sprout-595c745f77-9ldqw', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'sprout-595c745f77', 'uid': 'e8b5f53c-70c3-4cb7-9252-9e62e399e13f'}], 'resource_version': '1119666', 'self_link': '/api/v1/namespaces/default/pods/sprout-595c745f77-9ldqw', 'uid': '955ffcbb-b5e9-4180-937a-6ef67d61c3c0'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-sprout:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 3, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'sprout', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-dclt7', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-dclt7', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup cassandra; do echo ' 'waiting for cassandra to start ' '...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-dclt7', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'kali-worker', 'node_selector': None, 'preemption_policy': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'sproutlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}, {'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-dclt7', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-dclt7'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 21, 48, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 22, 11, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 22, 11, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://df1da6ea86cf5fae91008f1aff88e44aa098d698d5a78f8cf9aac8a92eef5ed3', 'image': 'docker.io/ollivier/clearwater-sprout:latest', 'image_id': 'docker.io/ollivier/clearwater-sprout@sha256:44590682de48854faeccc1f4c7de39cb666014a0c4e3abd93adcccad3208a6e2', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'sprout', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 8, 9, 21, 53, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}, {'container_id': 'containerd://b83c8cd976fe8ac29f9b73d113864a8593da11263761334c8cf3821e2596e669', 'image': 'docker.io/library/busybox:latest', 'image_id': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'tailer', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 8, 9, 22, 4, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.17.0.11', 'init_container_statuses': [{'container_id': 'containerd://aab8c1d6668533f37a174425250e052e5b4ce86e1381432987594ec1d5fe0014', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-cassandra', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://aab8c1d6668533f37a174425250e052e5b4ce86e1381432987594ec1d5fe0014', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 8, 9, 21, 46, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 8, 9, 19, 48, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.158', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 8, 9, 19, 36, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'sprout-595c745f77-9ldqw', 'generateName': 'sprout-595c745f77-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/sprout-595c745f77-9ldqw', 'uid': '955ffcbb-b5e9-4180-937a-6ef67d61c3c0', 'resourceVersion': '1119666', 'creationTimestamp': '2020-07-08T09:19:35Z', 'labels': {'pod-template-hash': '595c745f77', 'service': 'sprout', 'snmp': 'enabled'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'sprout-595c745f77', 'uid': 'e8b5f53c-70c3-4cb7-9252-9e62e399e13f', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'sproutlogs', 'emptyDir': {}}, {'name': 'default-token-dclt7', 'secret': {'secretName': 'default-token-dclt7', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-dclt7', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'sprout', 'image': 'ollivier/clearwater-sprout:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}, {'name': 'default-token-dclt7', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 3, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}, {'name': 'default-token-dclt7', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'kali-worker', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:21:48Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:22:11Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:22:11Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:19:35Z'}], 'hostIP': '172.17.0.11', 'podIP': '10.244.1.158', 'podIPs': [{'ip': '10.244.1.158'}], 'startTime': '2020-07-08T09:19:36Z', 'initContainerStatuses': [{'name': 'wait-on-cassandra', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-08T09:19:48Z', 'finishedAt': '2020-07-08T09:21:46Z', 'containerID': 'containerd://aab8c1d6668533f37a174425250e052e5b4ce86e1381432987594ec1d5fe0014'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://aab8c1d6668533f37a174425250e052e5b4ce86e1381432987594ec1d5fe0014'}], 'containerStatuses': [{'name': 'sprout', 'state': {'running': {'startedAt': '2020-07-08T09:21:53Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-sprout:latest', 'imageID': 'docker.io/ollivier/clearwater-sprout@sha256:44590682de48854faeccc1f4c7de39cb666014a0c4e3abd93adcccad3208a6e2', 'containerID': 'containerd://df1da6ea86cf5fae91008f1aff88e44aa098d698d5a78f8cf9aac8a92eef5ed3', 'started': True}, {'name': 'tailer', 'state': {'running': {'startedAt': '2020-07-08T09:22:04Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:latest', 'imageID': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'containerID': 'containerd://b83c8cd976fe8ac29f9b73d113864a8593da11263761334c8cf3821e2596e669', 'started': True}], 'qosClass': 'BestEffort'}}} 2020-07-08 09:23:08,165 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'bono-69fbbd8646-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '69fbbd8646', 'service': 'bono', 'snmp': 'enabled'}, 'managed_fields': None, 'name': 'bono-69fbbd8646-78phx', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'bono-69fbbd8646', 'uid': '61e7db37-1d26-43dc-8516-28a76c4a4cf8'}], 'resource_version': '1119814', 'self_link': '/api/v1/namespaces/default/pods/bono-69fbbd8646-78phx', 'uid': '26663176-fd2a-4dbf-ae58-b88041e67118'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-bono:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 ' '5062']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'bono', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 3478, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5060, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5062, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5060, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'UDP'}, {'container_port': 5062, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'UDP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 ' '5062']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/bono', 'mount_propagation': None, 'name': 'bonologs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-dclt7', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/bono/bono_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/bono', 'mount_propagation': None, 'name': 'bonologs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-dclt7', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup sprout; do echo ' 'waiting for sprout to start ...; ' 'sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-dclt7', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'kali-worker2', 'node_selector': None, 'preemption_policy': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'bonologs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}, {'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-dclt7', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-dclt7'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 22, 18, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 22, 48, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 22, 48, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://6d591a0cb8ad03c0dd816f0e76b0c4cc39f86c3fd8dda9b356b3d48a554e09f1', 'image': 'docker.io/ollivier/clearwater-bono:latest', 'image_id': 'docker.io/ollivier/clearwater-bono@sha256:eb98596100b1553c9814b6185863ec53e743eb0370faeeafe16fc1dfe8d02ec3', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'bono', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 8, 9, 22, 27, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}, {'container_id': 'containerd://9e538e9d9666652af0161b1af162143b1af66a1ec6ade13be63d57a004dabaf6', 'image': 'docker.io/library/busybox:latest', 'image_id': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'tailer', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 8, 9, 22, 39, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.17.0.12', 'init_container_statuses': [{'container_id': 'containerd://8490534ccf05297462de042ab01dd90d1fc9053795c51e96c5c47e98413e1a32', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-sprout', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://8490534ccf05297462de042ab01dd90d1fc9053795c51e96c5c47e98413e1a32', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 8, 9, 22, 15, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 8, 9, 19, 48, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.71', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'bono-69fbbd8646-78phx', 'generateName': 'bono-69fbbd8646-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/bono-69fbbd8646-78phx', 'uid': '26663176-fd2a-4dbf-ae58-b88041e67118', 'resourceVersion': '1119814', 'creationTimestamp': '2020-07-08T09:19:34Z', 'labels': {'pod-template-hash': '69fbbd8646', 'service': 'bono', 'snmp': 'enabled'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'bono-69fbbd8646', 'uid': '61e7db37-1d26-43dc-8516-28a76c4a4cf8', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'bonologs', 'emptyDir': {}}, {'name': 'default-token-dclt7', 'secret': {'secretName': 'default-token-dclt7', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-dclt7', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'bono', 'image': 'ollivier/clearwater-bono:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 3478, 'protocol': 'TCP'}, {'containerPort': 5060, 'protocol': 'TCP'}, {'containerPort': 5062, 'protocol': 'TCP'}, {'containerPort': 5060, 'protocol': 'UDP'}, {'containerPort': 5062, 'protocol': 'UDP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'bonologs', 'mountPath': '/var/log/bono'}, {'name': 'default-token-dclt7', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 5062']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 5062']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/bono/bono_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'bonologs', 'mountPath': '/var/log/bono'}, {'name': 'default-token-dclt7', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'kali-worker2', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:22:18Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:22:48Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:22:48Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:19:34Z'}], 'hostIP': '172.17.0.12', 'podIP': '10.244.2.71', 'podIPs': [{'ip': '10.244.2.71'}], 'startTime': '2020-07-08T09:19:35Z', 'initContainerStatuses': [{'name': 'wait-on-sprout', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-08T09:19:48Z', 'finishedAt': '2020-07-08T09:22:15Z', 'containerID': 'containerd://8490534ccf05297462de042ab01dd90d1fc9053795c51e96c5c47e98413e1a32'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://8490534ccf05297462de042ab01dd90d1fc9053795c51e96c5c47e98413e1a32'}], 'containerStatuses': [{'name': 'bono', 'state': {'running': {'startedAt': '2020-07-08T09:22:27Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-bono:latest', 'imageID': 'docker.io/ollivier/clearwater-bono@sha256:eb98596100b1553c9814b6185863ec53e743eb0370faeeafe16fc1dfe8d02ec3', 'containerID': 'containerd://6d591a0cb8ad03c0dd816f0e76b0c4cc39f86c3fd8dda9b356b3d48a554e09f1', 'started': True}, {'name': 'tailer', 'state': {'running': {'startedAt': '2020-07-08T09:22:39Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:latest', 'imageID': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'containerID': 'containerd://9e538e9d9666652af0161b1af162143b1af66a1ec6ade13be63d57a004dabaf6', 'started': True}], 'qosClass': 'BestEffort'}}} 2020-07-08 09:23:08,220 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'cassandra-7fbf8bb9cf-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '7fbf8bb9cf', 'service': 'cassandra'}, 'managed_fields': None, 'name': 'cassandra-7fbf8bb9cf-kkrjs', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'cassandra-7fbf8bb9cf', 'uid': '59847728-ffdb-4016-9349-fac6cc4f284b'}], 'resource_version': '1119512', 'self_link': '/api/v1/namespaces/default/pods/cassandra-7fbf8bb9cf-kkrjs', 'uid': 'd3f3f447-54ec-4627-9a6d-b62af241a578'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-cassandra:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 ' '9160']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 600, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'cassandra', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7001, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 9042, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 9160, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 ' '9160']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-dclt7', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup etcd; do echo ' 'waiting for etcd to start ...; ' 'sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-etcd', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-dclt7', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'kali-worker2', 'node_selector': None, 'preemption_policy': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-dclt7', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-dclt7'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 51, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 21, 33, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 21, 33, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://f46f4d97a09774642c1dc3703a09091fe3b6def3bd42c316b1114e6ac3111b54', 'image': 'docker.io/ollivier/clearwater-cassandra:latest', 'image_id': 'docker.io/ollivier/clearwater-cassandra@sha256:07e93f55decdc1224fb8d161edb5617d58e3488c1250168337548ccc3e82f6b7', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'cassandra', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 8, 9, 19, 59, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.17.0.12', 'init_container_statuses': [{'container_id': 'containerd://af4695e2afe3e8ab92da20297cb8d15ba248c2d784ec95eb77428362ce9e4da6', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-etcd', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://af4695e2afe3e8ab92da20297cb8d15ba248c2d784ec95eb77428362ce9e4da6', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 8, 9, 19, 50, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 8, 9, 19, 46, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.68', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'cassandra-7fbf8bb9cf-kkrjs', 'generateName': 'cassandra-7fbf8bb9cf-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/cassandra-7fbf8bb9cf-kkrjs', 'uid': 'd3f3f447-54ec-4627-9a6d-b62af241a578', 'resourceVersion': '1119512', 'creationTimestamp': '2020-07-08T09:19:34Z', 'labels': {'pod-template-hash': '7fbf8bb9cf', 'service': 'cassandra'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'cassandra-7fbf8bb9cf', 'uid': '59847728-ffdb-4016-9349-fac6cc4f284b', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-dclt7', 'secret': {'secretName': 'default-token-dclt7', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-etcd', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup etcd; do echo waiting for etcd to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-dclt7', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'cassandra', 'image': 'ollivier/clearwater-cassandra:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7001, 'protocol': 'TCP'}, {'containerPort': 9042, 'protocol': 'TCP'}, {'containerPort': 9160, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'default-token-dclt7', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 9160']}, 'initialDelaySeconds': 600, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 9160']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'kali-worker2', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:19:51Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:21:33Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:21:33Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:19:34Z'}], 'hostIP': '172.17.0.12', 'podIP': '10.244.2.68', 'podIPs': [{'ip': '10.244.2.68'}], 'startTime': '2020-07-08T09:19:35Z', 'initContainerStatuses': [{'name': 'wait-on-etcd', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-08T09:19:46Z', 'finishedAt': '2020-07-08T09:19:50Z', 'containerID': 'containerd://af4695e2afe3e8ab92da20297cb8d15ba248c2d784ec95eb77428362ce9e4da6'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://af4695e2afe3e8ab92da20297cb8d15ba248c2d784ec95eb77428362ce9e4da6'}], 'containerStatuses': [{'name': 'cassandra', 'state': {'running': {'startedAt': '2020-07-08T09:19:59Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-cassandra:latest', 'imageID': 'docker.io/ollivier/clearwater-cassandra@sha256:07e93f55decdc1224fb8d161edb5617d58e3488c1250168337548ccc3e82f6b7', 'containerID': 'containerd://f46f4d97a09774642c1dc3703a09091fe3b6def3bd42c316b1114e6ac3111b54', 'started': True}], 'qosClass': 'BestEffort'}}} 2020-07-08 09:23:08,244 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'homestead-fc79cc977-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': 'fc79cc977', 'service': 'homestead', 'snmp': 'enabled'}, 'managed_fields': None, 'name': 'homestead-fc79cc977-ssj87', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'homestead-fc79cc977', 'uid': 'b84a1c27-7336-419b-954d-9017f8d8182b'}], 'resource_version': '1119790', 'self_link': '/api/v1/namespaces/default/pods/homestead-fc79cc977-ssj87', 'uid': '3671757a-865f-42a9-a5fe-820d1ba18964'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/homestead', 'mount_propagation': None, 'name': 'homesteadlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-dclt7', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/homestead/homestead_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/homestead', 'mount_propagation': None, 'name': 'homesteadlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-dclt7', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup sprout; do echo ' 'waiting for sprout to start ...; ' 'sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-dclt7', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'kali-worker2', 'node_selector': None, 'preemption_policy': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'homesteadlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}, {'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-dclt7', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-dclt7'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 22, 16, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 22, 44, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 22, 44, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://d69f851f940efda87b47353cf0a360e736d5f4c0acc8b12d683f438dd48d9b79', 'image': 'docker.io/ollivier/clearwater-homestead:latest', 'image_id': 'docker.io/ollivier/clearwater-homestead@sha256:0b3c89ab451b09e347657d5f85ed99d47ec3e8689b98916af72b23576926b08d', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'homestead', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 8, 9, 22, 23, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}, {'container_id': 'containerd://60bb1c308bbcac18978ddeed14f6b921fa83efe7705a36aade1800559e554498', 'image': 'docker.io/library/busybox:latest', 'image_id': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'tailer', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 8, 9, 22, 36, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.17.0.12', 'init_container_statuses': [{'container_id': 'containerd://7838a02df91e74bf2924228d9be51246e1cb7e017d73f49d2ebc330fecfdf5bb', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-sprout', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://7838a02df91e74bf2924228d9be51246e1cb7e017d73f49d2ebc330fecfdf5bb', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 8, 9, 22, 14, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 8, 9, 19, 48, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.69', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'homestead-fc79cc977-ssj87', 'generateName': 'homestead-fc79cc977-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/homestead-fc79cc977-ssj87', 'uid': '3671757a-865f-42a9-a5fe-820d1ba18964', 'resourceVersion': '1119790', 'creationTimestamp': '2020-07-08T09:19:35Z', 'labels': {'pod-template-hash': 'fc79cc977', 'service': 'homestead', 'snmp': 'enabled'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'homestead-fc79cc977', 'uid': 'b84a1c27-7336-419b-954d-9017f8d8182b', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'homesteadlogs', 'emptyDir': {}}, {'name': 'default-token-dclt7', 'secret': {'secretName': 'default-token-dclt7', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-dclt7', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead', 'image': 'ollivier/clearwater-homestead:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'homesteadlogs', 'mountPath': '/var/log/homestead'}, {'name': 'default-token-dclt7', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/homestead/homestead_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'homesteadlogs', 'mountPath': '/var/log/homestead'}, {'name': 'default-token-dclt7', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'kali-worker2', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:22:16Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:22:44Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:22:44Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:19:35Z'}], 'hostIP': '172.17.0.12', 'podIP': '10.244.2.69', 'podIPs': [{'ip': '10.244.2.69'}], 'startTime': '2020-07-08T09:19:35Z', 'initContainerStatuses': [{'name': 'wait-on-sprout', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-08T09:19:48Z', 'finishedAt': '2020-07-08T09:22:14Z', 'containerID': 'containerd://7838a02df91e74bf2924228d9be51246e1cb7e017d73f49d2ebc330fecfdf5bb'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://7838a02df91e74bf2924228d9be51246e1cb7e017d73f49d2ebc330fecfdf5bb'}], 'containerStatuses': [{'name': 'homestead', 'state': {'running': {'startedAt': '2020-07-08T09:22:23Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-homestead:latest', 'imageID': 'docker.io/ollivier/clearwater-homestead@sha256:0b3c89ab451b09e347657d5f85ed99d47ec3e8689b98916af72b23576926b08d', 'containerID': 'containerd://d69f851f940efda87b47353cf0a360e736d5f4c0acc8b12d683f438dd48d9b79', 'started': True}, {'name': 'tailer', 'state': {'running': {'startedAt': '2020-07-08T09:22:36Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:latest', 'imageID': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'containerID': 'containerd://60bb1c308bbcac18978ddeed14f6b921fa83efe7705a36aade1800559e554498', 'started': True}], 'qosClass': 'BestEffort'}}} 2020-07-08 09:23:08,271 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'astaire-7666ff5885-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '7666ff5885', 'service': 'astaire'}, 'managed_fields': None, 'name': 'astaire-7666ff5885-8422r', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'astaire-7666ff5885', 'uid': '62ae5fd1-4ece-4649-9838-28ccafb17976'}], 'resource_version': '1119837', 'self_link': '/api/v1/namespaces/default/pods/astaire-7666ff5885-8422r', 'uid': 'c8879a09-6415-4651-b59b-cc2f0e869190'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-astaire:latest', 'image_pull_policy': 'Always', 'lifecycle': {'post_start': None, 'pre_stop': {'_exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}, 'http_get': None, 'tcp_socket': None}}, 'liveness_probe': {'_exec': None, 'failure_threshold': 9, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 11311}, 'timeout_seconds': 1}, 'name': 'astaire', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 11211, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 11311, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 11311}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/astaire', 'mount_propagation': None, 'name': 'astairelogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-dclt7', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/astaire/astaire_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/astaire', 'mount_propagation': None, 'name': 'astairelogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-dclt7', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup cassandra; do echo ' 'waiting for cassandra to start ' '...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-dclt7', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'kali-worker', 'node_selector': None, 'preemption_policy': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 120, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'astairelogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}, {'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-dclt7', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-dclt7'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 21, 50, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 22, 55, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 22, 55, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://415b12169fcc95f7b2124672d1361976e0cf60c4cced7fc195315eb2b6cd4036', 'image': 'docker.io/ollivier/clearwater-astaire:latest', 'image_id': 'docker.io/ollivier/clearwater-astaire@sha256:f365f3b72267bef0fd696e4a93c0f3c19fb65ad42a8850fe22873dbadd03fdba', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'astaire', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 8, 9, 22, 1, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}, {'container_id': 'containerd://a47826743d528874cf20c076e17828616ec85d6aee081ea17f22d8a8c429a5b5', 'image': 'docker.io/library/busybox:latest', 'image_id': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'tailer', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 8, 9, 22, 7, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.17.0.11', 'init_container_statuses': [{'container_id': 'containerd://dd3a1f8d12daa0738a441efcb899a37ae0ae6c11ab4aa98d1d51f26ad6eeee8c', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-cassandra', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://dd3a1f8d12daa0738a441efcb899a37ae0ae6c11ab4aa98d1d51f26ad6eeee8c', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 8, 9, 21, 49, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 8, 9, 19, 45, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.154', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'astaire-7666ff5885-8422r', 'generateName': 'astaire-7666ff5885-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/astaire-7666ff5885-8422r', 'uid': 'c8879a09-6415-4651-b59b-cc2f0e869190', 'resourceVersion': '1119837', 'creationTimestamp': '2020-07-08T09:19:34Z', 'labels': {'pod-template-hash': '7666ff5885', 'service': 'astaire'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'astaire-7666ff5885', 'uid': '62ae5fd1-4ece-4649-9838-28ccafb17976', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'astairelogs', 'emptyDir': {}}, {'name': 'default-token-dclt7', 'secret': {'secretName': 'default-token-dclt7', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-dclt7', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'astaire', 'image': 'ollivier/clearwater-astaire:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 11211, 'protocol': 'TCP'}, {'containerPort': 11311, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'astairelogs', 'mountPath': '/var/log/astaire'}, {'name': 'default-token-dclt7', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'tcpSocket': {'port': 11311}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 9}, 'readinessProbe': {'tcpSocket': {'port': 11311}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'lifecycle': {'preStop': {'exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}}}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/astaire/astaire_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'astairelogs', 'mountPath': '/var/log/astaire'}, {'name': 'default-token-dclt7', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 120, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'kali-worker', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:21:50Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:22:55Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:22:55Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:19:34Z'}], 'hostIP': '172.17.0.11', 'podIP': '10.244.1.154', 'podIPs': [{'ip': '10.244.1.154'}], 'startTime': '2020-07-08T09:19:34Z', 'initContainerStatuses': [{'name': 'wait-on-cassandra', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-08T09:19:45Z', 'finishedAt': '2020-07-08T09:21:49Z', 'containerID': 'containerd://dd3a1f8d12daa0738a441efcb899a37ae0ae6c11ab4aa98d1d51f26ad6eeee8c'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://dd3a1f8d12daa0738a441efcb899a37ae0ae6c11ab4aa98d1d51f26ad6eeee8c'}], 'containerStatuses': [{'name': 'astaire', 'state': {'running': {'startedAt': '2020-07-08T09:22:01Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-astaire:latest', 'imageID': 'docker.io/ollivier/clearwater-astaire@sha256:f365f3b72267bef0fd696e4a93c0f3c19fb65ad42a8850fe22873dbadd03fdba', 'containerID': 'containerd://415b12169fcc95f7b2124672d1361976e0cf60c4cced7fc195315eb2b6cd4036', 'started': True}, {'name': 'tailer', 'state': {'running': {'startedAt': '2020-07-08T09:22:07Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:latest', 'imageID': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'containerID': 'containerd://a47826743d528874cf20c076e17828616ec85d6aee081ea17f22d8a8c429a5b5', 'started': True}], 'qosClass': 'BestEffort'}}} 2020-07-08 09:23:08,301 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'ellis-64f544db5b-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '64f544db5b', 'service': 'ellis'}, 'managed_fields': None, 'name': 'ellis-64f544db5b-52s8w', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'ellis-64f544db5b', 'uid': '67c0e002-83c7-46fb-8372-b166768e1c0c'}], 'resource_version': '1119643', 'self_link': '/api/v1/namespaces/default/pods/ellis-64f544db5b-52s8w', 'uid': '73621a8b-b740-46e3-9039-73e141466928'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-ellis:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 80}, 'timeout_seconds': 1}, 'name': 'ellis', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 80, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 80}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-dclt7', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup cassandra; do echo ' 'waiting for cassandra to start ' '...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-dclt7', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'kali-worker2', 'node_selector': None, 'preemption_policy': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-dclt7', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-dclt7'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 21, 50, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 22, 6, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 22, 6, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://69a8a5bcbcbbe92083f85a7c303ac46e5cb6a743ae6054c72ba10d8f6c5f5e8d', 'image': 'docker.io/ollivier/clearwater-ellis:latest', 'image_id': 'docker.io/ollivier/clearwater-ellis@sha256:8c84761d2d906e344bc6a85a11451d35696cf684305555611df16ce2615ac816', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'ellis', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 8, 9, 21, 56, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.17.0.12', 'init_container_statuses': [{'container_id': 'containerd://bcf7f8ddb401a1c157cf758b5f49c42debf23b1068a5f37c71423310b1dae7d9', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-cassandra', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://bcf7f8ddb401a1c157cf758b5f49c42debf23b1068a5f37c71423310b1dae7d9', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 8, 9, 21, 49, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 8, 9, 19, 48, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.70', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'ellis-64f544db5b-52s8w', 'generateName': 'ellis-64f544db5b-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/ellis-64f544db5b-52s8w', 'uid': '73621a8b-b740-46e3-9039-73e141466928', 'resourceVersion': '1119643', 'creationTimestamp': '2020-07-08T09:19:34Z', 'labels': {'pod-template-hash': '64f544db5b', 'service': 'ellis'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'ellis-64f544db5b', 'uid': '67c0e002-83c7-46fb-8372-b166768e1c0c', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-dclt7', 'secret': {'secretName': 'default-token-dclt7', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-dclt7', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'ellis', 'image': 'ollivier/clearwater-ellis:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 80, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'default-token-dclt7', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'tcpSocket': {'port': 80}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 80}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'kali-worker2', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:21:50Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:22:06Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:22:06Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:19:35Z'}], 'hostIP': '172.17.0.12', 'podIP': '10.244.2.70', 'podIPs': [{'ip': '10.244.2.70'}], 'startTime': '2020-07-08T09:19:35Z', 'initContainerStatuses': [{'name': 'wait-on-cassandra', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-08T09:19:48Z', 'finishedAt': '2020-07-08T09:21:49Z', 'containerID': 'containerd://bcf7f8ddb401a1c157cf758b5f49c42debf23b1068a5f37c71423310b1dae7d9'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://bcf7f8ddb401a1c157cf758b5f49c42debf23b1068a5f37c71423310b1dae7d9'}], 'containerStatuses': [{'name': 'ellis', 'state': {'running': {'startedAt': '2020-07-08T09:21:56Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-ellis:latest', 'imageID': 'docker.io/ollivier/clearwater-ellis@sha256:8c84761d2d906e344bc6a85a11451d35696cf684305555611df16ce2615ac816', 'containerID': 'containerd://69a8a5bcbcbbe92083f85a7c303ac46e5cb6a743ae6054c72ba10d8f6c5f5e8d', 'started': True}], 'qosClass': 'BestEffort'}}} 2020-07-08 09:23:08,330 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'etcd-596fb59b77-', 'generation': None, 'initializers': None, 'labels': {'instance-type': 'etcd-pod', 'pod-template-hash': '596fb59b77'}, 'managed_fields': None, 'name': 'etcd-596fb59b77-g5gnh', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'etcd-596fb59b77', 'uid': '57e0a43a-971a-4cbf-88a0-4911c83ed6ee'}], 'resource_version': '1119173', 'self_link': '/api/v1/namespaces/default/pods/etcd-596fb59b77-g5gnh', 'uid': '12bcdaed-a236-4725-8858-c2e0d3696df7'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': ['--name', '$(MY_POD_NAME)', '--advertise-client-urls', 'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', '--listen-client-urls', 'http://0.0.0.0:2379,http://0.0.0.0:4001', '--initial-advertise-peer-urls', 'http://$(MY_POD_IP):2380', '--listen-peer-urls', 'http://0.0.0.0:2380', '--initial-cluster', '$(MY_POD_NAME)=http://$(MY_POD_IP):2380', '--initial-cluster-state', 'new'], 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}, {'name': 'MY_POD_NAME', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'metadata.name'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': None, 'image': 'quay.io/coreos/etcd:v2.2.5', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 300, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 4001}, 'timeout_seconds': 1}, 'name': 'etcd', 'ports': [{'container_port': 2379, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 2380, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 4001, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 4001}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-dclt7', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': None, 'node_name': 'kali-worker', 'node_selector': None, 'preemption_policy': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-dclt7', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-dclt7'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 47, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 47, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://2dd9a936cd7bc79c2dcb91d57a8edc18997d75d1b49916238542f22ed126612b', 'image': 'quay.io/coreos/etcd:v2.2.5', 'image_id': 'sha256:66590e2dd05422771324d8ffe9ad35165ba35db0842ac5e0f1668c2d56733860', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'etcd', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 8, 9, 19, 45, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.17.0.11', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.155', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'etcd-596fb59b77-g5gnh', 'generateName': 'etcd-596fb59b77-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/etcd-596fb59b77-g5gnh', 'uid': '12bcdaed-a236-4725-8858-c2e0d3696df7', 'resourceVersion': '1119173', 'creationTimestamp': '2020-07-08T09:19:35Z', 'labels': {'instance-type': 'etcd-pod', 'pod-template-hash': '596fb59b77'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'etcd-596fb59b77', 'uid': '57e0a43a-971a-4cbf-88a0-4911c83ed6ee', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-dclt7', 'secret': {'secretName': 'default-token-dclt7', 'defaultMode': 420}}], 'containers': [{'name': 'etcd', 'image': 'quay.io/coreos/etcd:v2.2.5', 'args': ['--name', '$(MY_POD_NAME)', '--advertise-client-urls', 'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', '--listen-client-urls', 'http://0.0.0.0:2379,http://0.0.0.0:4001', '--initial-advertise-peer-urls', 'http://$(MY_POD_IP):2380', '--listen-peer-urls', 'http://0.0.0.0:2380', '--initial-cluster', '$(MY_POD_NAME)=http://$(MY_POD_IP):2380', '--initial-cluster-state', 'new'], 'ports': [{'containerPort': 2379, 'protocol': 'TCP'}, {'containerPort': 2380, 'protocol': 'TCP'}, {'containerPort': 4001, 'protocol': 'TCP'}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}, {'name': 'MY_POD_NAME', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'metadata.name'}}}], 'resources': {}, 'volumeMounts': [{'name': 'default-token-dclt7', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'tcpSocket': {'port': 4001}, 'initialDelaySeconds': 300, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 4001}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'kali-worker', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:19:35Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:19:47Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:19:47Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:19:35Z'}], 'hostIP': '172.17.0.11', 'podIP': '10.244.1.155', 'podIPs': [{'ip': '10.244.1.155'}], 'startTime': '2020-07-08T09:19:35Z', 'containerStatuses': [{'name': 'etcd', 'state': {'running': {'startedAt': '2020-07-08T09:19:45Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'quay.io/coreos/etcd:v2.2.5', 'imageID': 'sha256:66590e2dd05422771324d8ffe9ad35165ba35db0842ac5e0f1668c2d56733860', 'containerID': 'containerd://2dd9a936cd7bc79c2dcb91d57a8edc18997d75d1b49916238542f22ed126612b', 'started': True}], 'qosClass': 'BestEffort'}}} 2020-07-08 09:23:08,348 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'homestead-prov-555fbf67b-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '555fbf67b', 'service': 'homestead-prov', 'snmp': 'enabled'}, 'managed_fields': None, 'name': 'homestead-prov-555fbf67b-75c9v', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'homestead-prov-555fbf67b', 'uid': '056528a7-b4a4-4931-a144-f4b0b42d51d0'}], 'resource_version': '1119880', 'self_link': '/api/v1/namespaces/default/pods/homestead-prov-555fbf67b-75c9v', 'uid': '95fc8d75-a8c7-41b4-a364-b6e8e95d3c34'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead-prov:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead-prov', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8889, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-dclt7', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup homestead; do echo ' 'waiting for homestead to start ' '...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-dclt7', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'kali-worker', 'node_selector': None, 'preemption_policy': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-dclt7', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-dclt7'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 22, 55, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 23, 7, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 23, 7, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://b4909c0ab2e18be75c7917c24211942a30c0625363e51d62a58a45d7ce9e6c3c', 'image': 'docker.io/ollivier/clearwater-homestead-prov:latest', 'image_id': 'docker.io/ollivier/clearwater-homestead-prov@sha256:141a336f17eaf068dbe8da4b01a832033aed5c09e7fa6349ec091ee30b76c9b1', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'homestead-prov', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 8, 9, 23, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.17.0.11', 'init_container_statuses': [{'container_id': 'containerd://052dcaae42fa9e7d3e59230b48d7782494e07c951be44780538e4cbd4a60a528', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-homestead', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://052dcaae42fa9e7d3e59230b48d7782494e07c951be44780538e4cbd4a60a528', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 8, 9, 22, 55, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 8, 9, 19, 46, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.156', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'homestead-prov-555fbf67b-75c9v', 'generateName': 'homestead-prov-555fbf67b-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/homestead-prov-555fbf67b-75c9v', 'uid': '95fc8d75-a8c7-41b4-a364-b6e8e95d3c34', 'resourceVersion': '1119880', 'creationTimestamp': '2020-07-08T09:19:35Z', 'labels': {'pod-template-hash': '555fbf67b', 'service': 'homestead-prov', 'snmp': 'enabled'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'homestead-prov-555fbf67b', 'uid': '056528a7-b4a4-4931-a144-f4b0b42d51d0', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-dclt7', 'secret': {'secretName': 'default-token-dclt7', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-homestead', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-dclt7', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead-prov', 'image': 'ollivier/clearwater-homestead-prov:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8889, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'default-token-dclt7', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'kali-worker', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:22:55Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:23:07Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:23:07Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:19:35Z'}], 'hostIP': '172.17.0.11', 'podIP': '10.244.1.156', 'podIPs': [{'ip': '10.244.1.156'}], 'startTime': '2020-07-08T09:19:35Z', 'initContainerStatuses': [{'name': 'wait-on-homestead', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-08T09:19:46Z', 'finishedAt': '2020-07-08T09:22:55Z', 'containerID': 'containerd://052dcaae42fa9e7d3e59230b48d7782494e07c951be44780538e4cbd4a60a528'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://052dcaae42fa9e7d3e59230b48d7782494e07c951be44780538e4cbd4a60a528'}], 'containerStatuses': [{'name': 'homestead-prov', 'state': {'running': {'startedAt': '2020-07-08T09:23:00Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-homestead-prov:latest', 'imageID': 'docker.io/ollivier/clearwater-homestead-prov@sha256:141a336f17eaf068dbe8da4b01a832033aed5c09e7fa6349ec091ee30b76c9b1', 'containerID': 'containerd://b4909c0ab2e18be75c7917c24211942a30c0625363e51d62a58a45d7ce9e6c3c', 'started': True}], 'qosClass': 'BestEffort'}}} 2020-07-08 09:23:08,368 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 23, 8, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': [{'api_version': 'v1', 'fields': None, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': datetime.datetime(2020, 7, 8, 9, 23, 8, tzinfo=tzlocal())}], 'name': 'live-test', 'namespace': 'default', 'owner_references': None, 'resource_version': '1119885', 'self_link': '/api/v1/namespaces/default/pods/live-test', 'uid': '30698de4-0c40-421b-97eb-99be84789ee9'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-dclt7', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'preemption_policy': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Never', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-dclt7', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-dclt7'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': None, 'container_statuses': None, 'host_ip': None, 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Pending', 'pod_ip': None, 'qos_class': 'BestEffort', 'reason': None, 'start_time': None}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test', 'uid': '30698de4-0c40-421b-97eb-99be84789ee9', 'resourceVersion': '1119885', 'creationTimestamp': '2020-07-08T09:23:08Z', 'managedFields': [{'manager': 'OpenAPI-Generator', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2020-07-08T09:23:08Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:spec': {'f:containers': {'k:{"name":"live-test"}': {'.': {}, 'f:image': {}, 'f:imagePullPolicy': {}, 'f:name': {}, 'f:resources': {}, 'f:terminationMessagePath': {}, 'f:terminationMessagePolicy': {}}}, 'f:dnsPolicy': {}, 'f:enableServiceLinks': {}, 'f:restartPolicy': {}, 'f:schedulerName': {}, 'f:securityContext': {}, 'f:terminationGracePeriodSeconds': {}}}}]}, 'spec': {'volumes': [{'name': 'default-token-dclt7', 'secret': {'secretName': 'default-token-dclt7', 'defaultMode': 420}}], 'containers': [{'name': 'live-test', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-dclt7', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Never', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Pending', 'qosClass': 'BestEffort'}}} 2020-07-08 09:23:08,379 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'ralf-5d845cff75-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '5d845cff75', 'service': 'ralf', 'snmp': 'enabled'}, 'managed_fields': None, 'name': 'ralf-5d845cff75-pk4nk', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'ralf-5d845cff75', 'uid': '618e77e4-dd8a-4f3f-9d17-2a2c91254a5d'}], 'resource_version': '1119774', 'self_link': '/api/v1/namespaces/default/pods/ralf-5d845cff75-pk4nk', 'uid': 'd582382e-f505-4a81-8037-cd8091a92f67'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-ralf:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'name': 'ralf', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 10888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-dclt7', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-dclt7', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup sprout; do echo ' 'waiting for sprout to start ...; ' 'sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-dclt7', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'kali-worker', 'node_selector': None, 'preemption_policy': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'ralflogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}, {'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-dclt7', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-dclt7'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 22, 20, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 22, 40, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 22, 40, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://22edecc886f5f9eb0fa687db77caffd12a12d9f694652cbe87d3a52aedf528e4', 'image': 'docker.io/ollivier/clearwater-ralf:latest', 'image_id': 'docker.io/ollivier/clearwater-ralf@sha256:20069a8d9f366dd0f003afa7c4fbcbcd5e9d2b99abae83540c6538fc7cff6b97', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'ralf', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 8, 9, 22, 27, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}, {'container_id': 'containerd://13179daf8ade6f945cd413d7a065f3d80288d3c8b5b12f1e46d3960c76bc5021', 'image': 'docker.io/library/busybox:latest', 'image_id': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'tailer', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 8, 9, 22, 36, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.17.0.11', 'init_container_statuses': [{'container_id': 'containerd://c1dad59ae2e4776eb4be0132108266ae48bd8d97fbc9479aa1aebd6e1108dcad', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-sprout', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://c1dad59ae2e4776eb4be0132108266ae48bd8d97fbc9479aa1aebd6e1108dcad', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 8, 9, 22, 18, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 8, 9, 19, 48, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.157', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 8, 9, 19, 35, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'ralf-5d845cff75-pk4nk', 'generateName': 'ralf-5d845cff75-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/ralf-5d845cff75-pk4nk', 'uid': 'd582382e-f505-4a81-8037-cd8091a92f67', 'resourceVersion': '1119774', 'creationTimestamp': '2020-07-08T09:19:35Z', 'labels': {'pod-template-hash': '5d845cff75', 'service': 'ralf', 'snmp': 'enabled'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'ralf-5d845cff75', 'uid': '618e77e4-dd8a-4f3f-9d17-2a2c91254a5d', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'ralflogs', 'emptyDir': {}}, {'name': 'default-token-dclt7', 'secret': {'secretName': 'default-token-dclt7', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-dclt7', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'ralf', 'image': 'ollivier/clearwater-ralf:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 10888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}, {'name': 'default-token-dclt7', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'tcpSocket': {'port': 10888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 10888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}, {'name': 'default-token-dclt7', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'kali-worker', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:22:20Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:22:40Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:22:40Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:19:35Z'}], 'hostIP': '172.17.0.11', 'podIP': '10.244.1.157', 'podIPs': [{'ip': '10.244.1.157'}], 'startTime': '2020-07-08T09:19:35Z', 'initContainerStatuses': [{'name': 'wait-on-sprout', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-08T09:19:48Z', 'finishedAt': '2020-07-08T09:22:18Z', 'containerID': 'containerd://c1dad59ae2e4776eb4be0132108266ae48bd8d97fbc9479aa1aebd6e1108dcad'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://c1dad59ae2e4776eb4be0132108266ae48bd8d97fbc9479aa1aebd6e1108dcad'}], 'containerStatuses': [{'name': 'ralf', 'state': {'running': {'startedAt': '2020-07-08T09:22:27Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-ralf:latest', 'imageID': 'docker.io/ollivier/clearwater-ralf@sha256:20069a8d9f366dd0f003afa7c4fbcbcd5e9d2b99abae83540c6538fc7cff6b97', 'containerID': 'containerd://22edecc886f5f9eb0fa687db77caffd12a12d9f694652cbe87d3a52aedf528e4', 'started': True}, {'name': 'tailer', 'state': {'running': {'startedAt': '2020-07-08T09:22:36Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:latest', 'imageID': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'containerID': 'containerd://13179daf8ade6f945cd413d7a065f3d80288d3c8b5b12f1e46d3960c76bc5021', 'started': True}], 'qosClass': 'BestEffort'}}} 2020-07-08 09:23:08,404 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 23, 8, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': [{'api_version': 'v1', 'fields': None, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': datetime.datetime(2020, 7, 8, 9, 23, 8, tzinfo=tzlocal())}], 'name': 'live-test', 'namespace': 'default', 'owner_references': None, 'resource_version': '1119886', 'self_link': '/api/v1/namespaces/default/pods/live-test', 'uid': '30698de4-0c40-421b-97eb-99be84789ee9'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-dclt7', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'kali-worker2', 'node_selector': None, 'preemption_policy': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Never', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-dclt7', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-dclt7'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 23, 8, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': None, 'host_ip': None, 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Pending', 'pod_ip': None, 'qos_class': 'BestEffort', 'reason': None, 'start_time': None}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test', 'uid': '30698de4-0c40-421b-97eb-99be84789ee9', 'resourceVersion': '1119886', 'creationTimestamp': '2020-07-08T09:23:08Z', 'managedFields': [{'manager': 'OpenAPI-Generator', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2020-07-08T09:23:08Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:spec': {'f:containers': {'k:{"name":"live-test"}': {'.': {}, 'f:image': {}, 'f:imagePullPolicy': {}, 'f:name': {}, 'f:resources': {}, 'f:terminationMessagePath': {}, 'f:terminationMessagePolicy': {}}}, 'f:dnsPolicy': {}, 'f:enableServiceLinks': {}, 'f:restartPolicy': {}, 'f:schedulerName': {}, 'f:securityContext': {}, 'f:terminationGracePeriodSeconds': {}}}}]}, 'spec': {'volumes': [{'name': 'default-token-dclt7', 'secret': {'secretName': 'default-token-dclt7', 'defaultMode': 420}}], 'containers': [{'name': 'live-test', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-dclt7', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Never', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'kali-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Pending', 'conditions': [{'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:23:08Z'}], 'qosClass': 'BestEffort'}}} 2020-07-08 09:23:08,415 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 23, 8, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': [{'api_version': 'v1', 'fields': None, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': datetime.datetime(2020, 7, 8, 9, 23, 8, tzinfo=tzlocal())}, {'api_version': 'v1', 'fields': None, 'manager': 'kubelet', 'operation': 'Update', 'time': datetime.datetime(2020, 7, 8, 9, 23, 8, tzinfo=tzlocal())}], 'name': 'live-test', 'namespace': 'default', 'owner_references': None, 'resource_version': '1119889', 'self_link': '/api/v1/namespaces/default/pods/live-test', 'uid': '30698de4-0c40-421b-97eb-99be84789ee9'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-dclt7', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'kali-worker2', 'node_selector': None, 'preemption_policy': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Never', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-dclt7', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-dclt7'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 23, 8, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 23, 8, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 23, 8, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 23, 8, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_id': '', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'live-test', 'ready': False, 'restart_count': 0, 'state': {'running': None, 'terminated': None, 'waiting': {'message': None, 'reason': 'ContainerCreating'}}}], 'host_ip': '172.17.0.12', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Pending', 'pod_ip': None, 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 8, 9, 23, 8, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test', 'uid': '30698de4-0c40-421b-97eb-99be84789ee9', 'resourceVersion': '1119889', 'creationTimestamp': '2020-07-08T09:23:08Z', 'managedFields': [{'manager': 'OpenAPI-Generator', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2020-07-08T09:23:08Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:spec': {'f:containers': {'k:{"name":"live-test"}': {'.': {}, 'f:image': {}, 'f:imagePullPolicy': {}, 'f:name': {}, 'f:resources': {}, 'f:terminationMessagePath': {}, 'f:terminationMessagePolicy': {}}}, 'f:dnsPolicy': {}, 'f:enableServiceLinks': {}, 'f:restartPolicy': {}, 'f:schedulerName': {}, 'f:securityContext': {}, 'f:terminationGracePeriodSeconds': {}}}}, {'manager': 'kubelet', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2020-07-08T09:23:08Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:status': {'f:conditions': {'k:{"type":"ContainersReady"}': {'.': {}, 'f:lastProbeTime': {}, 'f:lastTransitionTime': {}, 'f:message': {}, 'f:reason': {}, 'f:status': {}, 'f:type': {}}, 'k:{"type":"Initialized"}': {'.': {}, 'f:lastProbeTime': {}, 'f:lastTransitionTime': {}, 'f:status': {}, 'f:type': {}}, 'k:{"type":"Ready"}': {'.': {}, 'f:lastProbeTime': {}, 'f:lastTransitionTime': {}, 'f:message': {}, 'f:reason': {}, 'f:status': {}, 'f:type': {}}}, 'f:containerStatuses': {}, 'f:hostIP': {}, 'f:startTime': {}}}}]}, 'spec': {'volumes': [{'name': 'default-token-dclt7', 'secret': {'secretName': 'default-token-dclt7', 'defaultMode': 420}}], 'containers': [{'name': 'live-test', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-dclt7', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Never', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'kali-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Pending', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:23:08Z'}, {'type': 'Ready', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:23:08Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test]'}, {'type': 'ContainersReady', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:23:08Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test]'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:23:08Z'}], 'hostIP': '172.17.0.12', 'startTime': '2020-07-08T09:23:08Z', 'containerStatuses': [{'name': 'live-test', 'state': {'waiting': {'reason': 'ContainerCreating'}}, 'lastState': {}, 'ready': False, 'restartCount': 0, 'image': 'ollivier/clearwater-live-test:latest', 'imageID': '', 'started': False}], 'qosClass': 'BestEffort'}}} 2020-07-08 09:23:14,454 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 23, 8, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': [{'api_version': 'v1', 'fields': None, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': datetime.datetime(2020, 7, 8, 9, 23, 8, tzinfo=tzlocal())}, {'api_version': 'v1', 'fields': None, 'manager': 'kubelet', 'operation': 'Update', 'time': datetime.datetime(2020, 7, 8, 9, 23, 14, tzinfo=tzlocal())}], 'name': 'live-test', 'namespace': 'default', 'owner_references': None, 'resource_version': '1119910', 'self_link': '/api/v1/namespaces/default/pods/live-test', 'uid': '30698de4-0c40-421b-97eb-99be84789ee9'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-dclt7', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'kali-worker2', 'node_selector': None, 'preemption_policy': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Never', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-dclt7', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-dclt7'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 23, 8, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 23, 14, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 23, 14, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 23, 8, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://f6e37183c951eb5a8c0ed26fe8c9515b57241beb41b7e3c32da7a94f829d6138', 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'image_id': 'docker.io/ollivier/clearwater-live-test@sha256:c2efaddff058c146b93517d06a3a8066b6e88fecdd98fa6847cb69db22555f04', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'live-test', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 8, 9, 23, 13, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.17.0.12', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.72', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 8, 9, 23, 8, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test', 'uid': '30698de4-0c40-421b-97eb-99be84789ee9', 'resourceVersion': '1119910', 'creationTimestamp': '2020-07-08T09:23:08Z', 'managedFields': [{'manager': 'OpenAPI-Generator', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2020-07-08T09:23:08Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:spec': {'f:containers': {'k:{"name":"live-test"}': {'.': {}, 'f:image': {}, 'f:imagePullPolicy': {}, 'f:name': {}, 'f:resources': {}, 'f:terminationMessagePath': {}, 'f:terminationMessagePolicy': {}}}, 'f:dnsPolicy': {}, 'f:enableServiceLinks': {}, 'f:restartPolicy': {}, 'f:schedulerName': {}, 'f:securityContext': {}, 'f:terminationGracePeriodSeconds': {}}}}, {'manager': 'kubelet', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2020-07-08T09:23:14Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:status': {'f:conditions': {'k:{"type":"ContainersReady"}': {'.': {}, 'f:lastProbeTime': {}, 'f:lastTransitionTime': {}, 'f:status': {}, 'f:type': {}}, 'k:{"type":"Initialized"}': {'.': {}, 'f:lastProbeTime': {}, 'f:lastTransitionTime': {}, 'f:status': {}, 'f:type': {}}, 'k:{"type":"Ready"}': {'.': {}, 'f:lastProbeTime': {}, 'f:lastTransitionTime': {}, 'f:status': {}, 'f:type': {}}}, 'f:containerStatuses': {}, 'f:hostIP': {}, 'f:phase': {}, 'f:podIP': {}, 'f:podIPs': {'.': {}, 'k:{"ip":"10.244.2.72"}': {'.': {}, 'f:ip': {}}}, 'f:startTime': {}}}}]}, 'spec': {'volumes': [{'name': 'default-token-dclt7', 'secret': {'secretName': 'default-token-dclt7', 'defaultMode': 420}}], 'containers': [{'name': 'live-test', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-dclt7', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Never', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'kali-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:23:08Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:23:14Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:23:14Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:23:08Z'}], 'hostIP': '172.17.0.12', 'podIP': '10.244.2.72', 'podIPs': [{'ip': '10.244.2.72'}], 'startTime': '2020-07-08T09:23:08Z', 'containerStatuses': [{'name': 'live-test', 'state': {'running': {'startedAt': '2020-07-08T09:23:13Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'imageID': 'docker.io/ollivier/clearwater-live-test@sha256:c2efaddff058c146b93517d06a3a8066b6e88fecdd98fa6847cb69db22555f04', 'containerID': 'containerd://f6e37183c951eb5a8c0ed26fe8c9515b57241beb41b7e3c32da7a94f829d6138', 'started': True}], 'qosClass': 'BestEffort'}}} 2020-07-08 09:26:07,855 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 8, 9, 23, 8, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': [{'api_version': 'v1', 'fields': None, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': datetime.datetime(2020, 7, 8, 9, 23, 8, tzinfo=tzlocal())}, {'api_version': 'v1', 'fields': None, 'manager': 'kubelet', 'operation': 'Update', 'time': datetime.datetime(2020, 7, 8, 9, 26, 7, tzinfo=tzlocal())}], 'name': 'live-test', 'namespace': 'default', 'owner_references': None, 'resource_version': '1120393', 'self_link': '/api/v1/namespaces/default/pods/live-test', 'uid': '30698de4-0c40-421b-97eb-99be84789ee9'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-dclt7', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'kali-worker2', 'node_selector': None, 'preemption_policy': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Never', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-dclt7', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-dclt7'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 23, 8, tzinfo=tzlocal()), 'message': None, 'reason': 'PodCompleted', 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 26, 7, tzinfo=tzlocal()), 'message': None, 'reason': 'PodCompleted', 'status': 'False', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 26, 7, tzinfo=tzlocal()), 'message': None, 'reason': 'PodCompleted', 'status': 'False', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 8, 9, 23, 8, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://f6e37183c951eb5a8c0ed26fe8c9515b57241beb41b7e3c32da7a94f829d6138', 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'image_id': 'docker.io/ollivier/clearwater-live-test@sha256:c2efaddff058c146b93517d06a3a8066b6e88fecdd98fa6847cb69db22555f04', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'live-test', 'ready': False, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://f6e37183c951eb5a8c0ed26fe8c9515b57241beb41b7e3c32da7a94f829d6138', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 8, 9, 26, 6, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 8, 9, 23, 13, tzinfo=tzlocal())}, 'waiting': None}}], 'host_ip': '172.17.0.12', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Succeeded', 'pod_ip': '10.244.2.72', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 8, 9, 23, 8, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test', 'uid': '30698de4-0c40-421b-97eb-99be84789ee9', 'resourceVersion': '1120393', 'creationTimestamp': '2020-07-08T09:23:08Z', 'managedFields': [{'manager': 'OpenAPI-Generator', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2020-07-08T09:23:08Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:spec': {'f:containers': {'k:{"name":"live-test"}': {'.': {}, 'f:image': {}, 'f:imagePullPolicy': {}, 'f:name': {}, 'f:resources': {}, 'f:terminationMessagePath': {}, 'f:terminationMessagePolicy': {}}}, 'f:dnsPolicy': {}, 'f:enableServiceLinks': {}, 'f:restartPolicy': {}, 'f:schedulerName': {}, 'f:securityContext': {}, 'f:terminationGracePeriodSeconds': {}}}}, {'manager': 'kubelet', 'operation': 'Update', 'apiVersion': 'v1', 'time': '2020-07-08T09:26:07Z', 'fieldsType': 'FieldsV1', 'fieldsV1': {'f:status': {'f:conditions': {'k:{"type":"ContainersReady"}': {'.': {}, 'f:lastProbeTime': {}, 'f:lastTransitionTime': {}, 'f:reason': {}, 'f:status': {}, 'f:type': {}}, 'k:{"type":"Initialized"}': {'.': {}, 'f:lastProbeTime': {}, 'f:lastTransitionTime': {}, 'f:reason': {}, 'f:status': {}, 'f:type': {}}, 'k:{"type":"Ready"}': {'.': {}, 'f:lastProbeTime': {}, 'f:lastTransitionTime': {}, 'f:reason': {}, 'f:status': {}, 'f:type': {}}}, 'f:containerStatuses': {}, 'f:hostIP': {}, 'f:phase': {}, 'f:podIP': {}, 'f:podIPs': {'.': {}, 'k:{"ip":"10.244.2.72"}': {'.': {}, 'f:ip': {}}}, 'f:startTime': {}}}}]}, 'spec': {'volumes': [{'name': 'default-token-dclt7', 'secret': {'secretName': 'default-token-dclt7', 'defaultMode': 420}}], 'containers': [{'name': 'live-test', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-dclt7', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Never', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'kali-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Succeeded', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:23:08Z', 'reason': 'PodCompleted'}, {'type': 'Ready', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:26:07Z', 'reason': 'PodCompleted'}, {'type': 'ContainersReady', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:26:07Z', 'reason': 'PodCompleted'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-08T09:23:08Z'}], 'hostIP': '172.17.0.12', 'podIP': '10.244.2.72', 'podIPs': [{'ip': '10.244.2.72'}], 'startTime': '2020-07-08T09:23:08Z', 'containerStatuses': [{'name': 'live-test', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-08T09:23:13Z', 'finishedAt': '2020-07-08T09:26:06Z', 'containerID': 'containerd://f6e37183c951eb5a8c0ed26fe8c9515b57241beb41b7e3c32da7a94f829d6138'}}, 'lastState': {}, 'ready': False, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'imageID': 'docker.io/ollivier/clearwater-live-test@sha256:c2efaddff058c146b93517d06a3a8066b6e88fecdd98fa6847cb69db22555f04', 'containerID': 'containerd://f6e37183c951eb5a8c0ed26fe8c9515b57241beb41b7e3c32da7a94f829d6138', 'started': False}], 'qosClass': 'BestEffort'}}} 2020-07-08 09:26:07,918 - functest_kubernetes.ims.ims - INFO - ** Invoke test (first_time) ** Execute test /usr/lib/ruby/gems/2.6.0/gems/httpi-2.4.0/lib/httpi/auth/ssl.rb:13: warning: constant OpenSSL::SSL::SSLContext::METHODS is deprecated # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' Basic Call - Mainline (TCP) - (6505550026, 6505550439) Passed Basic Call - SDP (TCP) - (6505550205, 6505550130) Passed Basic Call - Tel URIs (TCP) - (6505550851, 6505550319) Passed Basic Call - Unknown number (TCP) - (6505550188, 6505550125) Passed Basic Call - Rejected by remote endpoint (TCP) - (6505550669, 6505550627) Passed Basic Call - Messages - Pager model (TCP) - (6505550421, 6505550527) Passed Basic Call - Pracks (TCP) - (6505550728, 6505550247) Passed Basic Registration (TCP) - (6505550677) Passed Emergency Registration (TCP) - Skipped (Not running with emergency registrations) - Call with EMERGENCY_REG=Y to run test Multiple Identities (TCP) - (6505550725, 6505550670) Passed Call Barring - Outbound Rejection (TCP) - (6505550314, 6505550627) Passed Call Barring - Allow non-international call (TCP) - Skipped (No PSTN support) - Call with PSTN=true to run test Call Barring - Reject international call (TCP) - Skipped (No PSTN support) - Call with PSTN=true to run test Call Barring - Inbound Rejection (TCP) - (6505550018, 6505550868) Passed Call Diversion AS - Unconditional (TCP) - Skipped (No Call Diversion AS hostname provided) - Call with CDIV_AS= Call Diversion AS - Busy (TCP) - Skipped (No Call Diversion AS hostname provided) - Call with CDIV_AS= Call Diversion AS - No answer (TCP) - Skipped (No Call Diversion AS hostname provided) - Call with CDIV_AS= Call Diversion - Not registered (TCP) - (6505550854, 6505550627, 6505550070) Passed Call Diversion - Not reachable (not registered) (TCP) - (6505550501, 6505550947, 6505550781) Passed Call Diversion - Not reachable (408) (TCP) - (6505550452, 6505550855, 6505550109) Passed Call Diversion - Not reachable (503) (TCP) - (6505550275, 6505550755, 6505550206) Passed Call Diversion - Not reachable (500) (TCP) - (6505550604, 6505550375, 6505550464) Passed Call Diversion - Busy (TCP) - (6505550949, 6505550354, 6505550690) Passed Call Diversion - Unconditional (TCP) - (6505550899, 6505550808, 6505550409) Passed Call Diversion - No answer (TCP) - (6505550197, 6505550888, 6505550127) Passed Call Diversion - Bad target URI (TCP) - (6505550135, 6505550307) Passed Call Diversion - Audio-only call (TCP) - (6505550263, 6505550919, 6505550066, 6505550791) Passed Call Diversion - Audio-video call (TCP) - (6505550377, 6505550794, 6505550714, 6505550020) Passed Call Forking - Mainline (TCP) - (6505550025, 6505550445) Passed Call Forking - Endpoint offline (TCP) - (6505550998, 6505550948) Passed Call Forking - Endpoint offline while ringing (TCP) - (6505550246, 6505550391) Passed Call Waiting - Accepted (TCP) - (6505550973, 6505550507, 6505550030) Passed Call Waiting - Cancelled (TCP) - (6505550073, 6505550897, 6505550547) Passed CANCEL - Mainline (TCP) - (6505550818, 6505550948) Passed Filtering - Accept-Contact (TCP) - (6505550548, 6505550726) Passed Accept-Contact with response (SFR 511195) (TCP) - (6505550492, 6505550123) Passed Filtering - Accept-Contact no match (TCP) - (6505550315, 6505550074) Passed Filtering - Accept-Contact negated match (TCP) - (6505550363, 6505550067) Passed Filtering - RFC3841 example (TCP) - (6505550710, 6505550391) Passed Filtering - Reject-Contact no match (TCP) - (6505550639, 6505550381) Passed Filtering - Reject-Contact match (TCP) - (6505550648, 6505550596) Passed Gemini - INVITE - VoIP device answers (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Mobile device answers (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - VoIP device rejects (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Mobile device rejects (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Mobile device rejects with a 480 (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Both reject, choose mobile response (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Both reject, choose VoIP response (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Successful call with GR (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Failed call with GR (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Successful call with Accept-Contact (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Failed call with Accept-Contact (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - SUBSCRIBE - Mobile Notifies (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - SUBSCRIBE - Joint 408 (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= GRUU - REGISTER - two bindings with and without GRUU (TCP) - (6505550420) Passed GRUU - REGISTER - binding suggested GRUU (TCP) - (6505550619) Passed GRUU - REGISTER - instance ID requires escaping (TCP) - (6505550482) Passed GRUU - REGISTER - three bindings with GRUUs (TCP) - (6505550360) Passed GRUU - Call - first endpoint GRUU as target (TCP) - (6505550903, 6505550317) Passed GRUU - Call - second endpoint GRUU as target (TCP) - (6505550186, 6505550959) Passed GRUU - Call - only GRUU as target (TCP) - (6505550998, 6505550394) Passed GRUU - Call - AoR as target (TCP) - (6505550962, 6505550032) Passed GRUU - Call - unknown GRUU as target (TCP) - (6505550095, 6505550439) Passed GRUU - Call - unknown GRUU as target - no GRUUs assigned (TCP) - (6505550639, 6505550016) Passed GRUU - Call - Reject-Contact interop (TCP) - (6505550255, 6505550077) Passed GRUU - Call - Accept-Contact interop (TCP) - (6505550422, 6505550367) Passed GRUU - Call - AoR with other param as target (TCP) - (6505550634, 6505550783) Passed GRUU - Call - GRUU with other param as target (TCP) - (6505550948, 6505550062) Passed ISC Interface - Terminating (TCP) - Skipped (No hostname given) - Call with HOST_NAME= ISC Interface - Terminating (UDP AS) (TCP) - Skipped (No hostname given) - Call with HOST_NAME= ISC Interface - Terminating Failed (TCP) - Skipped (No hostname given) - Call with HOST_NAME= ISC Interface - Third-party Registration (TCP) - Skipped (No hostname given) - Call with HOST_NAME= ISC Interface - Third-party Registration - implicit registration (TCP) - Skipped (No hostname given) - Call with HOST_NAME= ISC Interface - Redirect (TCP) - Skipped (No hostname given) - Call with HOST_NAME= ISC Interface - B2BUA (TCP) - Skipped (No hostname given) - Call with HOST_NAME= Live Call - Dial out to a real number (TCP) - Skipped (No live number given) - Call with LIVENUMBER= Memento - Incorrect Password (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Wrong Call List (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Basic Call (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Unknown Number (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Rejected Call (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Cancelled Call (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Privacy Call (TCP) - Skipped (No memento hostnames provided) /usr/lib/ruby/gems/2.6.0/gems/nokogiri-1.6.6.2/lib/nokogiri/xml/document.rb:44: warning: constant ::Fixnum is deprecated # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Barred Call (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Busy Call Forwarding (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Nonce-Count - Mainline (TCP) - Skipped (No nonce-count support) - Call with NONCE_COUNT=Y to run test Nonce-Count - Reject Re-Use (TCP) - Skipped (No nonce-count support) - Call with NONCE_COUNT=Y to run test Off-net calls - tel: URI (TCP) - Skipped (No off-net number given) - Call with OFF_NET_TEL= Off-net calls - sip: URI (TCP) - Skipped (No off-net number given) - Call with OFF_NET_TEL= SUBSCRIBE - reg-event (TCP) - (6505550850) Passed SUBSCRIBE - reg-event with a GRUU (TCP) - (6505550462) Passed SUBSCRIBE - Subscription timeout (TCP) - (6505550562) Passed SUBSCRIBE - Registration timeout (TCP) - Skipped (Not running with short registrations) - Call with SHORT_REG=Y to run test Multiple SUBSCRIBErs to one UE's reg-event (TCP) - (6505550848, 6505550924) Passed Message - URN URIs (TCP) - Skipped (No hostname given) - Call with HOST_NAME= Message - URN URIs to AS (TCP) - Skipped (No hostname given) - Call with HOST_NAME= 0 failures out of 96 tests run 43 tests skipped 2020-07-08 09:26:07,920 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | k8s_vims | functest | 06:33 | PASS | +-------------------+------------------+------------------+----------------+ 2020-07-08 09:26:07,928 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_config_map: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'configmaps', 'name': 'env-vars', 'retry_after_seconds': None, 'uid': 'f8423acd-ba66-4dca-95d4-d5beccf54ac2'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'remaining_item_count': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-08 09:26:07,961 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_pod: {'api_version': 'v1', 'code': None, 'details': None, 'kind': 'Pod', 'message': None, 'metadata': {'_continue': None, 'remaining_item_count': None, 'resource_version': '1120395', 'self_link': '/api/v1/namespaces/default/pods/live-test'}, 'reason': None, 'status': "{'phase': 'Succeeded', 'conditions': [{'type': 'Initialized', " "'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': " "'2020-07-08T09:23:08Z', 'reason': 'PodCompleted'}, {'type': " "'Ready', 'status': 'False', 'lastProbeTime': None, " "'lastTransitionTime': '2020-07-08T09:26:07Z', 'reason': " "'PodCompleted'}, {'type': 'ContainersReady', 'status': 'False', " "'lastProbeTime': None, 'lastTransitionTime': " "'2020-07-08T09:26:07Z', 'reason': 'PodCompleted'}, {'type': " "'PodScheduled', 'status': 'True', 'lastProbeTime': None, " "'lastTransitionTime': '2020-07-08T09:23:08Z'}], 'hostIP': " "'172.17.0.12', 'podIP': '10.244.2.72', 'podIPs': [{'ip': " "'10.244.2.72'}], 'startTime': '2020-07-08T09:23:08Z', " "'containerStatuses': [{'name': 'live-test', 'state': " "{'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': " "'2020-07-08T09:23:13Z', 'finishedAt': '2020-07-08T09:26:06Z', " "'containerID': " "'containerd://f6e37183c951eb5a8c0ed26fe8c9515b57241beb41b7e3c32da7a94f829d6138'}}, " "'lastState': {}, 'ready': False, 'restartCount': 0, 'image': " "'docker.io/ollivier/clearwater-live-test:latest', 'imageID': " "'docker.io/ollivier/clearwater-live-test@sha256:c2efaddff058c146b93517d06a3a8066b6e88fecdd98fa6847cb69db22555f04', " "'containerID': " "'containerd://f6e37183c951eb5a8c0ed26fe8c9515b57241beb41b7e3c32da7a94f829d6138', " "'started': False}], 'qosClass': 'BestEffort'}"} 2020-07-08 09:26:07,980 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'astaire', 'retry_after_seconds': None, 'uid': '68995dc6-e4d2-45b2-877e-2da5b83dc39a'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'remaining_item_count': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-08 09:26:08,005 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'astaire', 'retry_after_seconds': None, 'uid': '8cee681b-34a6-457c-aecb-a6d2be0fa59c'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'remaining_item_count': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-08 09:26:08,319 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'bono', 'retry_after_seconds': None, 'uid': 'a751ae0c-4e93-45a3-8f61-e936eeed743d'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'remaining_item_count': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-08 09:26:08,455 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'bono', 'retry_after_seconds': None, 'uid': '48a49f5b-a2b1-42c7-89fe-5e5b21c7a109'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'remaining_item_count': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-08 09:26:08,533 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'cassandra', 'retry_after_seconds': None, 'uid': '8f5f8720-db5f-48bb-8c57-6e903c983396'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'remaining_item_count': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-08 09:26:08,640 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'cassandra', 'retry_after_seconds': None, 'uid': 'ab0f4901-7a1c-4790-8b30-6efe3c322c6c'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'remaining_item_count': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-08 09:26:08,671 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'chronos', 'retry_after_seconds': None, 'uid': '8f3898f8-5e27-429e-adc1-c917f18e0bce'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'remaining_item_count': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-08 09:26:08,752 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'chronos', 'retry_after_seconds': None, 'uid': '88b7b0a7-652f-4a29-a0f8-9bcd8e24cf1d'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'remaining_item_count': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-08 09:26:08,805 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'ellis', 'retry_after_seconds': None, 'uid': 'cab81990-1908-4a3b-9c66-11e61e015dd1'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'remaining_item_count': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-08 09:26:08,862 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'ellis', 'retry_after_seconds': None, 'uid': '43f471ba-d390-4348-8bb0-2fefdf63be4b'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'remaining_item_count': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-08 09:26:08,922 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'etcd', 'retry_after_seconds': None, 'uid': '853d1398-c468-48d4-a0f6-47592d5d9b24'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'remaining_item_count': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-08 09:26:09,146 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'etcd', 'retry_after_seconds': None, 'uid': 'a2505a9a-6b77-4ade-a4cc-803e0275ef9a'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'remaining_item_count': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-08 09:26:09,359 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'homer', 'retry_after_seconds': None, 'uid': '12b09fa3-f659-4785-92cf-bd776560faf9'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'remaining_item_count': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-08 09:26:10,013 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'homer', 'retry_after_seconds': None, 'uid': '2d531c87-4599-47c4-8ccb-b44d0a63c080'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'remaining_item_count': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-08 09:26:10,279 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'homestead', 'retry_after_seconds': None, 'uid': '2990f5b7-ff0c-493d-81e1-d2b266aa1435'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'remaining_item_count': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-08 09:26:10,826 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'homestead', 'retry_after_seconds': None, 'uid': '1467f422-56ce-4fd4-b3fe-f30dace3ba41'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'remaining_item_count': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-08 09:26:10,981 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'homestead-prov', 'retry_after_seconds': None, 'uid': '3724a68c-af0c-49cb-ba4b-4d6458de1e73'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'remaining_item_count': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-08 09:26:11,075 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'homestead-prov', 'retry_after_seconds': None, 'uid': '97a322c8-0cbc-4dc3-9f39-c71c6b40fbde'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'remaining_item_count': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-08 09:26:11,154 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'ralf', 'retry_after_seconds': None, 'uid': '46af59da-36f6-459d-bbfa-eb62d2690b5d'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'remaining_item_count': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-08 09:26:11,521 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'ralf', 'retry_after_seconds': None, 'uid': '91a1e654-5e2b-4563-b1fa-f1e2eb9c6820'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'remaining_item_count': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-08 09:26:11,567 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'sprout', 'retry_after_seconds': None, 'uid': '8b2db2f4-6475-4bd9-9f22-9afbc5239ee6'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'remaining_item_count': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-08 09:26:11,616 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'sprout', 'retry_after_seconds': None, 'uid': 'ba89cd22-b671-44b7-b0f1-18fee63d9ebb'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'remaining_item_count': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-08 09:26:11,966 - xtesting.core.testcase - DEBUG - Publishing /var/lib/xtesting/results/functest-kubernetes.log ('text/plain', None)