2020-07-15 14:33:38,928 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | k8-nosdn-nofeature-noha | | INSTALLER_TYPE | unknown | | BUILD_TAG | 21BBXURL17P1 | | NODE_NAME | lf-virtual1-2 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/functest-kubernetes/21BBXURL17P1/functest-kubernetes-opnfv-functest-kubernetes-cnf-iruya-k8s_vims-run-19 | | HTTP_DST_URL | http://artifacts.opnfv.org/functest-kubernetes/21BBXURL17P1/functest-kubernetes-opnfv-functest-kubernetes-cnf-iruya-k8s_vims-run-19 | +-------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+ 2020-07-15 14:33:38,933 - xtesting.ci.run_tests - DEBUG - No env file /var/lib/xtesting/conf/env_file found 2020-07-15 14:33:38,933 - xtesting.ci.run_tests - DEBUG - Test args: k8s_vims 2020-07-15 14:33:38,938 - xtesting.ci.run_tests - INFO - Loading test case 'k8s_vims'... 2020-07-15 14:33:39,202 - xtesting.ci.run_tests - INFO - Running test case 'k8s_vims'... 2020-07-15 14:33:39,224 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_config_map: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041428', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'fffbe536-a9e4-4fc1-a876-21bc0598b036'}} 2020-07-15 14:33:39,263 - functest_kubernetes.ims.ims - INFO - Deployment astaire created 2020-07-15 14:33:39,263 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041428', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'fffbe536-a9e4-4fc1-a876-21bc0598b036'}} 2020-07-15 14:33:39,353 - functest_kubernetes.ims.ims - INFO - Deployment bono created 2020-07-15 14:33:39,353 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041428', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'fffbe536-a9e4-4fc1-a876-21bc0598b036'}} 2020-07-15 14:33:39,437 - functest_kubernetes.ims.ims - INFO - Deployment cassandra created 2020-07-15 14:33:39,437 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041428', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'fffbe536-a9e4-4fc1-a876-21bc0598b036'}} 2020-07-15 14:33:39,503 - functest_kubernetes.ims.ims - INFO - Deployment chronos created 2020-07-15 14:33:39,503 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041428', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'fffbe536-a9e4-4fc1-a876-21bc0598b036'}} 2020-07-15 14:33:39,557 - functest_kubernetes.ims.ims - INFO - Deployment ellis created 2020-07-15 14:33:39,557 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041428', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'fffbe536-a9e4-4fc1-a876-21bc0598b036'}} 2020-07-15 14:33:39,587 - functest_kubernetes.ims.ims - INFO - Deployment etcd created 2020-07-15 14:33:39,587 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041428', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'fffbe536-a9e4-4fc1-a876-21bc0598b036'}} 2020-07-15 14:33:39,648 - functest_kubernetes.ims.ims - INFO - Deployment homer created 2020-07-15 14:33:39,648 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041428', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'fffbe536-a9e4-4fc1-a876-21bc0598b036'}} 2020-07-15 14:33:39,700 - functest_kubernetes.ims.ims - INFO - Deployment homestead created 2020-07-15 14:33:39,700 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041428', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'fffbe536-a9e4-4fc1-a876-21bc0598b036'}} 2020-07-15 14:33:39,777 - functest_kubernetes.ims.ims - INFO - Deployment homestead-prov created 2020-07-15 14:33:39,796 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041428', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'fffbe536-a9e4-4fc1-a876-21bc0598b036'}} 2020-07-15 14:33:39,840 - functest_kubernetes.ims.ims - INFO - Deployment ralf created 2020-07-15 14:33:39,840 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041428', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'fffbe536-a9e4-4fc1-a876-21bc0598b036'}} 2020-07-15 14:33:39,938 - functest_kubernetes.ims.ims - INFO - Deployment sprout created 2020-07-15 14:33:39,938 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041428', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'fffbe536-a9e4-4fc1-a876-21bc0598b036'}} 2020-07-15 14:33:40,087 - functest_kubernetes.ims.ims - INFO - Service astaire created 2020-07-15 14:33:40,087 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041428', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'fffbe536-a9e4-4fc1-a876-21bc0598b036'}} 2020-07-15 14:33:40,139 - functest_kubernetes.ims.ims - INFO - Service bono created 2020-07-15 14:33:40,140 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041428', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'fffbe536-a9e4-4fc1-a876-21bc0598b036'}} 2020-07-15 14:33:40,159 - functest_kubernetes.ims.ims - INFO - Service cassandra created 2020-07-15 14:33:40,159 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041428', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'fffbe536-a9e4-4fc1-a876-21bc0598b036'}} 2020-07-15 14:33:40,205 - functest_kubernetes.ims.ims - INFO - Service chronos created 2020-07-15 14:33:40,206 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041428', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'fffbe536-a9e4-4fc1-a876-21bc0598b036'}} 2020-07-15 14:33:40,224 - functest_kubernetes.ims.ims - INFO - Service ellis created 2020-07-15 14:33:40,224 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041428', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'fffbe536-a9e4-4fc1-a876-21bc0598b036'}} 2020-07-15 14:33:40,255 - functest_kubernetes.ims.ims - INFO - Service etcd created 2020-07-15 14:33:40,255 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041428', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'fffbe536-a9e4-4fc1-a876-21bc0598b036'}} 2020-07-15 14:33:40,284 - functest_kubernetes.ims.ims - INFO - Service homer created 2020-07-15 14:33:40,285 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041428', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'fffbe536-a9e4-4fc1-a876-21bc0598b036'}} 2020-07-15 14:33:40,342 - functest_kubernetes.ims.ims - INFO - Service homestead created 2020-07-15 14:33:40,343 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041428', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'fffbe536-a9e4-4fc1-a876-21bc0598b036'}} 2020-07-15 14:33:40,380 - functest_kubernetes.ims.ims - INFO - Service homestead-prov created 2020-07-15 14:33:40,380 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041428', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'fffbe536-a9e4-4fc1-a876-21bc0598b036'}} 2020-07-15 14:33:40,403 - functest_kubernetes.ims.ims - INFO - Service ralf created 2020-07-15 14:33:40,403 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041428', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'fffbe536-a9e4-4fc1-a876-21bc0598b036'}} 2020-07-15 14:33:40,425 - functest_kubernetes.ims.ims - INFO - Service sprout created 2020-07-15 14:33:40,425 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041428', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'fffbe536-a9e4-4fc1-a876-21bc0598b036'}} 2020-07-15 14:33:40,431 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 10, 58, 1, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test2'}, 'managed_fields': None, 'name': 'live-test2', 'namespace': 'default', 'owner_references': None, 'resource_version': '1040358', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test2', 'uid': 'c6c9caaa-5133-4416-b435-70577cb956d5'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test2'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test2'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test2', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 10, 58, 2, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 10, 58, 12, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test2-54d9dcd87" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 29, 10, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 29, 10, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test2', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test2', 'uid': 'c6c9caaa-5133-4416-b435-70577cb956d5', 'resourceVersion': '1040358', 'generation': 1, 'creationTimestamp': '2020-07-10T10:58:01Z', 'labels': {'run': 'live-test2'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test2'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test2'}}, 'spec': {'containers': [{'name': 'live-test2', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T10:58:12Z', 'lastTransitionTime': '2020-07-10T10:58:02Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test2-54d9dcd87" has successfully progressed.'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-15T14:29:10Z', 'lastTransitionTime': '2020-07-15T14:29:10Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-15 14:33:40,442 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'ellis', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041529', 'self_link': '/apis/apps/v1/namespaces/default/deployments/ellis', 'uid': '8b571c0e-9aed-474d-b36b-47189dd6b27a'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'ellis'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'ellis'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-ellis:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 80}, 'timeout_seconds': 1}, 'name': 'ellis', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 80, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 80}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'homestead-prov; ' 'do echo ' 'waiting for ' 'homestead-prov ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead-prov', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'sprout; do ' 'echo waiting ' 'for sprout ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'message': 'ReplicaSet "ellis-57b84b6dd7" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'ellis', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/ellis', 'uid': '8b571c0e-9aed-474d-b36b-47189dd6b27a', 'resourceVersion': '1041529', 'generation': 1, 'creationTimestamp': '2020-07-15T14:33:39Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'ellis'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'ellis'}}, 'spec': {'initContainers': [{'name': 'wait-on-homestead-prov', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead-prov; do echo waiting for homestead-prov to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'ellis', 'image': 'ollivier/clearwater-ellis:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 80, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'tcpSocket': {'port': 80}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 80}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-15T14:33:39Z', 'lastTransitionTime': '2020-07-15T14:33:39Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:33:39Z', 'lastTransitionTime': '2020-07-15T14:33:39Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "ellis-57b84b6dd7" is progressing.'}]}}} 2020-07-15 14:33:40,477 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homer', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041548', 'self_link': '/apis/apps/v1/namespaces/default/deployments/homer', 'uid': 'a50654d8-5759-4b14-b0c0-c96d44e244a0'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'homer'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'homer'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homer:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'name': 'homer', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'message': 'Created new replica set ' '"homer-74dd4556d9"', 'reason': 'NewReplicaSetCreated', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': None, 'unavailable_replicas': 1, 'updated_replicas': None}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homer', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/homer', 'uid': 'a50654d8-5759-4b14-b0c0-c96d44e244a0', 'resourceVersion': '1041548', 'generation': 1, 'creationTimestamp': '2020-07-15T14:33:39Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homer'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homer'}}, 'spec': {'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homer', 'image': 'ollivier/clearwater-homer:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'tcpSocket': {'port': 7888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 7888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:33:39Z', 'lastTransitionTime': '2020-07-15T14:33:39Z', 'reason': 'NewReplicaSetCreated', 'message': 'Created new replica set "homer-74dd4556d9"'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-15T14:33:39Z', 'lastTransitionTime': '2020-07-15T14:33:39Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-15 14:33:40,496 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homestead-prov', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041538', 'self_link': '/apis/apps/v1/namespaces/default/deployments/homestead-prov', 'uid': '8d5df381-c48e-4efc-9e9f-c79a0bf96cc5'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'homestead-prov'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'homestead-prov', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead-prov:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead-prov', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8889, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'homestead; ' 'do echo ' 'waiting for ' 'homestead to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'message': 'Created new replica set ' '"homestead-prov-756c8bff5d"', 'reason': 'NewReplicaSetCreated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': None, 'ready_replicas': None, 'replicas': None, 'unavailable_replicas': None, 'updated_replicas': None}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homestead-prov', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/homestead-prov', 'uid': '8d5df381-c48e-4efc-9e9f-c79a0bf96cc5', 'resourceVersion': '1041538', 'generation': 1, 'creationTimestamp': '2020-07-15T14:33:39Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homestead-prov'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homestead-prov', 'snmp': 'enabled'}}, 'spec': {'initContainers': [{'name': 'wait-on-homestead', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead-prov', 'image': 'ollivier/clearwater-homestead-prov:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8889, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:33:39Z', 'lastTransitionTime': '2020-07-15T14:33:39Z', 'reason': 'NewReplicaSetCreated', 'message': 'Created new replica set "homestead-prov-756c8bff5d"'}]}}} 2020-07-15 14:33:40,520 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'ralf', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041574', 'self_link': '/apis/apps/v1/namespaces/default/deployments/ralf', 'uid': '5d905c8e-6cfe-4b91-9eb2-cbef1b4ca843'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'ralf'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'ralf', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-ralf:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'name': 'ralf', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 10888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'ralflogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 40, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 33, 40, tzinfo=tzlocal()), 'message': 'Created new replica set ' '"ralf-57c4654cb8"', 'reason': 'NewReplicaSetCreated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': None, 'ready_replicas': None, 'replicas': None, 'unavailable_replicas': None, 'updated_replicas': None}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'ralf', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/ralf', 'uid': '5d905c8e-6cfe-4b91-9eb2-cbef1b4ca843', 'resourceVersion': '1041574', 'generation': 1, 'creationTimestamp': '2020-07-15T14:33:39Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'ralf'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'ralf', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'ralflogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'ralf', 'image': 'ollivier/clearwater-ralf:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 10888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}], 'livenessProbe': {'tcpSocket': {'port': 10888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 10888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:33:40Z', 'lastTransitionTime': '2020-07-15T14:33:40Z', 'reason': 'NewReplicaSetCreated', 'message': 'Created new replica set "ralf-57c4654cb8"'}]}}} 2020-07-15 14:33:40,546 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 10, 49, 36, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test1'}, 'managed_fields': None, 'name': 'live-test1', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041392', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test1', 'uid': '0fe55582-d17d-4d84-bef8-ad96e8e08b3a'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test1'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test1'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test1', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 10, 49, 37, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 10, 50, 2, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test1-677ffc8869" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 27, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 33, 27, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test1', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test1', 'uid': '0fe55582-d17d-4d84-bef8-ad96e8e08b3a', 'resourceVersion': '1041392', 'generation': 1, 'creationTimestamp': '2020-07-10T10:49:36Z', 'labels': {'run': 'live-test1'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test1'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test1'}}, 'spec': {'containers': [{'name': 'live-test1', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T10:50:02Z', 'lastTransitionTime': '2020-07-10T10:49:37Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test1-677ffc8869" has successfully progressed.'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-15T14:33:27Z', 'lastTransitionTime': '2020-07-15T14:33:27Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-15 14:33:40,557 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'bono', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041457', 'self_link': '/apis/apps/v1/namespaces/default/deployments/bono', 'uid': 'c7d6ebd8-a408-43db-b0b4-2c25424d8b1b'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'bono'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'bono', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-bono:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 ' '5060 ' '5062']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'bono', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 3478, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5060, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5062, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5060, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'UDP'}, {'container_port': 5062, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'UDP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 ' '5060 ' '5062']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/bono', 'mount_propagation': None, 'name': 'bonologs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/bono/bono_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/bono', 'mount_propagation': None, 'name': 'bonologs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'sprout; do ' 'echo waiting ' 'for sprout ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'bonologs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'message': 'ReplicaSet "bono-5cdb7bfcdd" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'bono', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/bono', 'uid': 'c7d6ebd8-a408-43db-b0b4-2c25424d8b1b', 'resourceVersion': '1041457', 'generation': 1, 'creationTimestamp': '2020-07-15T14:33:39Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'bono'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'bono', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'bonologs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'bono', 'image': 'ollivier/clearwater-bono:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 3478, 'protocol': 'TCP'}, {'containerPort': 5060, 'protocol': 'TCP'}, {'containerPort': 5062, 'protocol': 'TCP'}, {'containerPort': 5060, 'protocol': 'UDP'}, {'containerPort': 5062, 'protocol': 'UDP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'bonologs', 'mountPath': '/var/log/bono'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 5062']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 5062']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/bono/bono_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'bonologs', 'mountPath': '/var/log/bono'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-15T14:33:39Z', 'lastTransitionTime': '2020-07-15T14:33:39Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:33:39Z', 'lastTransitionTime': '2020-07-15T14:33:39Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "bono-5cdb7bfcdd" is progressing.'}]}}} 2020-07-15 14:33:40,583 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'cassandra', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041508', 'self_link': '/apis/apps/v1/namespaces/default/deployments/cassandra', 'uid': '58757469-bb46-4e13-b1b3-6975ce393a66'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'cassandra'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'cassandra'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-cassandra:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 ' '9042 ' '9160']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 600, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'cassandra', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7001, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 9042, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 9160, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 ' '9042 ' '9160']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'etcd; do ' 'echo waiting ' 'for etcd to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-etcd', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'message': 'ReplicaSet "cassandra-76f5c4d86c" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'cassandra', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/cassandra', 'uid': '58757469-bb46-4e13-b1b3-6975ce393a66', 'resourceVersion': '1041508', 'generation': 1, 'creationTimestamp': '2020-07-15T14:33:39Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'cassandra'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'cassandra'}}, 'spec': {'initContainers': [{'name': 'wait-on-etcd', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup etcd; do echo waiting for etcd to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'cassandra', 'image': 'ollivier/clearwater-cassandra:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7001, 'protocol': 'TCP'}, {'containerPort': 9042, 'protocol': 'TCP'}, {'containerPort': 9160, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 9160']}, 'initialDelaySeconds': 600, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 9160']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-15T14:33:39Z', 'lastTransitionTime': '2020-07-15T14:33:39Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:33:39Z', 'lastTransitionTime': '2020-07-15T14:33:39Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "cassandra-76f5c4d86c" is progressing.'}]}}} 2020-07-15 14:33:40,601 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'sprout', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041528', 'self_link': '/apis/apps/v1/namespaces/default/deployments/sprout', 'uid': '3baf95af-ef52-4f16-a57f-62f80bcd945a'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'sprout'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'sprout', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-sprout:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 3, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'sprout', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'ralf; do ' 'echo waiting ' 'for ralf to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-ralf', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'chronos; do ' 'echo waiting ' 'for chronos ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-chronos', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'homestead; ' 'do echo ' 'waiting for ' 'homestead to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'sproutlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': None, 'observed_generation': None, 'ready_replicas': None, 'replicas': None, 'unavailable_replicas': None, 'updated_replicas': None}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'sprout', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/sprout', 'uid': '3baf95af-ef52-4f16-a57f-62f80bcd945a', 'resourceVersion': '1041528', 'generation': 1, 'creationTimestamp': '2020-07-15T14:33:39Z'}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'sprout'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'sprout', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'sproutlogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-ralf', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup ralf; do echo waiting for ralf to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-chronos', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup chronos; do echo waiting for chronos to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-homestead', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'sprout', 'image': 'ollivier/clearwater-sprout:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 3, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {}}} 2020-07-15 14:33:40,626 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 22, 41, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test6'}, 'managed_fields': None, 'name': 'live-test6', 'namespace': 'default', 'owner_references': None, 'resource_version': '1040814', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test6', 'uid': '2c504f10-f046-4779-8b04-c6cb52c7bf86'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test6'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test6'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test6', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 11, 22, 41, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 11, 22, 50, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test6-988dbb567" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 30, 45, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 30, 45, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test6', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test6', 'uid': '2c504f10-f046-4779-8b04-c6cb52c7bf86', 'resourceVersion': '1040814', 'generation': 1, 'creationTimestamp': '2020-07-10T11:22:41Z', 'labels': {'run': 'live-test6'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test6'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test6'}}, 'spec': {'containers': [{'name': 'live-test6', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T11:22:50Z', 'lastTransitionTime': '2020-07-10T11:22:41Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test6-988dbb567" has successfully progressed.'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-15T14:30:45Z', 'lastTransitionTime': '2020-07-15T14:30:45Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-15 14:33:40,637 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 54, 47, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test7'}, 'managed_fields': None, 'name': 'live-test7', 'namespace': 'default', 'owner_references': None, 'resource_version': '1040705', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test7', 'uid': '7bb42069-0e58-44eb-97bf-37be24b29e9c'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test7'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test7'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test7', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 11, 54, 47, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 11, 54, 54, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test7-5dd99f9b45" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 30, 20, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 30, 20, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test7', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test7', 'uid': '7bb42069-0e58-44eb-97bf-37be24b29e9c', 'resourceVersion': '1040705', 'generation': 1, 'creationTimestamp': '2020-07-10T11:54:47Z', 'labels': {'run': 'live-test7'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test7'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test7'}}, 'spec': {'containers': [{'name': 'live-test7', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T11:54:54Z', 'lastTransitionTime': '2020-07-10T11:54:47Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test7-5dd99f9b45" has successfully progressed.'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-15T14:30:20Z', 'lastTransitionTime': '2020-07-15T14:30:20Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-15 14:33:40,647 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 56, 6, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test8'}, 'managed_fields': None, 'name': 'live-test8', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041077', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test8', 'uid': '97897e35-290b-4b9f-b5bf-1be380092f43'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test8'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test8'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test8', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 11, 56, 6, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 11, 56, 16, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test8-55669b464c" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 31, 59, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 31, 59, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test8', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test8', 'uid': '97897e35-290b-4b9f-b5bf-1be380092f43', 'resourceVersion': '1041077', 'generation': 1, 'creationTimestamp': '2020-07-10T11:56:06Z', 'labels': {'run': 'live-test8'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test8'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test8'}}, 'spec': {'containers': [{'name': 'live-test8', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T11:56:16Z', 'lastTransitionTime': '2020-07-10T11:56:06Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test8-55669b464c" has successfully progressed.'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-15T14:31:59Z', 'lastTransitionTime': '2020-07-15T14:31:59Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-15 14:33:40,667 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'service': 'chronos'}, 'managed_fields': None, 'name': 'chronos', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041499', 'self_link': '/apis/apps/v1/namespaces/default/deployments/chronos', 'uid': '15c34867-a879-463c-b5ba-9346b4e16e93'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'chronos'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'chronos'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-chronos:latest', 'image_pull_policy': 'Always', 'lifecycle': {'post_start': None, 'pre_stop': {'_exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}, 'http_get': None, 'tcp_socket': None}}, 'liveness_probe': {'_exec': None, 'failure_threshold': 9, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7253}, 'timeout_seconds': 1}, 'name': 'chronos', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7253, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7253}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/chronos', 'mount_propagation': None, 'name': 'chronoslogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/chronos/chronos_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/chronos', 'mount_propagation': None, 'name': 'chronoslogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 120, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'chronoslogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'message': 'ReplicaSet "chronos-687b9884c5" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'chronos', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/chronos', 'uid': '15c34867-a879-463c-b5ba-9346b4e16e93', 'resourceVersion': '1041499', 'generation': 1, 'creationTimestamp': '2020-07-15T14:33:39Z', 'labels': {'service': 'chronos'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'chronos'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'chronos'}}, 'spec': {'volumes': [{'name': 'chronoslogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'chronos', 'image': 'ollivier/clearwater-chronos:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7253, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'chronoslogs', 'mountPath': '/var/log/chronos'}], 'livenessProbe': {'tcpSocket': {'port': 7253}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 9}, 'readinessProbe': {'tcpSocket': {'port': 7253}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'lifecycle': {'preStop': {'exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}}}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/chronos/chronos_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'chronoslogs', 'mountPath': '/var/log/chronos'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 120, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-15T14:33:39Z', 'lastTransitionTime': '2020-07-15T14:33:39Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:33:39Z', 'lastTransitionTime': '2020-07-15T14:33:39Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "chronos-687b9884c5" is progressing.'}]}}} 2020-07-15 14:33:40,692 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 0, 4, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test3'}, 'managed_fields': None, 'name': 'live-test3', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041417', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test3', 'uid': '93bd8802-4153-4590-aee1-cd3b8f208f06'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test3'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test3'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test3', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 11, 0, 4, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 11, 0, 17, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test3-6556bf7d77" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 33, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 33, 33, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test3', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test3', 'uid': '93bd8802-4153-4590-aee1-cd3b8f208f06', 'resourceVersion': '1041417', 'generation': 1, 'creationTimestamp': '2020-07-10T11:00:04Z', 'labels': {'run': 'live-test3'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test3'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test3'}}, 'spec': {'containers': [{'name': 'live-test3', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T11:00:17Z', 'lastTransitionTime': '2020-07-10T11:00:04Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test3-6556bf7d77" has successfully progressed.'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-15T14:33:33Z', 'lastTransitionTime': '2020-07-15T14:33:33Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-15 14:33:40,702 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 6, 27, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test5'}, 'managed_fields': None, 'name': 'live-test5', 'namespace': 'default', 'owner_references': None, 'resource_version': '1040862', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test5', 'uid': '386005c8-1f07-46dc-adf0-77ceea373c63'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test5'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test5'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test5', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 11, 6, 27, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 11, 6, 40, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test5-b6fcb7757" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 31, 6, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 31, 6, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test5', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test5', 'uid': '386005c8-1f07-46dc-adf0-77ceea373c63', 'resourceVersion': '1040862', 'generation': 1, 'creationTimestamp': '2020-07-10T11:06:27Z', 'labels': {'run': 'live-test5'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test5'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test5'}}, 'spec': {'containers': [{'name': 'live-test5', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T11:06:40Z', 'lastTransitionTime': '2020-07-10T11:06:27Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test5-b6fcb7757" has successfully progressed.'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-15T14:31:06Z', 'lastTransitionTime': '2020-07-15T14:31:06Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-15 14:33:40,713 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'astaire', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041452', 'self_link': '/apis/apps/v1/namespaces/default/deployments/astaire', 'uid': 'd48fa86b-cb50-4292-809a-be08cb1a5333'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'astaire'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'astaire'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-astaire:latest', 'image_pull_policy': 'Always', 'lifecycle': {'post_start': None, 'pre_stop': {'_exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}, 'http_get': None, 'tcp_socket': None}}, 'liveness_probe': {'_exec': None, 'failure_threshold': 9, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 11311}, 'timeout_seconds': 1}, 'name': 'astaire', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 11211, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 11311, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 11311}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/astaire', 'mount_propagation': None, 'name': 'astairelogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/astaire/astaire_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/astaire', 'mount_propagation': None, 'name': 'astairelogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 120, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'astairelogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'message': 'ReplicaSet "astaire-5ddcdd6b7f" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'astaire', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/astaire', 'uid': 'd48fa86b-cb50-4292-809a-be08cb1a5333', 'resourceVersion': '1041452', 'generation': 1, 'creationTimestamp': '2020-07-15T14:33:39Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'astaire'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'astaire'}}, 'spec': {'volumes': [{'name': 'astairelogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'astaire', 'image': 'ollivier/clearwater-astaire:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 11211, 'protocol': 'TCP'}, {'containerPort': 11311, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'astairelogs', 'mountPath': '/var/log/astaire'}], 'livenessProbe': {'tcpSocket': {'port': 11311}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 9}, 'readinessProbe': {'tcpSocket': {'port': 11311}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'lifecycle': {'preStop': {'exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}}}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/astaire/astaire_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'astairelogs', 'mountPath': '/var/log/astaire'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 120, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-15T14:33:39Z', 'lastTransitionTime': '2020-07-15T14:33:39Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:33:39Z', 'lastTransitionTime': '2020-07-15T14:33:39Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "astaire-5ddcdd6b7f" is progressing.'}]}}} 2020-07-15 14:33:40,737 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'etcd', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041535', 'self_link': '/apis/apps/v1/namespaces/default/deployments/etcd', 'uid': '87c6ea83-e892-4d3b-9660-fef8d6426a75'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'instance-type': 'etcd-pod'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'instance-type': 'etcd-pod'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': ['--name', '$(MY_POD_NAME)', '--advertise-client-urls', 'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', '--listen-client-urls', 'http://0.0.0.0:2379,http://0.0.0.0:4001', '--initial-advertise-peer-urls', 'http://$(MY_POD_IP):2380', '--listen-peer-urls', 'http://0.0.0.0:2380', '--initial-cluster', '$(MY_POD_NAME)=http://$(MY_POD_IP):2380', '--initial-cluster-state', 'new'], 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}, {'name': 'MY_POD_NAME', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'metadata.name'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': None, 'image': 'quay.io/coreos/etcd:v2.2.5', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 300, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 4001}, 'timeout_seconds': 1}, 'name': 'etcd', 'ports': [{'container_port': 2379, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 2380, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 4001, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 4001}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'message': 'Created new replica set ' '"etcd-5cbf55c8c"', 'reason': 'NewReplicaSetCreated', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': None, 'unavailable_replicas': 1, 'updated_replicas': None}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'etcd', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/etcd', 'uid': '87c6ea83-e892-4d3b-9660-fef8d6426a75', 'resourceVersion': '1041535', 'generation': 1, 'creationTimestamp': '2020-07-15T14:33:39Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'instance-type': 'etcd-pod'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'instance-type': 'etcd-pod'}}, 'spec': {'containers': [{'name': 'etcd', 'image': 'quay.io/coreos/etcd:v2.2.5', 'args': ['--name', '$(MY_POD_NAME)', '--advertise-client-urls', 'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', '--listen-client-urls', 'http://0.0.0.0:2379,http://0.0.0.0:4001', '--initial-advertise-peer-urls', 'http://$(MY_POD_IP):2380', '--listen-peer-urls', 'http://0.0.0.0:2380', '--initial-cluster', '$(MY_POD_NAME)=http://$(MY_POD_IP):2380', '--initial-cluster-state', 'new'], 'ports': [{'containerPort': 2379, 'protocol': 'TCP'}, {'containerPort': 2380, 'protocol': 'TCP'}, {'containerPort': 4001, 'protocol': 'TCP'}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}, {'name': 'MY_POD_NAME', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'metadata.name'}}}], 'resources': {}, 'livenessProbe': {'tcpSocket': {'port': 4001}, 'initialDelaySeconds': 300, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 4001}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:33:39Z', 'lastTransitionTime': '2020-07-15T14:33:39Z', 'reason': 'NewReplicaSetCreated', 'message': 'Created new replica set "etcd-5cbf55c8c"'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-15T14:33:39Z', 'lastTransitionTime': '2020-07-15T14:33:39Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-15 14:33:40,754 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homestead', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041554', 'self_link': '/apis/apps/v1/namespaces/default/deployments/homestead', 'uid': '71366f1e-26ec-4ac2-84b2-55cf1731d728'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'homestead'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'homestead', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/homestead', 'mount_propagation': None, 'name': 'homesteadlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/homestead/homestead_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/homestead', 'mount_propagation': None, 'name': 'homesteadlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'astaire; do ' 'echo waiting ' 'for astaire ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-astaire', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'homesteadlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'message': 'ReplicaSet "homestead-57586d6cdc" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homestead', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/homestead', 'uid': '71366f1e-26ec-4ac2-84b2-55cf1731d728', 'resourceVersion': '1041554', 'generation': 1, 'creationTimestamp': '2020-07-15T14:33:39Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homestead'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homestead', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'homesteadlogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-astaire', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup astaire; do echo waiting for astaire to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead', 'image': 'ollivier/clearwater-homestead:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'homesteadlogs', 'mountPath': '/var/log/homestead'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/homestead/homestead_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'homesteadlogs', 'mountPath': '/var/log/homestead'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-15T14:33:39Z', 'lastTransitionTime': '2020-07-15T14:33:39Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:33:39Z', 'lastTransitionTime': '2020-07-15T14:33:39Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "homestead-57586d6cdc" is progressing.'}]}}} 2020-07-15 14:33:40,779 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 2, 2, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test4'}, 'managed_fields': None, 'name': 'live-test4', 'namespace': 'default', 'owner_references': None, 'resource_version': '1040952', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test4', 'uid': 'b0d44bb2-0c16-4b80-813a-381e5cb8c2f1'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test4'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test4'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test4', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 11, 2, 2, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 11, 2, 13, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test4-74f5c7c95f" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 31, 30, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 31, 30, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test4', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test4', 'uid': 'b0d44bb2-0c16-4b80-813a-381e5cb8c2f1', 'resourceVersion': '1040952', 'generation': 1, 'creationTimestamp': '2020-07-10T11:02:02Z', 'labels': {'run': 'live-test4'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test4'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test4'}}, 'spec': {'containers': [{'name': 'live-test4', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T11:02:13Z', 'lastTransitionTime': '2020-07-10T11:02:02Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test4-74f5c7c95f" has successfully progressed.'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-15T14:31:30Z', 'lastTransitionTime': '2020-07-15T14:31:30Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-15 14:33:40,789 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'etcd', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041583', 'self_link': '/apis/apps/v1/namespaces/default/deployments/etcd', 'uid': '87c6ea83-e892-4d3b-9660-fef8d6426a75'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'instance-type': 'etcd-pod'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'instance-type': 'etcd-pod'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': ['--name', '$(MY_POD_NAME)', '--advertise-client-urls', 'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', '--listen-client-urls', 'http://0.0.0.0:2379,http://0.0.0.0:4001', '--initial-advertise-peer-urls', 'http://$(MY_POD_IP):2380', '--listen-peer-urls', 'http://0.0.0.0:2380', '--initial-cluster', '$(MY_POD_NAME)=http://$(MY_POD_IP):2380', '--initial-cluster-state', 'new'], 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}, {'name': 'MY_POD_NAME', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'metadata.name'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': None, 'image': 'quay.io/coreos/etcd:v2.2.5', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 300, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 4001}, 'timeout_seconds': 1}, 'name': 'etcd', 'ports': [{'container_port': 2379, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 2380, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 4001, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 4001}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 33, 40, tzinfo=tzlocal()), 'message': 'ReplicaSet "etcd-5cbf55c8c" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'etcd', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/etcd', 'uid': '87c6ea83-e892-4d3b-9660-fef8d6426a75', 'resourceVersion': '1041583', 'generation': 1, 'creationTimestamp': '2020-07-15T14:33:39Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'instance-type': 'etcd-pod'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'instance-type': 'etcd-pod'}}, 'spec': {'containers': [{'name': 'etcd', 'image': 'quay.io/coreos/etcd:v2.2.5', 'args': ['--name', '$(MY_POD_NAME)', '--advertise-client-urls', 'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', '--listen-client-urls', 'http://0.0.0.0:2379,http://0.0.0.0:4001', '--initial-advertise-peer-urls', 'http://$(MY_POD_IP):2380', '--listen-peer-urls', 'http://0.0.0.0:2380', '--initial-cluster', '$(MY_POD_NAME)=http://$(MY_POD_IP):2380', '--initial-cluster-state', 'new'], 'ports': [{'containerPort': 2379, 'protocol': 'TCP'}, {'containerPort': 2380, 'protocol': 'TCP'}, {'containerPort': 4001, 'protocol': 'TCP'}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}, {'name': 'MY_POD_NAME', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'metadata.name'}}}], 'resources': {}, 'livenessProbe': {'tcpSocket': {'port': 4001}, 'initialDelaySeconds': 300, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 4001}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-15T14:33:39Z', 'lastTransitionTime': '2020-07-15T14:33:39Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:33:40Z', 'lastTransitionTime': '2020-07-15T14:33:39Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "etcd-5cbf55c8c" is progressing.'}]}}} 2020-07-15 14:33:40,806 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homer', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041585', 'self_link': '/apis/apps/v1/namespaces/default/deployments/homer', 'uid': 'a50654d8-5759-4b14-b0c0-c96d44e244a0'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'homer'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'homer'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homer:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'name': 'homer', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 33, 40, tzinfo=tzlocal()), 'message': 'ReplicaSet "homer-74dd4556d9" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homer', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/homer', 'uid': 'a50654d8-5759-4b14-b0c0-c96d44e244a0', 'resourceVersion': '1041585', 'generation': 1, 'creationTimestamp': '2020-07-15T14:33:39Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homer'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homer'}}, 'spec': {'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homer', 'image': 'ollivier/clearwater-homer:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'tcpSocket': {'port': 7888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 7888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-15T14:33:39Z', 'lastTransitionTime': '2020-07-15T14:33:39Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:33:40Z', 'lastTransitionTime': '2020-07-15T14:33:39Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "homer-74dd4556d9" is progressing.'}]}}} 2020-07-15 14:33:40,824 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'sprout', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041586', 'self_link': '/apis/apps/v1/namespaces/default/deployments/sprout', 'uid': '3baf95af-ef52-4f16-a57f-62f80bcd945a'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'sprout'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'sprout', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-sprout:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 3, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'sprout', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'ralf; do ' 'echo waiting ' 'for ralf to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-ralf', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'chronos; do ' 'echo waiting ' 'for chronos ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-chronos', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'homestead; ' 'do echo ' 'waiting for ' 'homestead to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'sproutlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 40, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 33, 40, tzinfo=tzlocal()), 'message': 'Created new replica set ' '"sprout-686cc64cfb"', 'reason': 'NewReplicaSetCreated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': None, 'ready_replicas': None, 'replicas': None, 'unavailable_replicas': None, 'updated_replicas': None}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'sprout', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/sprout', 'uid': '3baf95af-ef52-4f16-a57f-62f80bcd945a', 'resourceVersion': '1041586', 'generation': 1, 'creationTimestamp': '2020-07-15T14:33:39Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'sprout'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'sprout', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'sproutlogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-ralf', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup ralf; do echo waiting for ralf to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-chronos', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup chronos; do echo waiting for chronos to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-homestead', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'sprout', 'image': 'ollivier/clearwater-sprout:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 3, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:33:40Z', 'lastTransitionTime': '2020-07-15T14:33:40Z', 'reason': 'NewReplicaSetCreated', 'message': 'Created new replica set "sprout-686cc64cfb"'}]}}} 2020-07-15 14:33:40,853 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homestead-prov', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041587', 'self_link': '/apis/apps/v1/namespaces/default/deployments/homestead-prov', 'uid': '8d5df381-c48e-4efc-9e9f-c79a0bf96cc5'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'homestead-prov'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'homestead-prov', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead-prov:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead-prov', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8889, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'homestead; ' 'do echo ' 'waiting for ' 'homestead to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 40, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 33, 40, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 33, 40, tzinfo=tzlocal()), 'message': 'ReplicaSet "homestead-prov-756c8bff5d" ' 'is progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homestead-prov', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/homestead-prov', 'uid': '8d5df381-c48e-4efc-9e9f-c79a0bf96cc5', 'resourceVersion': '1041587', 'generation': 1, 'creationTimestamp': '2020-07-15T14:33:39Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homestead-prov'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homestead-prov', 'snmp': 'enabled'}}, 'spec': {'initContainers': [{'name': 'wait-on-homestead', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead-prov', 'image': 'ollivier/clearwater-homestead-prov:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8889, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-15T14:33:40Z', 'lastTransitionTime': '2020-07-15T14:33:40Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:33:40Z', 'lastTransitionTime': '2020-07-15T14:33:39Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "homestead-prov-756c8bff5d" is progressing.'}]}}} 2020-07-15 14:33:40,870 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'ralf', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041591', 'self_link': '/apis/apps/v1/namespaces/default/deployments/ralf', 'uid': '5d905c8e-6cfe-4b91-9eb2-cbef1b4ca843'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'ralf'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'ralf', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-ralf:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'name': 'ralf', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 10888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'ralflogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 40, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 33, 40, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 40, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 33, 40, tzinfo=tzlocal()), 'message': 'ReplicaSet "ralf-57c4654cb8" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'ralf', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/ralf', 'uid': '5d905c8e-6cfe-4b91-9eb2-cbef1b4ca843', 'resourceVersion': '1041591', 'generation': 1, 'creationTimestamp': '2020-07-15T14:33:39Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'ralf'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'ralf', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'ralflogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'ralf', 'image': 'ollivier/clearwater-ralf:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 10888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}], 'livenessProbe': {'tcpSocket': {'port': 10888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 10888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-15T14:33:40Z', 'lastTransitionTime': '2020-07-15T14:33:40Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:33:40Z', 'lastTransitionTime': '2020-07-15T14:33:40Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "ralf-57c4654cb8" is progressing.'}]}}} 2020-07-15 14:33:40,894 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'sprout', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041592', 'self_link': '/apis/apps/v1/namespaces/default/deployments/sprout', 'uid': '3baf95af-ef52-4f16-a57f-62f80bcd945a'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'sprout'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'sprout', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-sprout:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 3, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'sprout', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'ralf; do ' 'echo waiting ' 'for ralf to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-ralf', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'chronos; do ' 'echo waiting ' 'for chronos ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-chronos', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'homestead; ' 'do echo ' 'waiting for ' 'homestead to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'sproutlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 40, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 33, 40, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 40, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 33, 40, tzinfo=tzlocal()), 'message': 'ReplicaSet "sprout-686cc64cfb" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'sprout', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/sprout', 'uid': '3baf95af-ef52-4f16-a57f-62f80bcd945a', 'resourceVersion': '1041592', 'generation': 1, 'creationTimestamp': '2020-07-15T14:33:39Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'sprout'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'sprout', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'sproutlogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-ralf', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup ralf; do echo waiting for ralf to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-chronos', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup chronos; do echo waiting for chronos to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-homestead', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'sprout', 'image': 'ollivier/clearwater-sprout:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 3, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-15T14:33:40Z', 'lastTransitionTime': '2020-07-15T14:33:40Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:33:40Z', 'lastTransitionTime': '2020-07-15T14:33:40Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "sprout-686cc64cfb" is progressing.'}]}}} 2020-07-15 14:33:57,040 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'etcd', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041682', 'self_link': '/apis/apps/v1/namespaces/default/deployments/etcd', 'uid': '87c6ea83-e892-4d3b-9660-fef8d6426a75'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'instance-type': 'etcd-pod'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'instance-type': 'etcd-pod'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': ['--name', '$(MY_POD_NAME)', '--advertise-client-urls', 'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', '--listen-client-urls', 'http://0.0.0.0:2379,http://0.0.0.0:4001', '--initial-advertise-peer-urls', 'http://$(MY_POD_IP):2380', '--listen-peer-urls', 'http://0.0.0.0:2380', '--initial-cluster', '$(MY_POD_NAME)=http://$(MY_POD_IP):2380', '--initial-cluster-state', 'new'], 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}, {'name': 'MY_POD_NAME', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'metadata.name'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': None, 'image': 'quay.io/coreos/etcd:v2.2.5', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 300, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 4001}, 'timeout_seconds': 1}, 'name': 'etcd', 'ports': [{'container_port': 2379, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 2380, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 4001, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 4001}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 57, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 33, 57, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 33, 57, tzinfo=tzlocal()), 'message': 'ReplicaSet "etcd-5cbf55c8c" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'etcd', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/etcd', 'uid': '87c6ea83-e892-4d3b-9660-fef8d6426a75', 'resourceVersion': '1041682', 'generation': 1, 'creationTimestamp': '2020-07-15T14:33:39Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'instance-type': 'etcd-pod'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'instance-type': 'etcd-pod'}}, 'spec': {'containers': [{'name': 'etcd', 'image': 'quay.io/coreos/etcd:v2.2.5', 'args': ['--name', '$(MY_POD_NAME)', '--advertise-client-urls', 'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', '--listen-client-urls', 'http://0.0.0.0:2379,http://0.0.0.0:4001', '--initial-advertise-peer-urls', 'http://$(MY_POD_IP):2380', '--listen-peer-urls', 'http://0.0.0.0:2380', '--initial-cluster', '$(MY_POD_NAME)=http://$(MY_POD_IP):2380', '--initial-cluster-state', 'new'], 'ports': [{'containerPort': 2379, 'protocol': 'TCP'}, {'containerPort': 2380, 'protocol': 'TCP'}, {'containerPort': 4001, 'protocol': 'TCP'}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}, {'name': 'MY_POD_NAME', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'metadata.name'}}}], 'resources': {}, 'livenessProbe': {'tcpSocket': {'port': 4001}, 'initialDelaySeconds': 300, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 4001}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:33:57Z', 'lastTransitionTime': '2020-07-15T14:33:57Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:33:57Z', 'lastTransitionTime': '2020-07-15T14:33:39Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "etcd-5cbf55c8c" has successfully progressed.'}]}}} 2020-07-15 14:33:57,060 - functest_kubernetes.ims.ims - INFO - etcd started in 17.86 sec 2020-07-15 14:34:15,857 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 10, 58, 1, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test2'}, 'managed_fields': None, 'name': 'live-test2', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041723', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test2', 'uid': 'c6c9caaa-5133-4416-b435-70577cb956d5'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test2'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test2'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test2', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 10, 58, 2, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 10, 58, 12, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test2-54d9dcd87" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 34, 15, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 34, 15, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test2', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test2', 'uid': 'c6c9caaa-5133-4416-b435-70577cb956d5', 'resourceVersion': '1041723', 'generation': 1, 'creationTimestamp': '2020-07-10T10:58:01Z', 'labels': {'run': 'live-test2'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test2'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test2'}}, 'spec': {'containers': [{'name': 'live-test2', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T10:58:12Z', 'lastTransitionTime': '2020-07-10T10:58:02Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test2-54d9dcd87" has successfully progressed.'}, {'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:34:15Z', 'lastTransitionTime': '2020-07-15T14:34:15Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}]}}} 2020-07-15 14:34:16,879 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 10, 58, 1, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test2'}, 'managed_fields': None, 'name': 'live-test2', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041728', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test2', 'uid': 'c6c9caaa-5133-4416-b435-70577cb956d5'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test2'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test2'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test2', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 10, 58, 2, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 10, 58, 12, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test2-54d9dcd87" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 34, 16, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 34, 16, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test2', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test2', 'uid': 'c6c9caaa-5133-4416-b435-70577cb956d5', 'resourceVersion': '1041728', 'generation': 1, 'creationTimestamp': '2020-07-10T10:58:01Z', 'labels': {'run': 'live-test2'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test2'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test2'}}, 'spec': {'containers': [{'name': 'live-test2', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T10:58:12Z', 'lastTransitionTime': '2020-07-10T10:58:02Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test2-54d9dcd87" has successfully progressed.'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-15T14:34:16Z', 'lastTransitionTime': '2020-07-15T14:34:16Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-15 14:35:23,279 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 54, 47, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test7'}, 'managed_fields': None, 'name': 'live-test7', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041874', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test7', 'uid': '7bb42069-0e58-44eb-97bf-37be24b29e9c'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test7'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test7'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test7', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 11, 54, 47, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 11, 54, 54, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test7-5dd99f9b45" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 35, 23, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 35, 23, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test7', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test7', 'uid': '7bb42069-0e58-44eb-97bf-37be24b29e9c', 'resourceVersion': '1041874', 'generation': 1, 'creationTimestamp': '2020-07-10T11:54:47Z', 'labels': {'run': 'live-test7'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test7'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test7'}}, 'spec': {'containers': [{'name': 'live-test7', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T11:54:54Z', 'lastTransitionTime': '2020-07-10T11:54:47Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test7-5dd99f9b45" has successfully progressed.'}, {'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:35:23Z', 'lastTransitionTime': '2020-07-15T14:35:23Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}]}}} 2020-07-15 14:35:24,352 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 54, 47, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test7'}, 'managed_fields': None, 'name': 'live-test7', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041879', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test7', 'uid': '7bb42069-0e58-44eb-97bf-37be24b29e9c'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test7'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test7'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test7', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 11, 54, 47, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 11, 54, 54, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test7-5dd99f9b45" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 35, 24, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 35, 24, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test7', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test7', 'uid': '7bb42069-0e58-44eb-97bf-37be24b29e9c', 'resourceVersion': '1041879', 'generation': 1, 'creationTimestamp': '2020-07-10T11:54:47Z', 'labels': {'run': 'live-test7'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test7'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test7'}}, 'spec': {'containers': [{'name': 'live-test7', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T11:54:54Z', 'lastTransitionTime': '2020-07-10T11:54:47Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test7-5dd99f9b45" has successfully progressed.'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-15T14:35:24Z', 'lastTransitionTime': '2020-07-15T14:35:24Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-15 14:35:29,245 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'cassandra', 'namespace': 'default', 'owner_references': None, 'resource_version': '1041892', 'self_link': '/apis/apps/v1/namespaces/default/deployments/cassandra', 'uid': '58757469-bb46-4e13-b1b3-6975ce393a66'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'cassandra'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'cassandra'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-cassandra:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 ' '9042 ' '9160']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 600, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'cassandra', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7001, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 9042, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 9160, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 ' '9042 ' '9160']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'etcd; do ' 'echo waiting ' 'for etcd to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-etcd', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 15, 14, 35, 29, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 35, 29, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 35, 29, tzinfo=tzlocal()), 'message': 'ReplicaSet "cassandra-76f5c4d86c" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'cassandra', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/cassandra', 'uid': '58757469-bb46-4e13-b1b3-6975ce393a66', 'resourceVersion': '1041892', 'generation': 1, 'creationTimestamp': '2020-07-15T14:33:39Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'cassandra'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'cassandra'}}, 'spec': {'initContainers': [{'name': 'wait-on-etcd', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup etcd; do echo waiting for etcd to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'cassandra', 'image': 'ollivier/clearwater-cassandra:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7001, 'protocol': 'TCP'}, {'containerPort': 9042, 'protocol': 'TCP'}, {'containerPort': 9160, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 9160']}, 'initialDelaySeconds': 600, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 9160']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:35:29Z', 'lastTransitionTime': '2020-07-15T14:35:29Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:35:29Z', 'lastTransitionTime': '2020-07-15T14:33:39Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "cassandra-76f5c4d86c" has successfully progressed.'}]}}} 2020-07-15 14:35:29,267 - functest_kubernetes.ims.ims - INFO - cassandra started in 110.06 sec 2020-07-15 14:36:08,199 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 22, 41, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test6'}, 'managed_fields': None, 'name': 'live-test6', 'namespace': 'default', 'owner_references': None, 'resource_version': '1042000', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test6', 'uid': '2c504f10-f046-4779-8b04-c6cb52c7bf86'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test6'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test6'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test6', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 11, 22, 41, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 11, 22, 50, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test6-988dbb567" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 36, 8, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 36, 8, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test6', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test6', 'uid': '2c504f10-f046-4779-8b04-c6cb52c7bf86', 'resourceVersion': '1042000', 'generation': 1, 'creationTimestamp': '2020-07-10T11:22:41Z', 'labels': {'run': 'live-test6'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test6'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test6'}}, 'spec': {'containers': [{'name': 'live-test6', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T11:22:50Z', 'lastTransitionTime': '2020-07-10T11:22:41Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test6-988dbb567" has successfully progressed.'}, {'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:36:08Z', 'lastTransitionTime': '2020-07-15T14:36:08Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}]}}} 2020-07-15 14:36:10,213 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 22, 41, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test6'}, 'managed_fields': None, 'name': 'live-test6', 'namespace': 'default', 'owner_references': None, 'resource_version': '1042008', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test6', 'uid': '2c504f10-f046-4779-8b04-c6cb52c7bf86'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test6'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test6'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test6', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 11, 22, 41, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 11, 22, 50, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test6-988dbb567" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 36, 10, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 36, 10, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test6', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test6', 'uid': '2c504f10-f046-4779-8b04-c6cb52c7bf86', 'resourceVersion': '1042008', 'generation': 1, 'creationTimestamp': '2020-07-10T11:22:41Z', 'labels': {'run': 'live-test6'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test6'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test6'}}, 'spec': {'containers': [{'name': 'live-test6', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T11:22:50Z', 'lastTransitionTime': '2020-07-10T11:22:41Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test6-988dbb567" has successfully progressed.'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-15T14:36:10Z', 'lastTransitionTime': '2020-07-15T14:36:10Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-15 14:36:14,605 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homer', 'namespace': 'default', 'owner_references': None, 'resource_version': '1042031', 'self_link': '/apis/apps/v1/namespaces/default/deployments/homer', 'uid': 'a50654d8-5759-4b14-b0c0-c96d44e244a0'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'homer'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'homer'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homer:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'name': 'homer', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 15, 14, 36, 14, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 36, 14, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 36, 14, tzinfo=tzlocal()), 'message': 'ReplicaSet "homer-74dd4556d9" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homer', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/homer', 'uid': 'a50654d8-5759-4b14-b0c0-c96d44e244a0', 'resourceVersion': '1042031', 'generation': 1, 'creationTimestamp': '2020-07-15T14:33:39Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homer'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homer'}}, 'spec': {'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homer', 'image': 'ollivier/clearwater-homer:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'tcpSocket': {'port': 7888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 7888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:36:14Z', 'lastTransitionTime': '2020-07-15T14:36:14Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:36:14Z', 'lastTransitionTime': '2020-07-15T14:33:39Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "homer-74dd4556d9" has successfully progressed.'}]}}} 2020-07-15 14:36:14,624 - functest_kubernetes.ims.ims - INFO - homer started in 155.42 sec 2020-07-15 14:36:16,381 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 6, 27, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test5'}, 'managed_fields': None, 'name': 'live-test5', 'namespace': 'default', 'owner_references': None, 'resource_version': '1042037', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test5', 'uid': '386005c8-1f07-46dc-adf0-77ceea373c63'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test5'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test5'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test5', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 11, 6, 27, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 11, 6, 40, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test5-b6fcb7757" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 36, 16, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 36, 16, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test5', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test5', 'uid': '386005c8-1f07-46dc-adf0-77ceea373c63', 'resourceVersion': '1042037', 'generation': 1, 'creationTimestamp': '2020-07-10T11:06:27Z', 'labels': {'run': 'live-test5'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test5'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test5'}}, 'spec': {'containers': [{'name': 'live-test5', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T11:06:40Z', 'lastTransitionTime': '2020-07-10T11:06:27Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test5-b6fcb7757" has successfully progressed.'}, {'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:36:16Z', 'lastTransitionTime': '2020-07-15T14:36:16Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}]}}} 2020-07-15 14:36:17,292 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 6, 27, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test5'}, 'managed_fields': None, 'name': 'live-test5', 'namespace': 'default', 'owner_references': None, 'resource_version': '1042045', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test5', 'uid': '386005c8-1f07-46dc-adf0-77ceea373c63'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test5'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test5'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test5', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 11, 6, 27, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 11, 6, 40, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test5-b6fcb7757" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 36, 17, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 36, 17, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test5', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test5', 'uid': '386005c8-1f07-46dc-adf0-77ceea373c63', 'resourceVersion': '1042045', 'generation': 1, 'creationTimestamp': '2020-07-10T11:06:27Z', 'labels': {'run': 'live-test5'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test5'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test5'}}, 'spec': {'containers': [{'name': 'live-test5', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T11:06:40Z', 'lastTransitionTime': '2020-07-10T11:06:27Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test5-b6fcb7757" has successfully progressed.'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-15T14:36:17Z', 'lastTransitionTime': '2020-07-15T14:36:17Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-15 14:36:19,906 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'service': 'chronos'}, 'managed_fields': None, 'name': 'chronos', 'namespace': 'default', 'owner_references': None, 'resource_version': '1042056', 'self_link': '/apis/apps/v1/namespaces/default/deployments/chronos', 'uid': '15c34867-a879-463c-b5ba-9346b4e16e93'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'chronos'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'chronos'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-chronos:latest', 'image_pull_policy': 'Always', 'lifecycle': {'post_start': None, 'pre_stop': {'_exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}, 'http_get': None, 'tcp_socket': None}}, 'liveness_probe': {'_exec': None, 'failure_threshold': 9, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7253}, 'timeout_seconds': 1}, 'name': 'chronos', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7253, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7253}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/chronos', 'mount_propagation': None, 'name': 'chronoslogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/chronos/chronos_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/chronos', 'mount_propagation': None, 'name': 'chronoslogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 120, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'chronoslogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 15, 14, 36, 19, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 36, 19, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 36, 19, tzinfo=tzlocal()), 'message': 'ReplicaSet "chronos-687b9884c5" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'chronos', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/chronos', 'uid': '15c34867-a879-463c-b5ba-9346b4e16e93', 'resourceVersion': '1042056', 'generation': 1, 'creationTimestamp': '2020-07-15T14:33:39Z', 'labels': {'service': 'chronos'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'chronos'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'chronos'}}, 'spec': {'volumes': [{'name': 'chronoslogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'chronos', 'image': 'ollivier/clearwater-chronos:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7253, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'chronoslogs', 'mountPath': '/var/log/chronos'}], 'livenessProbe': {'tcpSocket': {'port': 7253}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 9}, 'readinessProbe': {'tcpSocket': {'port': 7253}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'lifecycle': {'preStop': {'exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}}}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/chronos/chronos_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'chronoslogs', 'mountPath': '/var/log/chronos'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 120, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:36:19Z', 'lastTransitionTime': '2020-07-15T14:36:19Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:36:19Z', 'lastTransitionTime': '2020-07-15T14:33:39Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "chronos-687b9884c5" has successfully progressed.'}]}}} 2020-07-15 14:36:19,932 - functest_kubernetes.ims.ims - INFO - chronos started in 160.73 sec 2020-07-15 14:36:23,643 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'ralf', 'namespace': 'default', 'owner_references': None, 'resource_version': '1042069', 'self_link': '/apis/apps/v1/namespaces/default/deployments/ralf', 'uid': '5d905c8e-6cfe-4b91-9eb2-cbef1b4ca843'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'ralf'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'ralf', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-ralf:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'name': 'ralf', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 10888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'ralflogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 15, 14, 36, 23, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 36, 23, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 40, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 36, 23, tzinfo=tzlocal()), 'message': 'ReplicaSet "ralf-57c4654cb8" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'ralf', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/ralf', 'uid': '5d905c8e-6cfe-4b91-9eb2-cbef1b4ca843', 'resourceVersion': '1042069', 'generation': 1, 'creationTimestamp': '2020-07-15T14:33:39Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'ralf'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'ralf', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'ralflogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'ralf', 'image': 'ollivier/clearwater-ralf:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 10888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}], 'livenessProbe': {'tcpSocket': {'port': 10888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 10888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:36:23Z', 'lastTransitionTime': '2020-07-15T14:36:23Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:36:23Z', 'lastTransitionTime': '2020-07-15T14:33:40Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "ralf-57c4654cb8" has successfully progressed.'}]}}} 2020-07-15 14:36:23,671 - functest_kubernetes.ims.ims - INFO - ralf started in 164.47 sec 2020-07-15 14:36:40,459 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 2, 2, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test4'}, 'managed_fields': None, 'name': 'live-test4', 'namespace': 'default', 'owner_references': None, 'resource_version': '1042117', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test4', 'uid': 'b0d44bb2-0c16-4b80-813a-381e5cb8c2f1'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test4'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test4'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test4', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 11, 2, 2, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 11, 2, 13, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test4-74f5c7c95f" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 36, 40, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 36, 40, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test4', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test4', 'uid': 'b0d44bb2-0c16-4b80-813a-381e5cb8c2f1', 'resourceVersion': '1042117', 'generation': 1, 'creationTimestamp': '2020-07-10T11:02:02Z', 'labels': {'run': 'live-test4'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test4'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test4'}}, 'spec': {'containers': [{'name': 'live-test4', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T11:02:13Z', 'lastTransitionTime': '2020-07-10T11:02:02Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test4-74f5c7c95f" has successfully progressed.'}, {'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:36:40Z', 'lastTransitionTime': '2020-07-15T14:36:40Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}]}}} 2020-07-15 14:36:42,522 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 2, 2, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test4'}, 'managed_fields': None, 'name': 'live-test4', 'namespace': 'default', 'owner_references': None, 'resource_version': '1042127', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test4', 'uid': 'b0d44bb2-0c16-4b80-813a-381e5cb8c2f1'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test4'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test4'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test4', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 11, 2, 2, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 11, 2, 13, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test4-74f5c7c95f" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 36, 42, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 36, 42, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test4', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test4', 'uid': 'b0d44bb2-0c16-4b80-813a-381e5cb8c2f1', 'resourceVersion': '1042127', 'generation': 1, 'creationTimestamp': '2020-07-10T11:02:02Z', 'labels': {'run': 'live-test4'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test4'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test4'}}, 'spec': {'containers': [{'name': 'live-test4', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T11:02:13Z', 'lastTransitionTime': '2020-07-10T11:02:02Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test4-74f5c7c95f" has successfully progressed.'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-15T14:36:42Z', 'lastTransitionTime': '2020-07-15T14:36:42Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-15 14:36:52,587 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'astaire', 'namespace': 'default', 'owner_references': None, 'resource_version': '1042150', 'self_link': '/apis/apps/v1/namespaces/default/deployments/astaire', 'uid': 'd48fa86b-cb50-4292-809a-be08cb1a5333'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'astaire'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'astaire'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-astaire:latest', 'image_pull_policy': 'Always', 'lifecycle': {'post_start': None, 'pre_stop': {'_exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}, 'http_get': None, 'tcp_socket': None}}, 'liveness_probe': {'_exec': None, 'failure_threshold': 9, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 11311}, 'timeout_seconds': 1}, 'name': 'astaire', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 11211, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 11311, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 11311}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/astaire', 'mount_propagation': None, 'name': 'astairelogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/astaire/astaire_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/astaire', 'mount_propagation': None, 'name': 'astairelogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 120, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'astairelogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 15, 14, 36, 52, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 36, 52, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 36, 52, tzinfo=tzlocal()), 'message': 'ReplicaSet "astaire-5ddcdd6b7f" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'astaire', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/astaire', 'uid': 'd48fa86b-cb50-4292-809a-be08cb1a5333', 'resourceVersion': '1042150', 'generation': 1, 'creationTimestamp': '2020-07-15T14:33:39Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'astaire'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'astaire'}}, 'spec': {'volumes': [{'name': 'astairelogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'astaire', 'image': 'ollivier/clearwater-astaire:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 11211, 'protocol': 'TCP'}, {'containerPort': 11311, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'astairelogs', 'mountPath': '/var/log/astaire'}], 'livenessProbe': {'tcpSocket': {'port': 11311}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 9}, 'readinessProbe': {'tcpSocket': {'port': 11311}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'lifecycle': {'preStop': {'exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}}}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/astaire/astaire_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'astairelogs', 'mountPath': '/var/log/astaire'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 120, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:36:52Z', 'lastTransitionTime': '2020-07-15T14:36:52Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:36:52Z', 'lastTransitionTime': '2020-07-15T14:33:39Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "astaire-5ddcdd6b7f" has successfully progressed.'}]}}} 2020-07-15 14:36:52,613 - functest_kubernetes.ims.ims - INFO - astaire started in 193.41 sec 2020-07-15 14:37:06,395 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 56, 6, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test8'}, 'managed_fields': None, 'name': 'live-test8', 'namespace': 'default', 'owner_references': None, 'resource_version': '1042184', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test8', 'uid': '97897e35-290b-4b9f-b5bf-1be380092f43'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test8'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test8'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test8', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 11, 56, 6, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 11, 56, 16, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test8-55669b464c" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 37, 6, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 37, 6, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test8', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test8', 'uid': '97897e35-290b-4b9f-b5bf-1be380092f43', 'resourceVersion': '1042184', 'generation': 1, 'creationTimestamp': '2020-07-10T11:56:06Z', 'labels': {'run': 'live-test8'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test8'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test8'}}, 'spec': {'containers': [{'name': 'live-test8', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T11:56:16Z', 'lastTransitionTime': '2020-07-10T11:56:06Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test8-55669b464c" has successfully progressed.'}, {'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:37:06Z', 'lastTransitionTime': '2020-07-15T14:37:06Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}]}}} 2020-07-15 14:37:07,444 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 56, 6, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test8'}, 'managed_fields': None, 'name': 'live-test8', 'namespace': 'default', 'owner_references': None, 'resource_version': '1042191', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test8', 'uid': '97897e35-290b-4b9f-b5bf-1be380092f43'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test8'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test8'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test8', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 11, 56, 6, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 11, 56, 16, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test8-55669b464c" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 37, 7, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 37, 7, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test8', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test8', 'uid': '97897e35-290b-4b9f-b5bf-1be380092f43', 'resourceVersion': '1042191', 'generation': 1, 'creationTimestamp': '2020-07-10T11:56:06Z', 'labels': {'run': 'live-test8'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test8'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test8'}}, 'spec': {'containers': [{'name': 'live-test8', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T11:56:16Z', 'lastTransitionTime': '2020-07-10T11:56:06Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test8-55669b464c" has successfully progressed.'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-15T14:37:07Z', 'lastTransitionTime': '2020-07-15T14:37:07Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-15 14:37:27,718 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homestead', 'namespace': 'default', 'owner_references': None, 'resource_version': '1042246', 'self_link': '/apis/apps/v1/namespaces/default/deployments/homestead', 'uid': '71366f1e-26ec-4ac2-84b2-55cf1731d728'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'homestead'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'homestead', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/homestead', 'mount_propagation': None, 'name': 'homesteadlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/homestead/homestead_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/homestead', 'mount_propagation': None, 'name': 'homesteadlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'astaire; do ' 'echo waiting ' 'for astaire ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-astaire', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'homesteadlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 15, 14, 37, 27, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 37, 27, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 37, 27, tzinfo=tzlocal()), 'message': 'ReplicaSet "homestead-57586d6cdc" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homestead', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/homestead', 'uid': '71366f1e-26ec-4ac2-84b2-55cf1731d728', 'resourceVersion': '1042246', 'generation': 1, 'creationTimestamp': '2020-07-15T14:33:39Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homestead'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homestead', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'homesteadlogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-astaire', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup astaire; do echo waiting for astaire to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead', 'image': 'ollivier/clearwater-homestead:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'homesteadlogs', 'mountPath': '/var/log/homestead'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/homestead/homestead_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'homesteadlogs', 'mountPath': '/var/log/homestead'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:37:27Z', 'lastTransitionTime': '2020-07-15T14:37:27Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:37:27Z', 'lastTransitionTime': '2020-07-15T14:33:39Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "homestead-57586d6cdc" has successfully progressed.'}]}}} 2020-07-15 14:37:27,747 - functest_kubernetes.ims.ims - INFO - homestead started in 228.54 sec 2020-07-15 14:37:44,711 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'sprout', 'namespace': 'default', 'owner_references': None, 'resource_version': '1042298', 'self_link': '/apis/apps/v1/namespaces/default/deployments/sprout', 'uid': '3baf95af-ef52-4f16-a57f-62f80bcd945a'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'sprout'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'sprout', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-sprout:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 3, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'sprout', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'ralf; do ' 'echo waiting ' 'for ralf to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-ralf', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'chronos; do ' 'echo waiting ' 'for chronos ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-chronos', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'homestead; ' 'do echo ' 'waiting for ' 'homestead to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'sproutlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 15, 14, 37, 44, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 37, 44, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 40, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 37, 44, tzinfo=tzlocal()), 'message': 'ReplicaSet "sprout-686cc64cfb" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'sprout', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/sprout', 'uid': '3baf95af-ef52-4f16-a57f-62f80bcd945a', 'resourceVersion': '1042298', 'generation': 1, 'creationTimestamp': '2020-07-15T14:33:39Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'sprout'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'sprout', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'sproutlogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-ralf', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup ralf; do echo waiting for ralf to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-chronos', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup chronos; do echo waiting for chronos to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-homestead', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'sprout', 'image': 'ollivier/clearwater-sprout:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 3, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:37:44Z', 'lastTransitionTime': '2020-07-15T14:37:44Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:37:44Z', 'lastTransitionTime': '2020-07-15T14:33:40Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "sprout-686cc64cfb" has successfully progressed.'}]}}} 2020-07-15 14:37:44,743 - functest_kubernetes.ims.ims - INFO - sprout started in 245.54 sec 2020-07-15 14:37:49,375 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homestead-prov', 'namespace': 'default', 'owner_references': None, 'resource_version': '1042311', 'self_link': '/apis/apps/v1/namespaces/default/deployments/homestead-prov', 'uid': '8d5df381-c48e-4efc-9e9f-c79a0bf96cc5'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'homestead-prov'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'homestead-prov', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead-prov:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead-prov', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8889, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'homestead; ' 'do echo ' 'waiting for ' 'homestead to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 15, 14, 37, 49, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 37, 49, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 37, 49, tzinfo=tzlocal()), 'message': 'ReplicaSet "homestead-prov-756c8bff5d" ' 'has successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homestead-prov', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/homestead-prov', 'uid': '8d5df381-c48e-4efc-9e9f-c79a0bf96cc5', 'resourceVersion': '1042311', 'generation': 1, 'creationTimestamp': '2020-07-15T14:33:39Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homestead-prov'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homestead-prov', 'snmp': 'enabled'}}, 'spec': {'initContainers': [{'name': 'wait-on-homestead', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead-prov', 'image': 'ollivier/clearwater-homestead-prov:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8889, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:37:49Z', 'lastTransitionTime': '2020-07-15T14:37:49Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:37:49Z', 'lastTransitionTime': '2020-07-15T14:33:39Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "homestead-prov-756c8bff5d" has successfully progressed.'}]}}} 2020-07-15 14:37:49,394 - functest_kubernetes.ims.ims - INFO - homestead-prov started in 250.19 sec 2020-07-15 14:38:24,108 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'bono', 'namespace': 'default', 'owner_references': None, 'resource_version': '1042406', 'self_link': '/apis/apps/v1/namespaces/default/deployments/bono', 'uid': 'c7d6ebd8-a408-43db-b0b4-2c25424d8b1b'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'bono'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'bono', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-bono:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 ' '5060 ' '5062']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'bono', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 3478, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5060, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5062, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5060, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'UDP'}, {'container_port': 5062, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'UDP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 ' '5060 ' '5062']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/bono', 'mount_propagation': None, 'name': 'bonologs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/bono/bono_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/bono', 'mount_propagation': None, 'name': 'bonologs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'sprout; do ' 'echo waiting ' 'for sprout ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'bonologs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 15, 14, 38, 24, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 38, 24, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 38, 24, tzinfo=tzlocal()), 'message': 'ReplicaSet "bono-5cdb7bfcdd" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'bono', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/bono', 'uid': 'c7d6ebd8-a408-43db-b0b4-2c25424d8b1b', 'resourceVersion': '1042406', 'generation': 1, 'creationTimestamp': '2020-07-15T14:33:39Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'bono'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'bono', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'bonologs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'bono', 'image': 'ollivier/clearwater-bono:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 3478, 'protocol': 'TCP'}, {'containerPort': 5060, 'protocol': 'TCP'}, {'containerPort': 5062, 'protocol': 'TCP'}, {'containerPort': 5060, 'protocol': 'UDP'}, {'containerPort': 5062, 'protocol': 'UDP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'bonologs', 'mountPath': '/var/log/bono'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 5062']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 5062']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/bono/bono_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'bonologs', 'mountPath': '/var/log/bono'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:38:24Z', 'lastTransitionTime': '2020-07-15T14:38:24Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:38:24Z', 'lastTransitionTime': '2020-07-15T14:33:39Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "bono-5cdb7bfcdd" has successfully progressed.'}]}}} 2020-07-15 14:38:24,136 - functest_kubernetes.ims.ims - INFO - bono started in 284.93 sec 2020-07-15 14:38:34,378 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'ellis', 'namespace': 'default', 'owner_references': None, 'resource_version': '1042431', 'self_link': '/apis/apps/v1/namespaces/default/deployments/ellis', 'uid': '8b571c0e-9aed-474d-b36b-47189dd6b27a'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'ellis'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'ellis'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-ellis:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 80}, 'timeout_seconds': 1}, 'name': 'ellis', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 80, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 80}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'homestead-prov; ' 'do echo ' 'waiting for ' 'homestead-prov ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead-prov', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'sprout; do ' 'echo waiting ' 'for sprout ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 15, 14, 38, 34, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 38, 34, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 15, 14, 38, 34, tzinfo=tzlocal()), 'message': 'ReplicaSet "ellis-57b84b6dd7" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'ellis', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/ellis', 'uid': '8b571c0e-9aed-474d-b36b-47189dd6b27a', 'resourceVersion': '1042431', 'generation': 1, 'creationTimestamp': '2020-07-15T14:33:39Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'ellis'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'ellis'}}, 'spec': {'initContainers': [{'name': 'wait-on-homestead-prov', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead-prov; do echo waiting for homestead-prov to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'ellis', 'image': 'ollivier/clearwater-ellis:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 80, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'tcpSocket': {'port': 80}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 80}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:38:34Z', 'lastTransitionTime': '2020-07-15T14:38:34Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-15T14:38:34Z', 'lastTransitionTime': '2020-07-15T14:33:39Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "ellis-57b84b6dd7" has successfully progressed.'}]}}} 2020-07-15 14:38:34,398 - functest_kubernetes.ims.ims - INFO - ellis started in 295.20 sec 2020-07-15 14:38:34,444 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'homer-74dd4556d9-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '74dd4556d9', 'service': 'homer'}, 'managed_fields': None, 'name': 'homer-74dd4556d9-ns72d', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'homer-74dd4556d9', 'uid': '1e7dbcef-264a-4e3e-b48c-27a0b9e667ed'}], 'resource_version': '1042027', 'self_link': '/api/v1/namespaces/default/pods/homer-74dd4556d9-ns72d', 'uid': '036d6f91-24da-4adf-a0e8-5a78e1e91ddc'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homer:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'name': 'homer', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup cassandra; do echo ' 'waiting for cassandra to start ' '...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'iruya-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 35, 49, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 36, 14, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 36, 14, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://f70ce8416a0b1715ed79167a52c61b98c81498c731f018371cdb0d2fcbcba5b5', 'image': 'docker.io/ollivier/clearwater-homer:latest', 'image_id': 'docker.io/ollivier/clearwater-homer@sha256:69b5406c3dcf61c95a067571c873b8691dc7cb23b24dbe3749b0a1d2b7c08ca9', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'homer', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 15, 14, 35, 57, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.9', 'init_container_statuses': [{'container_id': 'containerd://12e0703691b8f9fedaa75674945ab3cc30ff750a07b95c0f3359359ee3109cea', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-cassandra', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://12e0703691b8f9fedaa75674945ab3cc30ff750a07b95c0f3359359ee3109cea', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 15, 14, 35, 48, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 15, 14, 33, 52, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.197', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'homer-74dd4556d9-ns72d', 'generateName': 'homer-74dd4556d9-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/homer-74dd4556d9-ns72d', 'uid': '036d6f91-24da-4adf-a0e8-5a78e1e91ddc', 'resourceVersion': '1042027', 'creationTimestamp': '2020-07-15T14:33:39Z', 'labels': {'pod-template-hash': '74dd4556d9', 'service': 'homer'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'homer-74dd4556d9', 'uid': '1e7dbcef-264a-4e3e-b48c-27a0b9e667ed', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homer', 'image': 'ollivier/clearwater-homer:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'tcpSocket': {'port': 7888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 7888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:35:49Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:36:14Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:36:14Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:33:39Z'}], 'hostIP': '172.18.0.9', 'podIP': '10.244.2.197', 'startTime': '2020-07-15T14:33:39Z', 'initContainerStatuses': [{'name': 'wait-on-cassandra', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-15T14:33:52Z', 'finishedAt': '2020-07-15T14:35:48Z', 'containerID': 'containerd://12e0703691b8f9fedaa75674945ab3cc30ff750a07b95c0f3359359ee3109cea'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://12e0703691b8f9fedaa75674945ab3cc30ff750a07b95c0f3359359ee3109cea'}], 'containerStatuses': [{'name': 'homer', 'state': {'running': {'startedAt': '2020-07-15T14:35:57Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-homer:latest', 'imageID': 'docker.io/ollivier/clearwater-homer@sha256:69b5406c3dcf61c95a067571c873b8691dc7cb23b24dbe3749b0a1d2b7c08ca9', 'containerID': 'containerd://f70ce8416a0b1715ed79167a52c61b98c81498c731f018371cdb0d2fcbcba5b5'}], 'qosClass': 'BestEffort'}}} 2020-07-15 14:38:34,473 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 40, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'ralf-57c4654cb8-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '57c4654cb8', 'service': 'ralf', 'snmp': 'enabled'}, 'managed_fields': None, 'name': 'ralf-57c4654cb8-lq7q9', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'ralf-57c4654cb8', 'uid': 'b58c0e70-37ed-45bc-9972-9501c7aaa267'}], 'resource_version': '1042066', 'self_link': '/api/v1/namespaces/default/pods/ralf-57c4654cb8-lq7q9', 'uid': '248915f0-702a-4228-aabf-de8e7f63af3a'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-ralf:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'name': 'ralf', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 10888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup cassandra; do echo ' 'waiting for cassandra to start ' '...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'ralflogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}, {'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 35, 48, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 36, 23, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 36, 23, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 40, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://b4a807731c22a8e2a1fef557a99445b984935df4f0cf7dc028cb22ba4fe08b6b', 'image': 'docker.io/ollivier/clearwater-ralf:latest', 'image_id': 'docker.io/ollivier/clearwater-ralf@sha256:becf37bf5c8d9f81189d9d727c3c3ab7e032b7de3a710f7bbb264d35d442a344', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'ralf', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 15, 14, 36, 5, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}, {'container_id': 'containerd://154ef366f9f99b7010081bdebd4dddb18b503d00bf1b69432784888ecd12f11c', 'image': 'docker.io/library/busybox:latest', 'image_id': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'tailer', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 15, 14, 36, 14, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.5', 'init_container_statuses': [{'container_id': 'containerd://2a1509e95b5406328d618161a81c93a5e7b24ca167bc5287b40f692521ac6a04', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-cassandra', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://2a1509e95b5406328d618161a81c93a5e7b24ca167bc5287b40f692521ac6a04', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 15, 14, 35, 47, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 15, 14, 33, 50, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.42', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 15, 14, 33, 40, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'ralf-57c4654cb8-lq7q9', 'generateName': 'ralf-57c4654cb8-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/ralf-57c4654cb8-lq7q9', 'uid': '248915f0-702a-4228-aabf-de8e7f63af3a', 'resourceVersion': '1042066', 'creationTimestamp': '2020-07-15T14:33:40Z', 'labels': {'pod-template-hash': '57c4654cb8', 'service': 'ralf', 'snmp': 'enabled'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'ralf-57c4654cb8', 'uid': 'b58c0e70-37ed-45bc-9972-9501c7aaa267', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'ralflogs', 'emptyDir': {}}, {'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'ralf', 'image': 'ollivier/clearwater-ralf:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 10888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}, {'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'tcpSocket': {'port': 10888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 10888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}, {'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:35:48Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:36:23Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:36:23Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:33:40Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.42', 'startTime': '2020-07-15T14:33:40Z', 'initContainerStatuses': [{'name': 'wait-on-cassandra', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-15T14:33:50Z', 'finishedAt': '2020-07-15T14:35:47Z', 'containerID': 'containerd://2a1509e95b5406328d618161a81c93a5e7b24ca167bc5287b40f692521ac6a04'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://2a1509e95b5406328d618161a81c93a5e7b24ca167bc5287b40f692521ac6a04'}], 'containerStatuses': [{'name': 'ralf', 'state': {'running': {'startedAt': '2020-07-15T14:36:05Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-ralf:latest', 'imageID': 'docker.io/ollivier/clearwater-ralf@sha256:becf37bf5c8d9f81189d9d727c3c3ab7e032b7de3a710f7bbb264d35d442a344', 'containerID': 'containerd://b4a807731c22a8e2a1fef557a99445b984935df4f0cf7dc028cb22ba4fe08b6b'}, {'name': 'tailer', 'state': {'running': {'startedAt': '2020-07-15T14:36:14Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:latest', 'imageID': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'containerID': 'containerd://154ef366f9f99b7010081bdebd4dddb18b503d00bf1b69432784888ecd12f11c'}], 'qosClass': 'BestEffort'}}} 2020-07-15 14:38:34,502 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'ellis-57b84b6dd7-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '57b84b6dd7', 'service': 'ellis'}, 'managed_fields': None, 'name': 'ellis-57b84b6dd7-7nmg7', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'ellis-57b84b6dd7', 'uid': 'c10e914d-f66a-42c8-b519-32aa3fa28c40'}], 'resource_version': '1042428', 'self_link': '/api/v1/namespaces/default/pods/ellis-57b84b6dd7-7nmg7', 'uid': '85b3c589-22bd-4413-ab6d-546f3f635dcf'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-ellis:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 80}, 'timeout_seconds': 1}, 'name': 'ellis', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 80, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 80}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup homestead-prov; do ' 'echo waiting for homestead-prov to ' 'start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead-prov', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until nslookup sprout; do echo ' 'waiting for sprout to start ...; ' 'sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'iruya-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 38, 14, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 38, 34, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 38, 34, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://ea62e56f5053b65b1f4a95962d0a944b2d1dd4d4cae34c5a11641560b867f223', 'image': 'docker.io/ollivier/clearwater-ellis:latest', 'image_id': 'docker.io/ollivier/clearwater-ellis@sha256:ba47a8963e0683886890de11cf65942f3460ec4e2ad313f1e0fe0d144b12969b', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'ellis', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 15, 14, 38, 20, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.9', 'init_container_statuses': [{'container_id': 'containerd://f45182d1caeaae7bc90a4ee64014529997c2ab72e3a8ed07a2d87e4dd95bdd2b', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-homestead-prov', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://f45182d1caeaae7bc90a4ee64014529997c2ab72e3a8ed07a2d87e4dd95bdd2b', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 15, 14, 38, 10, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 15, 14, 33, 51, tzinfo=tzlocal())}, 'waiting': None}}, {'container_id': 'containerd://02ed2ca5ac3d12a8dd81b888fd7276d15ec87dfe267c4adee5de073037b0f442', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-sprout', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://02ed2ca5ac3d12a8dd81b888fd7276d15ec87dfe267c4adee5de073037b0f442', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 15, 14, 38, 14, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 15, 14, 38, 14, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.196', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'ellis-57b84b6dd7-7nmg7', 'generateName': 'ellis-57b84b6dd7-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/ellis-57b84b6dd7-7nmg7', 'uid': '85b3c589-22bd-4413-ab6d-546f3f635dcf', 'resourceVersion': '1042428', 'creationTimestamp': '2020-07-15T14:33:39Z', 'labels': {'pod-template-hash': '57b84b6dd7', 'service': 'ellis'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'ellis-57b84b6dd7', 'uid': 'c10e914d-f66a-42c8-b519-32aa3fa28c40', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-homestead-prov', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead-prov; do echo waiting for homestead-prov to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'ellis', 'image': 'ollivier/clearwater-ellis:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 80, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'tcpSocket': {'port': 80}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 80}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:38:14Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:38:34Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:38:34Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:33:39Z'}], 'hostIP': '172.18.0.9', 'podIP': '10.244.2.196', 'startTime': '2020-07-15T14:33:39Z', 'initContainerStatuses': [{'name': 'wait-on-homestead-prov', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-15T14:33:51Z', 'finishedAt': '2020-07-15T14:38:10Z', 'containerID': 'containerd://f45182d1caeaae7bc90a4ee64014529997c2ab72e3a8ed07a2d87e4dd95bdd2b'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://f45182d1caeaae7bc90a4ee64014529997c2ab72e3a8ed07a2d87e4dd95bdd2b'}, {'name': 'wait-on-sprout', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-15T14:38:14Z', 'finishedAt': '2020-07-15T14:38:14Z', 'containerID': 'containerd://02ed2ca5ac3d12a8dd81b888fd7276d15ec87dfe267c4adee5de073037b0f442'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://02ed2ca5ac3d12a8dd81b888fd7276d15ec87dfe267c4adee5de073037b0f442'}], 'containerStatuses': [{'name': 'ellis', 'state': {'running': {'startedAt': '2020-07-15T14:38:20Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-ellis:latest', 'imageID': 'docker.io/ollivier/clearwater-ellis@sha256:ba47a8963e0683886890de11cf65942f3460ec4e2ad313f1e0fe0d144b12969b', 'containerID': 'containerd://ea62e56f5053b65b1f4a95962d0a944b2d1dd4d4cae34c5a11641560b867f223'}], 'qosClass': 'BestEffort'}}} 2020-07-15 14:38:34,527 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': {'kubectl.kubernetes.io/last-applied-configuration': '{"apiVersion":"v1","kind":"Pod","metadata":{"annotations":{},"name":"dnsutils","namespace":"default"},"spec":{"containers":[{"command":["sleep","3600"],"image":"gcr.io/kubernetes-e2e-test-images/dnsutils:1.3","imagePullPolicy":"IfNotPresent","name":"dnsutils"}],"restartPolicy":"Always"}}\n'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 15, 11, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'dnsutils', 'namespace': 'default', 'owner_references': None, 'resource_version': '1038034', 'self_link': '/api/v1/namespaces/default/pods/dnsutils', 'uid': '5f3dcdb1-f6e7-4927-af74-aea6ae677366'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': ['sleep', '3600'], 'env': None, 'env_from': None, 'image': 'gcr.io/kubernetes-e2e-test-images/dnsutils:1.3', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'dnsutils', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 15, 11, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 21, 6, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 21, 6, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 15, 11, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://8f2afd616641c50440e42eb08a33d384e5d0469135adba0c04d2d5b0c8165c20', 'image': 'gcr.io/kubernetes-e2e-test-images/dnsutils:1.3', 'image_id': 'gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:b31bcf7ef4420ce7108e7fc10b6c00343b21257c945eec94c21598e72a8f2de0', 'last_state': {'running': None, 'terminated': {'container_id': 'containerd://d613405fd0dfc6384c98476114dcf19e845f8592089e605cce2c86d4d107f1a3', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 15, 14, 21, 2, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 15, 13, 21, 2, tzinfo=tzlocal())}, 'waiting': None}, 'name': 'dnsutils', 'ready': True, 'restart_count': 123, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 15, 14, 21, 6, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.9', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.10', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 10, 11, 15, 11, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'dnsutils', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/dnsutils', 'uid': '5f3dcdb1-f6e7-4927-af74-aea6ae677366', 'resourceVersion': '1038034', 'creationTimestamp': '2020-07-10T11:15:11Z', 'annotations': {'kubectl.kubernetes.io/last-applied-configuration': '{"apiVersion":"v1","kind":"Pod","metadata":{"annotations":{},"name":"dnsutils","namespace":"default"},"spec":{"containers":[{"command":["sleep","3600"],"image":"gcr.io/kubernetes-e2e-test-images/dnsutils:1.3","imagePullPolicy":"IfNotPresent","name":"dnsutils"}],"restartPolicy":"Always"}}\n'}}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'containers': [{'name': 'dnsutils', 'image': 'gcr.io/kubernetes-e2e-test-images/dnsutils:1.3', 'command': ['sleep', '3600'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:15:11Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:21:06Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:21:06Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:15:11Z'}], 'hostIP': '172.18.0.9', 'podIP': '10.244.2.10', 'startTime': '2020-07-10T11:15:11Z', 'containerStatuses': [{'name': 'dnsutils', 'state': {'running': {'startedAt': '2020-07-15T14:21:06Z'}}, 'lastState': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-15T13:21:02Z', 'finishedAt': '2020-07-15T14:21:02Z', 'containerID': 'containerd://d613405fd0dfc6384c98476114dcf19e845f8592089e605cce2c86d4d107f1a3'}}, 'ready': True, 'restartCount': 123, 'image': 'gcr.io/kubernetes-e2e-test-images/dnsutils:1.3', 'imageID': 'gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:b31bcf7ef4420ce7108e7fc10b6c00343b21257c945eec94c21598e72a8f2de0', 'containerID': 'containerd://8f2afd616641c50440e42eb08a33d384e5d0469135adba0c04d2d5b0c8165c20'}], 'qosClass': 'BestEffort'}}} 2020-07-15 14:38:34,541 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 56, 7, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'live-test8-55669b464c-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '55669b464c', 'run': 'live-test8'}, 'managed_fields': None, 'name': 'live-test8-55669b464c-bfdv5', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'live-test8-55669b464c', 'uid': 'ad220e2e-5b9d-4afe-a31a-f4f88934319e'}], 'resource_version': '1042229', 'self_link': '/api/v1/namespaces/default/pods/live-test8-55669b464c-bfdv5', 'uid': '1342c639-efa4-418e-a3fa-40ead49ad29f'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test8', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 56, 7, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 37, 7, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test8]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 37, 7, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test8]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 56, 7, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://faaca1ef398cd8fe29b5c18c98c90d7ac875bb069b2a1a14ae8c499af8a28436', 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'image_id': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'last_state': {'running': None, 'terminated': {'container_id': 'containerd://faaca1ef398cd8fe29b5c18c98c90d7ac875bb069b2a1a14ae8c499af8a28436', 'exit_code': 1, 'finished_at': datetime.datetime(2020, 7, 15, 14, 37, 6, tzinfo=tzlocal()), 'message': None, 'reason': 'Error', 'signal': None, 'started_at': datetime.datetime(2020, 7, 15, 14, 37, 5, tzinfo=tzlocal())}, 'waiting': None}, 'name': 'live-test8', 'ready': False, 'restart_count': 1418, 'state': {'running': None, 'terminated': None, 'waiting': {'message': 'Back-off ' '5m0s ' 'restarting ' 'failed ' 'container=live-test8 ' 'pod=live-test8-55669b464c-bfdv5_default(1342c639-efa4-418e-a3fa-40ead49ad29f)', 'reason': 'CrashLoopBackOff'}}}], 'host_ip': '172.18.0.5', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.12', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 10, 11, 56, 7, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test8-55669b464c-bfdv5', 'generateName': 'live-test8-55669b464c-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test8-55669b464c-bfdv5', 'uid': '1342c639-efa4-418e-a3fa-40ead49ad29f', 'resourceVersion': '1042229', 'creationTimestamp': '2020-07-10T11:56:07Z', 'labels': {'pod-template-hash': '55669b464c', 'run': 'live-test8'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'live-test8-55669b464c', 'uid': 'ad220e2e-5b9d-4afe-a31a-f4f88934319e', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'containers': [{'name': 'live-test8', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:56:07Z'}, {'type': 'Ready', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:37:07Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test8]'}, {'type': 'ContainersReady', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:37:07Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test8]'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:56:07Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.12', 'startTime': '2020-07-10T11:56:07Z', 'containerStatuses': [{'name': 'live-test8', 'state': {'waiting': {'reason': 'CrashLoopBackOff', 'message': 'Back-off 5m0s restarting failed container=live-test8 pod=live-test8-55669b464c-bfdv5_default(1342c639-efa4-418e-a3fa-40ead49ad29f)'}}, 'lastState': {'terminated': {'exitCode': 1, 'reason': 'Error', 'startedAt': '2020-07-15T14:37:05Z', 'finishedAt': '2020-07-15T14:37:06Z', 'containerID': 'containerd://faaca1ef398cd8fe29b5c18c98c90d7ac875bb069b2a1a14ae8c499af8a28436'}}, 'ready': False, 'restartCount': 1418, 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'imageID': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'containerID': 'containerd://faaca1ef398cd8fe29b5c18c98c90d7ac875bb069b2a1a14ae8c499af8a28436'}], 'qosClass': 'BestEffort'}}} 2020-07-15 14:38:34,565 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'chronos-687b9884c5-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '687b9884c5', 'service': 'chronos'}, 'managed_fields': None, 'name': 'chronos-687b9884c5-vk626', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'chronos-687b9884c5', 'uid': '2c6f3c11-309c-465b-ad74-4662fe9291b1'}], 'resource_version': '1042052', 'self_link': '/api/v1/namespaces/default/pods/chronos-687b9884c5-vk626', 'uid': '05c21374-3375-46f7-a67c-3aa7ab73117e'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-chronos:latest', 'image_pull_policy': 'Always', 'lifecycle': {'post_start': None, 'pre_stop': {'_exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}, 'http_get': None, 'tcp_socket': None}}, 'liveness_probe': {'_exec': None, 'failure_threshold': 9, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7253}, 'timeout_seconds': 1}, 'name': 'chronos', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7253, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7253}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/chronos', 'mount_propagation': None, 'name': 'chronoslogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/chronos/chronos_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/chronos', 'mount_propagation': None, 'name': 'chronoslogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup cassandra; do echo ' 'waiting for cassandra to start ' '...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 120, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'chronoslogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}, {'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 35, 51, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 36, 19, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 36, 19, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://5c55d49022df5f914bf90c9b1d4bc49e9c61de392efe737016cf915048f6316b', 'image': 'docker.io/ollivier/clearwater-chronos:latest', 'image_id': 'docker.io/ollivier/clearwater-chronos@sha256:83359fb6320eefc0adbf56fcd4eb7a19be2c53dadaa4944a20510cc761536222', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'chronos', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 15, 14, 36, 11, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}, {'container_id': 'containerd://98834c93a1f49cda53241256008b74da0dbb07a30805b69b174ed8e22d79ed68', 'image': 'docker.io/library/busybox:latest', 'image_id': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'tailer', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 15, 14, 36, 17, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.5', 'init_container_statuses': [{'container_id': 'containerd://4ad9df150ae8b565ca8c6de1fb9f2fb4b587d0c4f6dc4953df2abdf6361968f2', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-cassandra', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://4ad9df150ae8b565ca8c6de1fb9f2fb4b587d0c4f6dc4953df2abdf6361968f2', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 15, 14, 35, 50, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 15, 14, 33, 48, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.40', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'chronos-687b9884c5-vk626', 'generateName': 'chronos-687b9884c5-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/chronos-687b9884c5-vk626', 'uid': '05c21374-3375-46f7-a67c-3aa7ab73117e', 'resourceVersion': '1042052', 'creationTimestamp': '2020-07-15T14:33:39Z', 'labels': {'pod-template-hash': '687b9884c5', 'service': 'chronos'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'chronos-687b9884c5', 'uid': '2c6f3c11-309c-465b-ad74-4662fe9291b1', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'chronoslogs', 'emptyDir': {}}, {'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'chronos', 'image': 'ollivier/clearwater-chronos:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7253, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'chronoslogs', 'mountPath': '/var/log/chronos'}, {'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'tcpSocket': {'port': 7253}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 9}, 'readinessProbe': {'tcpSocket': {'port': 7253}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'lifecycle': {'preStop': {'exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}}}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/chronos/chronos_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'chronoslogs', 'mountPath': '/var/log/chronos'}, {'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 120, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:35:51Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:36:19Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:36:19Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:33:39Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.40', 'startTime': '2020-07-15T14:33:39Z', 'initContainerStatuses': [{'name': 'wait-on-cassandra', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-15T14:33:48Z', 'finishedAt': '2020-07-15T14:35:50Z', 'containerID': 'containerd://4ad9df150ae8b565ca8c6de1fb9f2fb4b587d0c4f6dc4953df2abdf6361968f2'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://4ad9df150ae8b565ca8c6de1fb9f2fb4b587d0c4f6dc4953df2abdf6361968f2'}], 'containerStatuses': [{'name': 'chronos', 'state': {'running': {'startedAt': '2020-07-15T14:36:11Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-chronos:latest', 'imageID': 'docker.io/ollivier/clearwater-chronos@sha256:83359fb6320eefc0adbf56fcd4eb7a19be2c53dadaa4944a20510cc761536222', 'containerID': 'containerd://5c55d49022df5f914bf90c9b1d4bc49e9c61de392efe737016cf915048f6316b'}, {'name': 'tailer', 'state': {'running': {'startedAt': '2020-07-15T14:36:17Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:latest', 'imageID': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'containerID': 'containerd://98834c93a1f49cda53241256008b74da0dbb07a30805b69b174ed8e22d79ed68'}], 'qosClass': 'BestEffort'}}} 2020-07-15 14:38:34,595 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 38, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'live-test', 'namespace': 'default', 'owner_references': None, 'resource_version': '1042432', 'self_link': '/api/v1/namespaces/default/pods/live-test', 'uid': '827f6280-d43a-4fb7-8090-2db194596010'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Never', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': None, 'container_statuses': None, 'host_ip': None, 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Pending', 'pod_ip': None, 'qos_class': 'BestEffort', 'reason': None, 'start_time': None}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test', 'uid': '827f6280-d43a-4fb7-8090-2db194596010', 'resourceVersion': '1042432', 'creationTimestamp': '2020-07-15T14:38:34Z'}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'containers': [{'name': 'live-test', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Never', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Pending', 'qosClass': 'BestEffort'}}} 2020-07-15 14:38:34,605 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'cassandra-76f5c4d86c-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '76f5c4d86c', 'service': 'cassandra'}, 'managed_fields': None, 'name': 'cassandra-76f5c4d86c-8l4tt', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'cassandra-76f5c4d86c', 'uid': 'e0727c54-a0ed-4890-a462-40ea3bd058f1'}], 'resource_version': '1041889', 'self_link': '/api/v1/namespaces/default/pods/cassandra-76f5c4d86c-8l4tt', 'uid': '338fa0cf-7fd1-4b69-8439-98ecfb9cb47d'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-cassandra:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 ' '9160']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 600, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'cassandra', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7001, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 9042, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 9160, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 ' '9160']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup etcd; do echo ' 'waiting for etcd to start ...; ' 'sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-etcd', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'iruya-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 34, 24, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 35, 29, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 35, 29, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://d6285d41c034bc7b260ca6b490e879add4bece591fcf9273596a03f9c34c6f56', 'image': 'docker.io/ollivier/clearwater-cassandra:latest', 'image_id': 'docker.io/ollivier/clearwater-cassandra@sha256:24f49e5e936930e808cd79cac72fd4f2dc87e97b33a9dedecf60d0eb1f655015', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'cassandra', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 15, 14, 34, 29, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.9', 'init_container_statuses': [{'container_id': 'containerd://31b2bd5c851e1eea4b99841d7c25f9c4a1b4e5cb481733edeaa45948efdcb1a1', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-etcd', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://31b2bd5c851e1eea4b99841d7c25f9c4a1b4e5cb481733edeaa45948efdcb1a1', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 15, 14, 34, 23, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 15, 14, 33, 49, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.195', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'cassandra-76f5c4d86c-8l4tt', 'generateName': 'cassandra-76f5c4d86c-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/cassandra-76f5c4d86c-8l4tt', 'uid': '338fa0cf-7fd1-4b69-8439-98ecfb9cb47d', 'resourceVersion': '1041889', 'creationTimestamp': '2020-07-15T14:33:39Z', 'labels': {'pod-template-hash': '76f5c4d86c', 'service': 'cassandra'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'cassandra-76f5c4d86c', 'uid': 'e0727c54-a0ed-4890-a462-40ea3bd058f1', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-etcd', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup etcd; do echo waiting for etcd to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'cassandra', 'image': 'ollivier/clearwater-cassandra:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7001, 'protocol': 'TCP'}, {'containerPort': 9042, 'protocol': 'TCP'}, {'containerPort': 9160, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 9160']}, 'initialDelaySeconds': 600, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 9160']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:34:24Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:35:29Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:35:29Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:33:39Z'}], 'hostIP': '172.18.0.9', 'podIP': '10.244.2.195', 'startTime': '2020-07-15T14:33:39Z', 'initContainerStatuses': [{'name': 'wait-on-etcd', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-15T14:33:49Z', 'finishedAt': '2020-07-15T14:34:23Z', 'containerID': 'containerd://31b2bd5c851e1eea4b99841d7c25f9c4a1b4e5cb481733edeaa45948efdcb1a1'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://31b2bd5c851e1eea4b99841d7c25f9c4a1b4e5cb481733edeaa45948efdcb1a1'}], 'containerStatuses': [{'name': 'cassandra', 'state': {'running': {'startedAt': '2020-07-15T14:34:29Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-cassandra:latest', 'imageID': 'docker.io/ollivier/clearwater-cassandra@sha256:24f49e5e936930e808cd79cac72fd4f2dc87e97b33a9dedecf60d0eb1f655015', 'containerID': 'containerd://d6285d41c034bc7b260ca6b490e879add4bece591fcf9273596a03f9c34c6f56'}], 'qosClass': 'BestEffort'}}} 2020-07-15 14:38:34,627 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 2, 2, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'live-test4-74f5c7c95f-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '74f5c7c95f', 'run': 'live-test4'}, 'managed_fields': None, 'name': 'live-test4-74f5c7c95f-l2676', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'live-test4-74f5c7c95f', 'uid': '861a4ee1-16fa-4c8d-86da-15bb8159067e'}], 'resource_version': '1042154', 'self_link': '/api/v1/namespaces/default/pods/live-test4-74f5c7c95f-l2676', 'uid': '301c5bc5-7f5e-4120-9234-6495475466bb'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test4', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 2, 3, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 36, 42, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test4]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 36, 42, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test4]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 2, 2, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://f40ec47c4731b149426e52d6cb8e04f176376de68c1f95c59cf5080330f4b7b5', 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'image_id': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'last_state': {'running': None, 'terminated': {'container_id': 'containerd://f40ec47c4731b149426e52d6cb8e04f176376de68c1f95c59cf5080330f4b7b5', 'exit_code': 1, 'finished_at': datetime.datetime(2020, 7, 15, 14, 36, 41, tzinfo=tzlocal()), 'message': None, 'reason': 'Error', 'signal': None, 'started_at': datetime.datetime(2020, 7, 15, 14, 36, 40, tzinfo=tzlocal())}, 'waiting': None}, 'name': 'live-test4', 'ready': False, 'restart_count': 1431, 'state': {'running': None, 'terminated': None, 'waiting': {'message': 'Back-off ' '5m0s ' 'restarting ' 'failed ' 'container=live-test4 ' 'pod=live-test4-74f5c7c95f-l2676_default(301c5bc5-7f5e-4120-9234-6495475466bb)', 'reason': 'CrashLoopBackOff'}}}], 'host_ip': '172.18.0.9', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.9', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 10, 11, 2, 3, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test4-74f5c7c95f-l2676', 'generateName': 'live-test4-74f5c7c95f-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test4-74f5c7c95f-l2676', 'uid': '301c5bc5-7f5e-4120-9234-6495475466bb', 'resourceVersion': '1042154', 'creationTimestamp': '2020-07-10T11:02:02Z', 'labels': {'pod-template-hash': '74f5c7c95f', 'run': 'live-test4'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'live-test4-74f5c7c95f', 'uid': '861a4ee1-16fa-4c8d-86da-15bb8159067e', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'containers': [{'name': 'live-test4', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:02:03Z'}, {'type': 'Ready', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:36:42Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test4]'}, {'type': 'ContainersReady', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:36:42Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test4]'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:02:02Z'}], 'hostIP': '172.18.0.9', 'podIP': '10.244.2.9', 'startTime': '2020-07-10T11:02:03Z', 'containerStatuses': [{'name': 'live-test4', 'state': {'waiting': {'reason': 'CrashLoopBackOff', 'message': 'Back-off 5m0s restarting failed container=live-test4 pod=live-test4-74f5c7c95f-l2676_default(301c5bc5-7f5e-4120-9234-6495475466bb)'}}, 'lastState': {'terminated': {'exitCode': 1, 'reason': 'Error', 'startedAt': '2020-07-15T14:36:40Z', 'finishedAt': '2020-07-15T14:36:41Z', 'containerID': 'containerd://f40ec47c4731b149426e52d6cb8e04f176376de68c1f95c59cf5080330f4b7b5'}}, 'ready': False, 'restartCount': 1431, 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'imageID': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'containerID': 'containerd://f40ec47c4731b149426e52d6cb8e04f176376de68c1f95c59cf5080330f4b7b5'}], 'qosClass': 'BestEffort'}}} 2020-07-15 14:38:34,644 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 40, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'sprout-686cc64cfb-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '686cc64cfb', 'service': 'sprout', 'snmp': 'enabled'}, 'managed_fields': None, 'name': 'sprout-686cc64cfb-l6tvp', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'sprout-686cc64cfb', 'uid': 'a4d2e13b-1fde-4c22-b762-bb9977ced412'}], 'resource_version': '1042295', 'self_link': '/api/v1/namespaces/default/pods/sprout-686cc64cfb-l6tvp', 'uid': '1293b19d-f9a1-4f8f-b9ed-3b7759361b25'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-sprout:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 3, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'sprout', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup ralf; do echo ' 'waiting for ralf to start ...; ' 'sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-ralf', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until nslookup chronos; do echo ' 'waiting for chronos to start ...; ' 'sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-chronos', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until nslookup homestead; do echo ' 'waiting for homestead to start ' '...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'iruya-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'sproutlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}, {'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 37, 30, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 37, 44, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 37, 44, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 40, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://41882a2f1c03e59e7305cd3f8ad59831eab5ec9d6d16d0e31c7425bfd5cdcc7b', 'image': 'docker.io/ollivier/clearwater-sprout:latest', 'image_id': 'docker.io/ollivier/clearwater-sprout@sha256:5a833832419bcf25ea1044768038c885ed4bad73225d5d07fc54eebc2a56662b', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'sprout', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 15, 14, 37, 35, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}, {'container_id': 'containerd://8f397f85070d378c112c15e6f83d27c5cfbd58f0e5a4a633321ae366463bec63', 'image': 'docker.io/library/busybox:latest', 'image_id': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'tailer', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 15, 14, 37, 40, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.9', 'init_container_statuses': [{'container_id': 'containerd://24b37c4f1c924db48a5e245109ec670bb0a39a4a1dabfc176ae418b4cebac8db', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-ralf', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://24b37c4f1c924db48a5e245109ec670bb0a39a4a1dabfc176ae418b4cebac8db', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 15, 14, 36, 31, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 15, 14, 33, 52, tzinfo=tzlocal())}, 'waiting': None}}, {'container_id': 'containerd://a84cfe2dc8518100bc47b5c12f884c5c01fa896ff6f90c5f9c089dc688e5f893', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-chronos', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://a84cfe2dc8518100bc47b5c12f884c5c01fa896ff6f90c5f9c089dc688e5f893', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 15, 14, 36, 34, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 15, 14, 36, 34, tzinfo=tzlocal())}, 'waiting': None}}, {'container_id': 'containerd://c7dbc210221dac2aee9134344e7e9aa155821b2a9d1d45a49b0285465a45b7a1', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-homestead', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://c7dbc210221dac2aee9134344e7e9aa155821b2a9d1d45a49b0285465a45b7a1', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 15, 14, 37, 29, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 15, 14, 36, 37, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.200', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 15, 14, 33, 40, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'sprout-686cc64cfb-l6tvp', 'generateName': 'sprout-686cc64cfb-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/sprout-686cc64cfb-l6tvp', 'uid': '1293b19d-f9a1-4f8f-b9ed-3b7759361b25', 'resourceVersion': '1042295', 'creationTimestamp': '2020-07-15T14:33:40Z', 'labels': {'pod-template-hash': '686cc64cfb', 'service': 'sprout', 'snmp': 'enabled'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'sprout-686cc64cfb', 'uid': 'a4d2e13b-1fde-4c22-b762-bb9977ced412', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'sproutlogs', 'emptyDir': {}}, {'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-ralf', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup ralf; do echo waiting for ralf to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-chronos', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup chronos; do echo waiting for chronos to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-homestead', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'sprout', 'image': 'ollivier/clearwater-sprout:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}, {'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 3, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}, {'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:37:30Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:37:44Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:37:44Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:33:40Z'}], 'hostIP': '172.18.0.9', 'podIP': '10.244.2.200', 'startTime': '2020-07-15T14:33:40Z', 'initContainerStatuses': [{'name': 'wait-on-ralf', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-15T14:33:52Z', 'finishedAt': '2020-07-15T14:36:31Z', 'containerID': 'containerd://24b37c4f1c924db48a5e245109ec670bb0a39a4a1dabfc176ae418b4cebac8db'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://24b37c4f1c924db48a5e245109ec670bb0a39a4a1dabfc176ae418b4cebac8db'}, {'name': 'wait-on-chronos', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-15T14:36:34Z', 'finishedAt': '2020-07-15T14:36:34Z', 'containerID': 'containerd://a84cfe2dc8518100bc47b5c12f884c5c01fa896ff6f90c5f9c089dc688e5f893'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://a84cfe2dc8518100bc47b5c12f884c5c01fa896ff6f90c5f9c089dc688e5f893'}, {'name': 'wait-on-homestead', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-15T14:36:37Z', 'finishedAt': '2020-07-15T14:37:29Z', 'containerID': 'containerd://c7dbc210221dac2aee9134344e7e9aa155821b2a9d1d45a49b0285465a45b7a1'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://c7dbc210221dac2aee9134344e7e9aa155821b2a9d1d45a49b0285465a45b7a1'}], 'containerStatuses': [{'name': 'sprout', 'state': {'running': {'startedAt': '2020-07-15T14:37:35Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-sprout:latest', 'imageID': 'docker.io/ollivier/clearwater-sprout@sha256:5a833832419bcf25ea1044768038c885ed4bad73225d5d07fc54eebc2a56662b', 'containerID': 'containerd://41882a2f1c03e59e7305cd3f8ad59831eab5ec9d6d16d0e31c7425bfd5cdcc7b'}, {'name': 'tailer', 'state': {'running': {'startedAt': '2020-07-15T14:37:40Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:latest', 'imageID': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'containerID': 'containerd://8f397f85070d378c112c15e6f83d27c5cfbd58f0e5a4a633321ae366463bec63'}], 'qosClass': 'BestEffort'}}} 2020-07-15 14:38:34,679 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 22, 41, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'live-test6-988dbb567-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '988dbb567', 'run': 'live-test6'}, 'managed_fields': None, 'name': 'live-test6-988dbb567-rqc7x', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'live-test6-988dbb567', 'uid': '2aefcc7f-ce12-4f7f-a4a9-a58b67a26778'}], 'resource_version': '1042074', 'self_link': '/api/v1/namespaces/default/pods/live-test6-988dbb567-rqc7x', 'uid': 'd3a4086d-f6c3-49ab-8e6d-e47e0c9accc6'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test6', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 22, 41, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 36, 10, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test6]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 36, 10, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test6]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 22, 41, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://83dadc93b83c0103754f13d7d421a936e10df756da6ce935f7cee2cf48525810', 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'image_id': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'last_state': {'running': None, 'terminated': {'container_id': 'containerd://83dadc93b83c0103754f13d7d421a936e10df756da6ce935f7cee2cf48525810', 'exit_code': 1, 'finished_at': datetime.datetime(2020, 7, 15, 14, 36, 8, tzinfo=tzlocal()), 'message': None, 'reason': 'Error', 'signal': None, 'started_at': datetime.datetime(2020, 7, 15, 14, 36, 7, tzinfo=tzlocal())}, 'waiting': None}, 'name': 'live-test6', 'ready': False, 'restart_count': 1429, 'state': {'running': None, 'terminated': None, 'waiting': {'message': 'Back-off ' '5m0s ' 'restarting ' 'failed ' 'container=live-test6 ' 'pod=live-test6-988dbb567-rqc7x_default(d3a4086d-f6c3-49ab-8e6d-e47e0c9accc6)', 'reason': 'CrashLoopBackOff'}}}], 'host_ip': '172.18.0.5', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.11', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 10, 11, 22, 41, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test6-988dbb567-rqc7x', 'generateName': 'live-test6-988dbb567-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test6-988dbb567-rqc7x', 'uid': 'd3a4086d-f6c3-49ab-8e6d-e47e0c9accc6', 'resourceVersion': '1042074', 'creationTimestamp': '2020-07-10T11:22:41Z', 'labels': {'pod-template-hash': '988dbb567', 'run': 'live-test6'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'live-test6-988dbb567', 'uid': '2aefcc7f-ce12-4f7f-a4a9-a58b67a26778', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'containers': [{'name': 'live-test6', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:22:41Z'}, {'type': 'Ready', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:36:10Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test6]'}, {'type': 'ContainersReady', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:36:10Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test6]'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:22:41Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.11', 'startTime': '2020-07-10T11:22:41Z', 'containerStatuses': [{'name': 'live-test6', 'state': {'waiting': {'reason': 'CrashLoopBackOff', 'message': 'Back-off 5m0s restarting failed container=live-test6 pod=live-test6-988dbb567-rqc7x_default(d3a4086d-f6c3-49ab-8e6d-e47e0c9accc6)'}}, 'lastState': {'terminated': {'exitCode': 1, 'reason': 'Error', 'startedAt': '2020-07-15T14:36:07Z', 'finishedAt': '2020-07-15T14:36:08Z', 'containerID': 'containerd://83dadc93b83c0103754f13d7d421a936e10df756da6ce935f7cee2cf48525810'}}, 'ready': False, 'restartCount': 1429, 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'imageID': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'containerID': 'containerd://83dadc93b83c0103754f13d7d421a936e10df756da6ce935f7cee2cf48525810'}], 'qosClass': 'BestEffort'}}} 2020-07-15 14:38:34,696 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 10, 49, 37, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'live-test1-677ffc8869-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '677ffc8869', 'run': 'live-test1'}, 'managed_fields': None, 'name': 'live-test1-677ffc8869-nvdk5', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'live-test1-677ffc8869', 'uid': '8c0ead0e-0e53-4e6d-a864-b65ad37c5c18'}], 'resource_version': '1041595', 'self_link': '/api/v1/namespaces/default/pods/live-test1-677ffc8869-nvdk5', 'uid': '1bb35f10-321a-4dd0-b5dd-59488a1537c5'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test1', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 10, 49, 37, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 27, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test1]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 27, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test1]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 10, 49, 37, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://df5567780351cc44cff2a475e7647fa3b253b4aeec90bce02dfb9a16bb9e5caf', 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'image_id': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'last_state': {'running': None, 'terminated': {'container_id': 'containerd://df5567780351cc44cff2a475e7647fa3b253b4aeec90bce02dfb9a16bb9e5caf', 'exit_code': 1, 'finished_at': datetime.datetime(2020, 7, 15, 14, 33, 26, tzinfo=tzlocal()), 'message': None, 'reason': 'Error', 'signal': None, 'started_at': datetime.datetime(2020, 7, 15, 14, 33, 25, tzinfo=tzlocal())}, 'waiting': None}, 'name': 'live-test1', 'ready': False, 'restart_count': 1431, 'state': {'running': None, 'terminated': None, 'waiting': {'message': 'Back-off ' '5m0s ' 'restarting ' 'failed ' 'container=live-test1 ' 'pod=live-test1-677ffc8869-nvdk5_default(1bb35f10-321a-4dd0-b5dd-59488a1537c5)', 'reason': 'CrashLoopBackOff'}}}], 'host_ip': '172.18.0.5', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.7', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 10, 10, 49, 37, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test1-677ffc8869-nvdk5', 'generateName': 'live-test1-677ffc8869-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test1-677ffc8869-nvdk5', 'uid': '1bb35f10-321a-4dd0-b5dd-59488a1537c5', 'resourceVersion': '1041595', 'creationTimestamp': '2020-07-10T10:49:37Z', 'labels': {'pod-template-hash': '677ffc8869', 'run': 'live-test1'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'live-test1-677ffc8869', 'uid': '8c0ead0e-0e53-4e6d-a864-b65ad37c5c18', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'containers': [{'name': 'live-test1', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T10:49:37Z'}, {'type': 'Ready', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:33:27Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test1]'}, {'type': 'ContainersReady', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:33:27Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test1]'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T10:49:37Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.7', 'startTime': '2020-07-10T10:49:37Z', 'containerStatuses': [{'name': 'live-test1', 'state': {'waiting': {'reason': 'CrashLoopBackOff', 'message': 'Back-off 5m0s restarting failed container=live-test1 pod=live-test1-677ffc8869-nvdk5_default(1bb35f10-321a-4dd0-b5dd-59488a1537c5)'}}, 'lastState': {'terminated': {'exitCode': 1, 'reason': 'Error', 'startedAt': '2020-07-15T14:33:25Z', 'finishedAt': '2020-07-15T14:33:26Z', 'containerID': 'containerd://df5567780351cc44cff2a475e7647fa3b253b4aeec90bce02dfb9a16bb9e5caf'}}, 'ready': False, 'restartCount': 1431, 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'imageID': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'containerID': 'containerd://df5567780351cc44cff2a475e7647fa3b253b4aeec90bce02dfb9a16bb9e5caf'}], 'qosClass': 'BestEffort'}}} 2020-07-15 14:38:34,710 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 10, 58, 2, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'live-test2-54d9dcd87-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '54d9dcd87', 'run': 'live-test2'}, 'managed_fields': None, 'name': 'live-test2-54d9dcd87-bsdvc', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'live-test2-54d9dcd87', 'uid': 'd5763685-12a1-4103-8892-dc97fbdfd081'}], 'resource_version': '1041752', 'self_link': '/api/v1/namespaces/default/pods/live-test2-54d9dcd87-bsdvc', 'uid': '4207ade2-9821-446c-ba06-f7a392fee6fd'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test2', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 10, 58, 2, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 34, 16, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test2]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 34, 16, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test2]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 10, 58, 2, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://d08d6680fc13ae048ac26c34015d516f36c336a3c30d9dfab0b82dafbff7d267', 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'image_id': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'last_state': {'running': None, 'terminated': {'container_id': 'containerd://d08d6680fc13ae048ac26c34015d516f36c336a3c30d9dfab0b82dafbff7d267', 'exit_code': 1, 'finished_at': datetime.datetime(2020, 7, 15, 14, 34, 16, tzinfo=tzlocal()), 'message': None, 'reason': 'Error', 'signal': None, 'started_at': datetime.datetime(2020, 7, 15, 14, 34, 15, tzinfo=tzlocal())}, 'waiting': None}, 'name': 'live-test2', 'ready': False, 'restart_count': 1432, 'state': {'running': None, 'terminated': None, 'waiting': {'message': 'Back-off ' '5m0s ' 'restarting ' 'failed ' 'container=live-test2 ' 'pod=live-test2-54d9dcd87-bsdvc_default(4207ade2-9821-446c-ba06-f7a392fee6fd)', 'reason': 'CrashLoopBackOff'}}}], 'host_ip': '172.18.0.5', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.8', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 10, 10, 58, 2, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test2-54d9dcd87-bsdvc', 'generateName': 'live-test2-54d9dcd87-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test2-54d9dcd87-bsdvc', 'uid': '4207ade2-9821-446c-ba06-f7a392fee6fd', 'resourceVersion': '1041752', 'creationTimestamp': '2020-07-10T10:58:02Z', 'labels': {'pod-template-hash': '54d9dcd87', 'run': 'live-test2'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'live-test2-54d9dcd87', 'uid': 'd5763685-12a1-4103-8892-dc97fbdfd081', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'containers': [{'name': 'live-test2', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T10:58:02Z'}, {'type': 'Ready', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:34:16Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test2]'}, {'type': 'ContainersReady', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:34:16Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test2]'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T10:58:02Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.8', 'startTime': '2020-07-10T10:58:02Z', 'containerStatuses': [{'name': 'live-test2', 'state': {'waiting': {'reason': 'CrashLoopBackOff', 'message': 'Back-off 5m0s restarting failed container=live-test2 pod=live-test2-54d9dcd87-bsdvc_default(4207ade2-9821-446c-ba06-f7a392fee6fd)'}}, 'lastState': {'terminated': {'exitCode': 1, 'reason': 'Error', 'startedAt': '2020-07-15T14:34:15Z', 'finishedAt': '2020-07-15T14:34:16Z', 'containerID': 'containerd://d08d6680fc13ae048ac26c34015d516f36c336a3c30d9dfab0b82dafbff7d267'}}, 'ready': False, 'restartCount': 1432, 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'imageID': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'containerID': 'containerd://d08d6680fc13ae048ac26c34015d516f36c336a3c30d9dfab0b82dafbff7d267'}], 'qosClass': 'BestEffort'}}} 2020-07-15 14:38:34,725 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 6, 28, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'live-test5-b6fcb7757-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': 'b6fcb7757', 'run': 'live-test5'}, 'managed_fields': None, 'name': 'live-test5-b6fcb7757-w869x', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'live-test5-b6fcb7757', 'uid': '36f2bc87-4a91-4618-ab50-e994944be46b'}], 'resource_version': '1042086', 'self_link': '/api/v1/namespaces/default/pods/live-test5-b6fcb7757-w869x', 'uid': '019da30b-30ef-440c-a083-30e5b4ddc74a'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test5', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 6, 28, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 36, 17, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test5]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 36, 17, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test5]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 6, 28, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://8ec2b563e5ad062b636a5e8817619122c644f35eac68a84248550bee0bdfa891', 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'image_id': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'last_state': {'running': None, 'terminated': {'container_id': 'containerd://8ec2b563e5ad062b636a5e8817619122c644f35eac68a84248550bee0bdfa891', 'exit_code': 1, 'finished_at': datetime.datetime(2020, 7, 15, 14, 36, 16, tzinfo=tzlocal()), 'message': None, 'reason': 'Error', 'signal': None, 'started_at': datetime.datetime(2020, 7, 15, 14, 36, 15, tzinfo=tzlocal())}, 'waiting': None}, 'name': 'live-test5', 'ready': False, 'restart_count': 1428, 'state': {'running': None, 'terminated': None, 'waiting': {'message': 'Back-off ' '5m0s ' 'restarting ' 'failed ' 'container=live-test5 ' 'pod=live-test5-b6fcb7757-w869x_default(019da30b-30ef-440c-a083-30e5b4ddc74a)', 'reason': 'CrashLoopBackOff'}}}], 'host_ip': '172.18.0.5', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.10', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 10, 11, 6, 28, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test5-b6fcb7757-w869x', 'generateName': 'live-test5-b6fcb7757-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test5-b6fcb7757-w869x', 'uid': '019da30b-30ef-440c-a083-30e5b4ddc74a', 'resourceVersion': '1042086', 'creationTimestamp': '2020-07-10T11:06:28Z', 'labels': {'pod-template-hash': 'b6fcb7757', 'run': 'live-test5'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'live-test5-b6fcb7757', 'uid': '36f2bc87-4a91-4618-ab50-e994944be46b', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'containers': [{'name': 'live-test5', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:06:28Z'}, {'type': 'Ready', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:36:17Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test5]'}, {'type': 'ContainersReady', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:36:17Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test5]'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:06:28Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.10', 'startTime': '2020-07-10T11:06:28Z', 'containerStatuses': [{'name': 'live-test5', 'state': {'waiting': {'reason': 'CrashLoopBackOff', 'message': 'Back-off 5m0s restarting failed container=live-test5 pod=live-test5-b6fcb7757-w869x_default(019da30b-30ef-440c-a083-30e5b4ddc74a)'}}, 'lastState': {'terminated': {'exitCode': 1, 'reason': 'Error', 'startedAt': '2020-07-15T14:36:15Z', 'finishedAt': '2020-07-15T14:36:16Z', 'containerID': 'containerd://8ec2b563e5ad062b636a5e8817619122c644f35eac68a84248550bee0bdfa891'}}, 'ready': False, 'restartCount': 1428, 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'imageID': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'containerID': 'containerd://8ec2b563e5ad062b636a5e8817619122c644f35eac68a84248550bee0bdfa891'}], 'qosClass': 'BestEffort'}}} 2020-07-15 14:38:34,739 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'etcd-5cbf55c8c-', 'generation': None, 'initializers': None, 'labels': {'instance-type': 'etcd-pod', 'pod-template-hash': '5cbf55c8c'}, 'managed_fields': None, 'name': 'etcd-5cbf55c8c-h6qqt', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'etcd-5cbf55c8c', 'uid': '560c9773-885b-4757-b51f-a46d15865dc7'}], 'resource_version': '1041679', 'self_link': '/api/v1/namespaces/default/pods/etcd-5cbf55c8c-h6qqt', 'uid': '9e8826cb-b796-4595-9471-2fc5a31fc57b'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': ['--name', '$(MY_POD_NAME)', '--advertise-client-urls', 'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', '--listen-client-urls', 'http://0.0.0.0:2379,http://0.0.0.0:4001', '--initial-advertise-peer-urls', 'http://$(MY_POD_IP):2380', '--listen-peer-urls', 'http://0.0.0.0:2380', '--initial-cluster', '$(MY_POD_NAME)=http://$(MY_POD_IP):2380', '--initial-cluster-state', 'new'], 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}, {'name': 'MY_POD_NAME', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'metadata.name'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': None, 'image': 'quay.io/coreos/etcd:v2.2.5', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 300, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 4001}, 'timeout_seconds': 1}, 'name': 'etcd', 'ports': [{'container_port': 2379, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 2380, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 4001, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 4001}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': None, 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 56, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 56, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://0b8bb68e8961498c00387a7884501968bcf425d9a73c60afd41fbac5af125cd9', 'image': 'quay.io/coreos/etcd:v2.2.5', 'image_id': 'sha256:66590e2dd05422771324d8ffe9ad35165ba35db0842ac5e0f1668c2d56733860', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'etcd', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 15, 14, 33, 50, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.5', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.41', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'etcd-5cbf55c8c-h6qqt', 'generateName': 'etcd-5cbf55c8c-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/etcd-5cbf55c8c-h6qqt', 'uid': '9e8826cb-b796-4595-9471-2fc5a31fc57b', 'resourceVersion': '1041679', 'creationTimestamp': '2020-07-15T14:33:39Z', 'labels': {'instance-type': 'etcd-pod', 'pod-template-hash': '5cbf55c8c'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'etcd-5cbf55c8c', 'uid': '560c9773-885b-4757-b51f-a46d15865dc7', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'containers': [{'name': 'etcd', 'image': 'quay.io/coreos/etcd:v2.2.5', 'args': ['--name', '$(MY_POD_NAME)', '--advertise-client-urls', 'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', '--listen-client-urls', 'http://0.0.0.0:2379,http://0.0.0.0:4001', '--initial-advertise-peer-urls', 'http://$(MY_POD_IP):2380', '--listen-peer-urls', 'http://0.0.0.0:2380', '--initial-cluster', '$(MY_POD_NAME)=http://$(MY_POD_IP):2380', '--initial-cluster-state', 'new'], 'ports': [{'containerPort': 2379, 'protocol': 'TCP'}, {'containerPort': 2380, 'protocol': 'TCP'}, {'containerPort': 4001, 'protocol': 'TCP'}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}, {'name': 'MY_POD_NAME', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'metadata.name'}}}], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'tcpSocket': {'port': 4001}, 'initialDelaySeconds': 300, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 4001}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:33:39Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:33:56Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:33:56Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:33:39Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.41', 'startTime': '2020-07-15T14:33:39Z', 'containerStatuses': [{'name': 'etcd', 'state': {'running': {'startedAt': '2020-07-15T14:33:50Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'quay.io/coreos/etcd:v2.2.5', 'imageID': 'sha256:66590e2dd05422771324d8ffe9ad35165ba35db0842ac5e0f1668c2d56733860', 'containerID': 'containerd://0b8bb68e8961498c00387a7884501968bcf425d9a73c60afd41fbac5af125cd9'}], 'qosClass': 'BestEffort'}}} 2020-07-15 14:38:34,759 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'homestead-57586d6cdc-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '57586d6cdc', 'service': 'homestead', 'snmp': 'enabled'}, 'managed_fields': None, 'name': 'homestead-57586d6cdc-f6f2m', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'homestead-57586d6cdc', 'uid': '497aca04-e9b9-4a93-9602-f9846640c7a3'}], 'resource_version': '1042242', 'self_link': '/api/v1/namespaces/default/pods/homestead-57586d6cdc-f6f2m', 'uid': '121ce82a-b607-48ca-91b4-d183bd55f291'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/homestead', 'mount_propagation': None, 'name': 'homesteadlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/homestead/homestead_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/homestead', 'mount_propagation': None, 'name': 'homesteadlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup cassandra; do echo ' 'waiting for cassandra to start ' '...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until nslookup astaire; do echo ' 'waiting for astaire to start ...; ' 'sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-astaire', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'iruya-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'homesteadlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}, {'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 36, 59, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 37, 27, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 37, 27, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://fd9346e8f8d17253ba68f77ce5d77e1bd36da39209d6888c290e317b8b99e7e9', 'image': 'docker.io/ollivier/clearwater-homestead:latest', 'image_id': 'docker.io/ollivier/clearwater-homestead@sha256:6eebbdbc9e424dd87b3d149b9fa1c779ad5c402e2f7ef414ec585a43ebb782d6', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'homestead', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 15, 14, 37, 12, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}, {'container_id': 'containerd://61035f2d29a80f2b202ce43c72c046bddc8c8b23593061d2789d32fdabf3aed6', 'image': 'docker.io/library/busybox:latest', 'image_id': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'tailer', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 15, 14, 37, 15, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.9', 'init_container_statuses': [{'container_id': 'containerd://809002b005b9750c80ecfffcb61621b9051f78b6e14269699f4788ec74737091', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-cassandra', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://809002b005b9750c80ecfffcb61621b9051f78b6e14269699f4788ec74737091', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 15, 14, 35, 48, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 15, 14, 33, 52, tzinfo=tzlocal())}, 'waiting': None}}, {'container_id': 'containerd://7f0243d693b7002ff602f12b454992c617abe7f0917f37aff30f7387461b2e45', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-astaire', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://7f0243d693b7002ff602f12b454992c617abe7f0917f37aff30f7387461b2e45', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 15, 14, 36, 58, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 15, 14, 35, 52, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.198', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 15, 14, 33, 40, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'homestead-57586d6cdc-f6f2m', 'generateName': 'homestead-57586d6cdc-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/homestead-57586d6cdc-f6f2m', 'uid': '121ce82a-b607-48ca-91b4-d183bd55f291', 'resourceVersion': '1042242', 'creationTimestamp': '2020-07-15T14:33:39Z', 'labels': {'pod-template-hash': '57586d6cdc', 'service': 'homestead', 'snmp': 'enabled'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'homestead-57586d6cdc', 'uid': '497aca04-e9b9-4a93-9602-f9846640c7a3', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'homesteadlogs', 'emptyDir': {}}, {'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-astaire', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup astaire; do echo waiting for astaire to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead', 'image': 'ollivier/clearwater-homestead:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'homesteadlogs', 'mountPath': '/var/log/homestead'}, {'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/homestead/homestead_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'homesteadlogs', 'mountPath': '/var/log/homestead'}, {'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:36:59Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:37:27Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:37:27Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:33:39Z'}], 'hostIP': '172.18.0.9', 'podIP': '10.244.2.198', 'startTime': '2020-07-15T14:33:40Z', 'initContainerStatuses': [{'name': 'wait-on-cassandra', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-15T14:33:52Z', 'finishedAt': '2020-07-15T14:35:48Z', 'containerID': 'containerd://809002b005b9750c80ecfffcb61621b9051f78b6e14269699f4788ec74737091'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://809002b005b9750c80ecfffcb61621b9051f78b6e14269699f4788ec74737091'}, {'name': 'wait-on-astaire', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-15T14:35:52Z', 'finishedAt': '2020-07-15T14:36:58Z', 'containerID': 'containerd://7f0243d693b7002ff602f12b454992c617abe7f0917f37aff30f7387461b2e45'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://7f0243d693b7002ff602f12b454992c617abe7f0917f37aff30f7387461b2e45'}], 'containerStatuses': [{'name': 'homestead', 'state': {'running': {'startedAt': '2020-07-15T14:37:12Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-homestead:latest', 'imageID': 'docker.io/ollivier/clearwater-homestead@sha256:6eebbdbc9e424dd87b3d149b9fa1c779ad5c402e2f7ef414ec585a43ebb782d6', 'containerID': 'containerd://fd9346e8f8d17253ba68f77ce5d77e1bd36da39209d6888c290e317b8b99e7e9'}, {'name': 'tailer', 'state': {'running': {'startedAt': '2020-07-15T14:37:15Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:latest', 'imageID': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'containerID': 'containerd://61035f2d29a80f2b202ce43c72c046bddc8c8b23593061d2789d32fdabf3aed6'}], 'qosClass': 'BestEffort'}}} 2020-07-15 14:38:34,792 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 0, 4, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'live-test3-6556bf7d77-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '6556bf7d77', 'run': 'live-test3'}, 'managed_fields': None, 'name': 'live-test3-6556bf7d77-2k9dg', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'live-test3-6556bf7d77', 'uid': 'ae0f16c1-4489-44cd-a9fe-d94031eb8eca'}], 'resource_version': '1041629', 'self_link': '/api/v1/namespaces/default/pods/live-test3-6556bf7d77-2k9dg', 'uid': 'b882c1fd-7708-4a01-8d12-ebbdd4f09b7e'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test3', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 0, 5, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 33, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test3]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 33, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test3]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 0, 4, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://cc31d2dec2791b01b52bc597780ba7c7d4f179e8b6542dfd920daf1d0b9ab1a1', 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'image_id': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'last_state': {'running': None, 'terminated': {'container_id': 'containerd://cc31d2dec2791b01b52bc597780ba7c7d4f179e8b6542dfd920daf1d0b9ab1a1', 'exit_code': 1, 'finished_at': datetime.datetime(2020, 7, 15, 14, 33, 32, tzinfo=tzlocal()), 'message': None, 'reason': 'Error', 'signal': None, 'started_at': datetime.datetime(2020, 7, 15, 14, 33, 31, tzinfo=tzlocal())}, 'waiting': None}, 'name': 'live-test3', 'ready': False, 'restart_count': 1428, 'state': {'running': None, 'terminated': None, 'waiting': {'message': 'Back-off ' '5m0s ' 'restarting ' 'failed ' 'container=live-test3 ' 'pod=live-test3-6556bf7d77-2k9dg_default(b882c1fd-7708-4a01-8d12-ebbdd4f09b7e)', 'reason': 'CrashLoopBackOff'}}}], 'host_ip': '172.18.0.5', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.9', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 10, 11, 0, 5, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test3-6556bf7d77-2k9dg', 'generateName': 'live-test3-6556bf7d77-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test3-6556bf7d77-2k9dg', 'uid': 'b882c1fd-7708-4a01-8d12-ebbdd4f09b7e', 'resourceVersion': '1041629', 'creationTimestamp': '2020-07-10T11:00:04Z', 'labels': {'pod-template-hash': '6556bf7d77', 'run': 'live-test3'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'live-test3-6556bf7d77', 'uid': 'ae0f16c1-4489-44cd-a9fe-d94031eb8eca', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'containers': [{'name': 'live-test3', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:00:05Z'}, {'type': 'Ready', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:33:33Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test3]'}, {'type': 'ContainersReady', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:33:33Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test3]'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:00:04Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.9', 'startTime': '2020-07-10T11:00:05Z', 'containerStatuses': [{'name': 'live-test3', 'state': {'waiting': {'reason': 'CrashLoopBackOff', 'message': 'Back-off 5m0s restarting failed container=live-test3 pod=live-test3-6556bf7d77-2k9dg_default(b882c1fd-7708-4a01-8d12-ebbdd4f09b7e)'}}, 'lastState': {'terminated': {'exitCode': 1, 'reason': 'Error', 'startedAt': '2020-07-15T14:33:31Z', 'finishedAt': '2020-07-15T14:33:32Z', 'containerID': 'containerd://cc31d2dec2791b01b52bc597780ba7c7d4f179e8b6542dfd920daf1d0b9ab1a1'}}, 'ready': False, 'restartCount': 1428, 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'imageID': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'containerID': 'containerd://cc31d2dec2791b01b52bc597780ba7c7d4f179e8b6542dfd920daf1d0b9ab1a1'}], 'qosClass': 'BestEffort'}}} 2020-07-15 14:38:34,807 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 54, 47, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'live-test7-5dd99f9b45-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '5dd99f9b45', 'run': 'live-test7'}, 'managed_fields': None, 'name': 'live-test7-5dd99f9b45-jtpmp', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'live-test7-5dd99f9b45', 'uid': '8ed5db99-a572-42f0-9075-cb5fccdb5994'}], 'resource_version': '1041908', 'self_link': '/api/v1/namespaces/default/pods/live-test7-5dd99f9b45-jtpmp', 'uid': '14e71b26-1d97-42ed-afa2-17bea97954b0'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test7', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 54, 47, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 35, 24, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test7]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 35, 24, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test7]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 54, 47, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://a92bed0e157ac26a06a0ca4a6d9b633f4be66b81f09561bf32f12f482b350744', 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'image_id': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'last_state': {'running': None, 'terminated': {'container_id': 'containerd://a92bed0e157ac26a06a0ca4a6d9b633f4be66b81f09561bf32f12f482b350744', 'exit_code': 1, 'finished_at': datetime.datetime(2020, 7, 15, 14, 35, 23, tzinfo=tzlocal()), 'message': None, 'reason': 'Error', 'signal': None, 'started_at': datetime.datetime(2020, 7, 15, 14, 35, 22, tzinfo=tzlocal())}, 'waiting': None}, 'name': 'live-test7', 'ready': False, 'restart_count': 1415, 'state': {'running': None, 'terminated': None, 'waiting': {'message': 'Back-off ' '5m0s ' 'restarting ' 'failed ' 'container=live-test7 ' 'pod=live-test7-5dd99f9b45-jtpmp_default(14e71b26-1d97-42ed-afa2-17bea97954b0)', 'reason': 'CrashLoopBackOff'}}}], 'host_ip': '172.18.0.9', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.11', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 10, 11, 54, 47, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test7-5dd99f9b45-jtpmp', 'generateName': 'live-test7-5dd99f9b45-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test7-5dd99f9b45-jtpmp', 'uid': '14e71b26-1d97-42ed-afa2-17bea97954b0', 'resourceVersion': '1041908', 'creationTimestamp': '2020-07-10T11:54:47Z', 'labels': {'pod-template-hash': '5dd99f9b45', 'run': 'live-test7'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'live-test7-5dd99f9b45', 'uid': '8ed5db99-a572-42f0-9075-cb5fccdb5994', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'containers': [{'name': 'live-test7', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:54:47Z'}, {'type': 'Ready', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:35:24Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test7]'}, {'type': 'ContainersReady', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:35:24Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test7]'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:54:47Z'}], 'hostIP': '172.18.0.9', 'podIP': '10.244.2.11', 'startTime': '2020-07-10T11:54:47Z', 'containerStatuses': [{'name': 'live-test7', 'state': {'waiting': {'reason': 'CrashLoopBackOff', 'message': 'Back-off 5m0s restarting failed container=live-test7 pod=live-test7-5dd99f9b45-jtpmp_default(14e71b26-1d97-42ed-afa2-17bea97954b0)'}}, 'lastState': {'terminated': {'exitCode': 1, 'reason': 'Error', 'startedAt': '2020-07-15T14:35:22Z', 'finishedAt': '2020-07-15T14:35:23Z', 'containerID': 'containerd://a92bed0e157ac26a06a0ca4a6d9b633f4be66b81f09561bf32f12f482b350744'}}, 'ready': False, 'restartCount': 1415, 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'imageID': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'containerID': 'containerd://a92bed0e157ac26a06a0ca4a6d9b633f4be66b81f09561bf32f12f482b350744'}], 'qosClass': 'BestEffort'}}} 2020-07-15 14:38:34,824 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'astaire-5ddcdd6b7f-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '5ddcdd6b7f', 'service': 'astaire'}, 'managed_fields': None, 'name': 'astaire-5ddcdd6b7f-5jjpn', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'astaire-5ddcdd6b7f', 'uid': 'a5755d49-7b5d-4e45-b64b-74f70029af16'}], 'resource_version': '1042147', 'self_link': '/api/v1/namespaces/default/pods/astaire-5ddcdd6b7f-5jjpn', 'uid': '3d81a8b5-461d-4644-9c07-b082465360ad'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-astaire:latest', 'image_pull_policy': 'Always', 'lifecycle': {'post_start': None, 'pre_stop': {'_exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}, 'http_get': None, 'tcp_socket': None}}, 'liveness_probe': {'_exec': None, 'failure_threshold': 9, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 11311}, 'timeout_seconds': 1}, 'name': 'astaire', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 11211, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 11311, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 11311}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/astaire', 'mount_propagation': None, 'name': 'astairelogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/astaire/astaire_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/astaire', 'mount_propagation': None, 'name': 'astairelogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup cassandra; do echo ' 'waiting for cassandra to start ' '...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'iruya-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 120, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'astairelogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}, {'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 35, 50, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 36, 52, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 36, 52, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://b620c78330a4ebcbcad9f618e85d1d149cd107df87a6b87ddc2e6edc28820281', 'image': 'docker.io/ollivier/clearwater-astaire:latest', 'image_id': 'docker.io/ollivier/clearwater-astaire@sha256:24e9186a8be32af9559f4d198c5c423eaac0d6c7b827c5ab674f2d124385c2fb', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'astaire', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 15, 14, 36, 3, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}, {'container_id': 'containerd://f89197db5270b536a80da30c64e81c38d693d69e310f199e5059d4000895216d', 'image': 'docker.io/library/busybox:latest', 'image_id': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'tailer', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 15, 14, 36, 7, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.9', 'init_container_statuses': [{'container_id': 'containerd://1cc6e69850adbeb51122e19024cd0af8e0c38f4b765b25bfec720af1dc5a10e4', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-cassandra', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://1cc6e69850adbeb51122e19024cd0af8e0c38f4b765b25bfec720af1dc5a10e4', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 15, 14, 35, 49, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 15, 14, 33, 46, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.194', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'astaire-5ddcdd6b7f-5jjpn', 'generateName': 'astaire-5ddcdd6b7f-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/astaire-5ddcdd6b7f-5jjpn', 'uid': '3d81a8b5-461d-4644-9c07-b082465360ad', 'resourceVersion': '1042147', 'creationTimestamp': '2020-07-15T14:33:39Z', 'labels': {'pod-template-hash': '5ddcdd6b7f', 'service': 'astaire'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'astaire-5ddcdd6b7f', 'uid': 'a5755d49-7b5d-4e45-b64b-74f70029af16', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'astairelogs', 'emptyDir': {}}, {'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'astaire', 'image': 'ollivier/clearwater-astaire:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 11211, 'protocol': 'TCP'}, {'containerPort': 11311, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'astairelogs', 'mountPath': '/var/log/astaire'}, {'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'tcpSocket': {'port': 11311}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 9}, 'readinessProbe': {'tcpSocket': {'port': 11311}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'lifecycle': {'preStop': {'exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}}}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/astaire/astaire_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'astairelogs', 'mountPath': '/var/log/astaire'}, {'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 120, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:35:50Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:36:52Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:36:52Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:33:39Z'}], 'hostIP': '172.18.0.9', 'podIP': '10.244.2.194', 'startTime': '2020-07-15T14:33:39Z', 'initContainerStatuses': [{'name': 'wait-on-cassandra', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-15T14:33:46Z', 'finishedAt': '2020-07-15T14:35:49Z', 'containerID': 'containerd://1cc6e69850adbeb51122e19024cd0af8e0c38f4b765b25bfec720af1dc5a10e4'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://1cc6e69850adbeb51122e19024cd0af8e0c38f4b765b25bfec720af1dc5a10e4'}], 'containerStatuses': [{'name': 'astaire', 'state': {'running': {'startedAt': '2020-07-15T14:36:03Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-astaire:latest', 'imageID': 'docker.io/ollivier/clearwater-astaire@sha256:24e9186a8be32af9559f4d198c5c423eaac0d6c7b827c5ab674f2d124385c2fb', 'containerID': 'containerd://b620c78330a4ebcbcad9f618e85d1d149cd107df87a6b87ddc2e6edc28820281'}, {'name': 'tailer', 'state': {'running': {'startedAt': '2020-07-15T14:36:07Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:latest', 'imageID': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'containerID': 'containerd://f89197db5270b536a80da30c64e81c38d693d69e310f199e5059d4000895216d'}], 'qosClass': 'BestEffort'}}} 2020-07-15 14:38:34,856 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'bono-5cdb7bfcdd-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '5cdb7bfcdd', 'service': 'bono', 'snmp': 'enabled'}, 'managed_fields': None, 'name': 'bono-5cdb7bfcdd-5rln7', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'bono-5cdb7bfcdd', 'uid': '4ecac087-23b7-44be-a1d2-b6ea22e78212'}], 'resource_version': '1042403', 'self_link': '/api/v1/namespaces/default/pods/bono-5cdb7bfcdd-5rln7', 'uid': '6e245888-d37d-4b43-984c-2bc937301d4b'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-bono:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 ' '5062']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'bono', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 3478, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5060, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5062, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5060, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'UDP'}, {'container_port': 5062, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'UDP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 ' '5062']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/bono', 'mount_propagation': None, 'name': 'bonologs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/bono/bono_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/bono', 'mount_propagation': None, 'name': 'bonologs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup sprout; do echo ' 'waiting for sprout to start ...; ' 'sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'bonologs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}, {'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 38, 4, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 38, 24, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 38, 24, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://527c3008818d0f8c98e9b0e2a9e686e01209b4502bbbdcf78a9961300fcca21b', 'image': 'docker.io/ollivier/clearwater-bono:latest', 'image_id': 'docker.io/ollivier/clearwater-bono@sha256:25b1c4759aa4dd92b752451e64f9df5f4a6336d74a15dd5914fbb83ab81ab9f4', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'bono', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 15, 14, 38, 9, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}, {'container_id': 'containerd://b67cc8c056b4f8c769bb667efe688d194dd545b827c73b13b438c78d4c5c4730', 'image': 'docker.io/library/busybox:latest', 'image_id': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'tailer', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 15, 14, 38, 13, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.5', 'init_container_statuses': [{'container_id': 'containerd://bdc6635122368393e6864bb36d015ace9e3178865babe32c37488da6af064bea', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-sprout', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://bdc6635122368393e6864bb36d015ace9e3178865babe32c37488da6af064bea', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 15, 14, 38, 2, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 15, 14, 33, 47, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.39', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'bono-5cdb7bfcdd-5rln7', 'generateName': 'bono-5cdb7bfcdd-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/bono-5cdb7bfcdd-5rln7', 'uid': '6e245888-d37d-4b43-984c-2bc937301d4b', 'resourceVersion': '1042403', 'creationTimestamp': '2020-07-15T14:33:39Z', 'labels': {'pod-template-hash': '5cdb7bfcdd', 'service': 'bono', 'snmp': 'enabled'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'bono-5cdb7bfcdd', 'uid': '4ecac087-23b7-44be-a1d2-b6ea22e78212', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'bonologs', 'emptyDir': {}}, {'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'bono', 'image': 'ollivier/clearwater-bono:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 3478, 'protocol': 'TCP'}, {'containerPort': 5060, 'protocol': 'TCP'}, {'containerPort': 5062, 'protocol': 'TCP'}, {'containerPort': 5060, 'protocol': 'UDP'}, {'containerPort': 5062, 'protocol': 'UDP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'bonologs', 'mountPath': '/var/log/bono'}, {'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 5062']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 5062']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/bono/bono_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'bonologs', 'mountPath': '/var/log/bono'}, {'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:38:04Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:38:24Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:38:24Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:33:39Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.39', 'startTime': '2020-07-15T14:33:39Z', 'initContainerStatuses': [{'name': 'wait-on-sprout', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-15T14:33:47Z', 'finishedAt': '2020-07-15T14:38:02Z', 'containerID': 'containerd://bdc6635122368393e6864bb36d015ace9e3178865babe32c37488da6af064bea'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://bdc6635122368393e6864bb36d015ace9e3178865babe32c37488da6af064bea'}], 'containerStatuses': [{'name': 'bono', 'state': {'running': {'startedAt': '2020-07-15T14:38:09Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-bono:latest', 'imageID': 'docker.io/ollivier/clearwater-bono@sha256:25b1c4759aa4dd92b752451e64f9df5f4a6336d74a15dd5914fbb83ab81ab9f4', 'containerID': 'containerd://527c3008818d0f8c98e9b0e2a9e686e01209b4502bbbdcf78a9961300fcca21b'}, {'name': 'tailer', 'state': {'running': {'startedAt': '2020-07-15T14:38:13Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:latest', 'imageID': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'containerID': 'containerd://b67cc8c056b4f8c769bb667efe688d194dd545b827c73b13b438c78d4c5c4730'}], 'qosClass': 'BestEffort'}}} 2020-07-15 14:38:34,894 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'homestead-prov-756c8bff5d-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '756c8bff5d', 'service': 'homestead-prov', 'snmp': 'enabled'}, 'managed_fields': None, 'name': 'homestead-prov-756c8bff5d-9t87z', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'homestead-prov-756c8bff5d', 'uid': '6ae0087f-4082-49e8-8166-d749b073e77c'}], 'resource_version': '1042308', 'self_link': '/api/v1/namespaces/default/pods/homestead-prov-756c8bff5d-9t87z', 'uid': '5361443b-ca11-49bf-ac2d-0b5c4f0b1beb'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead-prov:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead-prov', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8889, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup homestead; do echo ' 'waiting for homestead to start ' '...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'iruya-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 37, 32, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 37, 49, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 37, 49, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 33, 39, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://d9703cd9d25d246eeb6e9656c4dc96e52f8ee0ec89cd69a755b75323dc463210', 'image': 'docker.io/ollivier/clearwater-homestead-prov:latest', 'image_id': 'docker.io/ollivier/clearwater-homestead-prov@sha256:21ea1bbce8747d80fc46c07ee0bdb94653036ee544413853074f39900798a7d8', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'homestead-prov', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 15, 14, 37, 38, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.9', 'init_container_statuses': [{'container_id': 'containerd://05202db9a8823316617c60335a2da5a93ea7bccc8215152c5d7f7aa026d43415', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-homestead', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://05202db9a8823316617c60335a2da5a93ea7bccc8215152c5d7f7aa026d43415', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 15, 14, 37, 31, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 15, 14, 33, 52, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.199', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 15, 14, 33, 40, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'homestead-prov-756c8bff5d-9t87z', 'generateName': 'homestead-prov-756c8bff5d-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/homestead-prov-756c8bff5d-9t87z', 'uid': '5361443b-ca11-49bf-ac2d-0b5c4f0b1beb', 'resourceVersion': '1042308', 'creationTimestamp': '2020-07-15T14:33:39Z', 'labels': {'pod-template-hash': '756c8bff5d', 'service': 'homestead-prov', 'snmp': 'enabled'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'homestead-prov-756c8bff5d', 'uid': '6ae0087f-4082-49e8-8166-d749b073e77c', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-homestead', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead-prov', 'image': 'ollivier/clearwater-homestead-prov:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8889, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:37:32Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:37:49Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:37:49Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:33:39Z'}], 'hostIP': '172.18.0.9', 'podIP': '10.244.2.199', 'startTime': '2020-07-15T14:33:40Z', 'initContainerStatuses': [{'name': 'wait-on-homestead', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-15T14:33:52Z', 'finishedAt': '2020-07-15T14:37:31Z', 'containerID': 'containerd://05202db9a8823316617c60335a2da5a93ea7bccc8215152c5d7f7aa026d43415'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://05202db9a8823316617c60335a2da5a93ea7bccc8215152c5d7f7aa026d43415'}], 'containerStatuses': [{'name': 'homestead-prov', 'state': {'running': {'startedAt': '2020-07-15T14:37:38Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-homestead-prov:latest', 'imageID': 'docker.io/ollivier/clearwater-homestead-prov@sha256:21ea1bbce8747d80fc46c07ee0bdb94653036ee544413853074f39900798a7d8', 'containerID': 'containerd://d9703cd9d25d246eeb6e9656c4dc96e52f8ee0ec89cd69a755b75323dc463210'}], 'qosClass': 'BestEffort'}}} 2020-07-15 14:38:34,915 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 38, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'live-test', 'namespace': 'default', 'owner_references': None, 'resource_version': '1042433', 'self_link': '/api/v1/namespaces/default/pods/live-test', 'uid': '827f6280-d43a-4fb7-8090-2db194596010'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Never', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 38, 34, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': None, 'host_ip': None, 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Pending', 'pod_ip': None, 'qos_class': 'BestEffort', 'reason': None, 'start_time': None}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test', 'uid': '827f6280-d43a-4fb7-8090-2db194596010', 'resourceVersion': '1042433', 'creationTimestamp': '2020-07-15T14:38:34Z'}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'containers': [{'name': 'live-test', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Never', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Pending', 'conditions': [{'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:38:34Z'}], 'qosClass': 'BestEffort'}}} 2020-07-15 14:38:34,925 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 38, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'live-test', 'namespace': 'default', 'owner_references': None, 'resource_version': '1042435', 'self_link': '/api/v1/namespaces/default/pods/live-test', 'uid': '827f6280-d43a-4fb7-8090-2db194596010'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Never', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 38, 34, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 38, 34, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 38, 34, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 38, 34, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_id': '', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'live-test', 'ready': False, 'restart_count': 0, 'state': {'running': None, 'terminated': None, 'waiting': {'message': None, 'reason': 'ContainerCreating'}}}], 'host_ip': '172.18.0.5', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Pending', 'pod_ip': None, 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 15, 14, 38, 34, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test', 'uid': '827f6280-d43a-4fb7-8090-2db194596010', 'resourceVersion': '1042435', 'creationTimestamp': '2020-07-15T14:38:34Z'}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'containers': [{'name': 'live-test', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Never', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Pending', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:38:34Z'}, {'type': 'Ready', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:38:34Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test]'}, {'type': 'ContainersReady', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:38:34Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test]'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:38:34Z'}], 'hostIP': '172.18.0.5', 'startTime': '2020-07-15T14:38:34Z', 'containerStatuses': [{'name': 'live-test', 'state': {'waiting': {'reason': 'ContainerCreating'}}, 'lastState': {}, 'ready': False, 'restartCount': 0, 'image': 'ollivier/clearwater-live-test:latest', 'imageID': ''}], 'qosClass': 'BestEffort'}}} 2020-07-15 14:38:39,588 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 38, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'live-test', 'namespace': 'default', 'owner_references': None, 'resource_version': '1042449', 'self_link': '/api/v1/namespaces/default/pods/live-test', 'uid': '827f6280-d43a-4fb7-8090-2db194596010'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Never', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 38, 34, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 38, 39, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 38, 39, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 38, 34, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://abe93b666c9faa14f63549f6dd61db0a8c3205685cceee108c9bb5d9d19d6b14', 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'image_id': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'live-test', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 15, 14, 38, 39, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.5', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.43', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 15, 14, 38, 34, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test', 'uid': '827f6280-d43a-4fb7-8090-2db194596010', 'resourceVersion': '1042449', 'creationTimestamp': '2020-07-15T14:38:34Z'}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'containers': [{'name': 'live-test', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Never', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:38:34Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:38:39Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:38:39Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:38:34Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.43', 'startTime': '2020-07-15T14:38:34Z', 'containerStatuses': [{'name': 'live-test', 'state': {'running': {'startedAt': '2020-07-15T14:38:39Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'imageID': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'containerID': 'containerd://abe93b666c9faa14f63549f6dd61db0a8c3205685cceee108c9bb5d9d19d6b14'}], 'qosClass': 'BestEffort'}}} 2020-07-15 14:38:41,598 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 10, 49, 37, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'live-test1-677ffc8869-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '677ffc8869', 'run': 'live-test1'}, 'managed_fields': None, 'name': 'live-test1-677ffc8869-nvdk5', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'live-test1-677ffc8869', 'uid': '8c0ead0e-0e53-4e6d-a864-b65ad37c5c18'}], 'resource_version': '1042454', 'self_link': '/api/v1/namespaces/default/pods/live-test1-677ffc8869-nvdk5', 'uid': '1bb35f10-321a-4dd0-b5dd-59488a1537c5'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test1', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 10, 49, 37, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 38, 41, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 38, 41, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 10, 49, 37, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://ecba3d3ada1e489c6e7742dd158958f1046750c6297ece0fbc9026af7b103c71', 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'image_id': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'last_state': {'running': None, 'terminated': {'container_id': 'containerd://df5567780351cc44cff2a475e7647fa3b253b4aeec90bce02dfb9a16bb9e5caf', 'exit_code': 1, 'finished_at': datetime.datetime(2020, 7, 15, 14, 33, 26, tzinfo=tzlocal()), 'message': None, 'reason': 'Error', 'signal': None, 'started_at': datetime.datetime(2020, 7, 15, 14, 33, 25, tzinfo=tzlocal())}, 'waiting': None}, 'name': 'live-test1', 'ready': True, 'restart_count': 1432, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 15, 14, 38, 41, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.5', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.7', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 10, 10, 49, 37, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test1-677ffc8869-nvdk5', 'generateName': 'live-test1-677ffc8869-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test1-677ffc8869-nvdk5', 'uid': '1bb35f10-321a-4dd0-b5dd-59488a1537c5', 'resourceVersion': '1042454', 'creationTimestamp': '2020-07-10T10:49:37Z', 'labels': {'pod-template-hash': '677ffc8869', 'run': 'live-test1'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'live-test1-677ffc8869', 'uid': '8c0ead0e-0e53-4e6d-a864-b65ad37c5c18', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'containers': [{'name': 'live-test1', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T10:49:37Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:38:41Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:38:41Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T10:49:37Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.7', 'startTime': '2020-07-10T10:49:37Z', 'containerStatuses': [{'name': 'live-test1', 'state': {'running': {'startedAt': '2020-07-15T14:38:41Z'}}, 'lastState': {'terminated': {'exitCode': 1, 'reason': 'Error', 'startedAt': '2020-07-15T14:33:25Z', 'finishedAt': '2020-07-15T14:33:26Z', 'containerID': 'containerd://df5567780351cc44cff2a475e7647fa3b253b4aeec90bce02dfb9a16bb9e5caf'}}, 'ready': True, 'restartCount': 1432, 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'imageID': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'containerID': 'containerd://ecba3d3ada1e489c6e7742dd158958f1046750c6297ece0fbc9026af7b103c71'}], 'qosClass': 'BestEffort'}}} 2020-07-15 14:38:46,610 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 0, 4, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'live-test3-6556bf7d77-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '6556bf7d77', 'run': 'live-test3'}, 'managed_fields': None, 'name': 'live-test3-6556bf7d77-2k9dg', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'live-test3-6556bf7d77', 'uid': 'ae0f16c1-4489-44cd-a9fe-d94031eb8eca'}], 'resource_version': '1042467', 'self_link': '/api/v1/namespaces/default/pods/live-test3-6556bf7d77-2k9dg', 'uid': 'b882c1fd-7708-4a01-8d12-ebbdd4f09b7e'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test3', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 0, 5, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 38, 46, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 38, 46, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 0, 4, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://42d41a7414bacb490e2499340d9dd7b26eb752fa66bcbe4da390ac0791b08f7c', 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'image_id': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'last_state': {'running': None, 'terminated': {'container_id': 'containerd://cc31d2dec2791b01b52bc597780ba7c7d4f179e8b6542dfd920daf1d0b9ab1a1', 'exit_code': 1, 'finished_at': datetime.datetime(2020, 7, 15, 14, 33, 32, tzinfo=tzlocal()), 'message': None, 'reason': 'Error', 'signal': None, 'started_at': datetime.datetime(2020, 7, 15, 14, 33, 31, tzinfo=tzlocal())}, 'waiting': None}, 'name': 'live-test3', 'ready': True, 'restart_count': 1429, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 15, 14, 38, 45, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.5', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.9', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 10, 11, 0, 5, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test3-6556bf7d77-2k9dg', 'generateName': 'live-test3-6556bf7d77-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test3-6556bf7d77-2k9dg', 'uid': 'b882c1fd-7708-4a01-8d12-ebbdd4f09b7e', 'resourceVersion': '1042467', 'creationTimestamp': '2020-07-10T11:00:04Z', 'labels': {'pod-template-hash': '6556bf7d77', 'run': 'live-test3'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'live-test3-6556bf7d77', 'uid': 'ae0f16c1-4489-44cd-a9fe-d94031eb8eca', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'containers': [{'name': 'live-test3', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:00:05Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:38:46Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:38:46Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:00:04Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.9', 'startTime': '2020-07-10T11:00:05Z', 'containerStatuses': [{'name': 'live-test3', 'state': {'running': {'startedAt': '2020-07-15T14:38:45Z'}}, 'lastState': {'terminated': {'exitCode': 1, 'reason': 'Error', 'startedAt': '2020-07-15T14:33:31Z', 'finishedAt': '2020-07-15T14:33:32Z', 'containerID': 'containerd://cc31d2dec2791b01b52bc597780ba7c7d4f179e8b6542dfd920daf1d0b9ab1a1'}}, 'ready': True, 'restartCount': 1429, 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'imageID': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'containerID': 'containerd://42d41a7414bacb490e2499340d9dd7b26eb752fa66bcbe4da390ac0791b08f7c'}], 'qosClass': 'BestEffort'}}} 2020-07-15 14:38:55,632 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 15, 14, 38, 34, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'live-test', 'namespace': 'default', 'owner_references': None, 'resource_version': '1042487', 'self_link': '/api/v1/namespaces/default/pods/live-test', 'uid': '827f6280-d43a-4fb7-8090-2db194596010'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Never', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 38, 34, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 38, 55, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 38, 55, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 15, 14, 38, 34, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://abe93b666c9faa14f63549f6dd61db0a8c3205685cceee108c9bb5d9d19d6b14', 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'image_id': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'live-test', 'ready': False, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://abe93b666c9faa14f63549f6dd61db0a8c3205685cceee108c9bb5d9d19d6b14', 'exit_code': 1, 'finished_at': datetime.datetime(2020, 7, 15, 14, 38, 54, tzinfo=tzlocal()), 'message': None, 'reason': 'Error', 'signal': None, 'started_at': datetime.datetime(2020, 7, 15, 14, 38, 39, tzinfo=tzlocal())}, 'waiting': None}}], 'host_ip': '172.18.0.5', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Failed', 'pod_ip': '10.244.1.43', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 15, 14, 38, 34, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test', 'uid': '827f6280-d43a-4fb7-8090-2db194596010', 'resourceVersion': '1042487', 'creationTimestamp': '2020-07-15T14:38:34Z'}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'containers': [{'name': 'live-test', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Never', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Failed', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:38:34Z'}, {'type': 'Ready', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:38:55Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test]'}, {'type': 'ContainersReady', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:38:55Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test]'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-15T14:38:34Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.43', 'startTime': '2020-07-15T14:38:34Z', 'containerStatuses': [{'name': 'live-test', 'state': {'terminated': {'exitCode': 1, 'reason': 'Error', 'startedAt': '2020-07-15T14:38:39Z', 'finishedAt': '2020-07-15T14:38:54Z', 'containerID': 'containerd://abe93b666c9faa14f63549f6dd61db0a8c3205685cceee108c9bb5d9d19d6b14'}}, 'lastState': {}, 'ready': False, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'imageID': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'containerID': 'containerd://abe93b666c9faa14f63549f6dd61db0a8c3205685cceee108c9bb5d9d19d6b14'}], 'qosClass': 'BestEffort'}}} 2020-07-15 14:38:55,706 - functest_kubernetes.ims.ims - INFO - ** Invoke test (first_time) ** Execute test /usr/lib/ruby/gems/2.6.0/gems/httpi-2.4.0/lib/httpi/auth/ssl.rb:13: warning: constant OpenSSL::SSL::SSLContext::METHODS is deprecated Basic Call - Mainline (TCP) - (6505550825, 6505550617) Leaked sip:6505550617@default.svc.cluster.local, DELETE returned 502 Leaked sip:6505550825@default.svc.cluster.local, DELETE returned 502 Passed Basic Call - SDP (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/basic-call.rb:82:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Basic Call - Tel URIs (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/basic-call.rb:137:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Basic Call - Unknown number (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/basic-call.rb:178:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Basic Call - Rejected by remote endpoint (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/basic-call.rb:202:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Basic Call - Messages - Pager model (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/basic-call.rb:237:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Basic Call - Pracks (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/basic-call.rb:267:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Basic Registration (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/basic-register.rb:11:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Emergency Registration (TCP) - Skipped (Not running with emergency registrations) - Call with EMERGENCY_REG=Y to run test Multiple Identities (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/basic-register.rb:65:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Call Barring - Outbound Rejection (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/call-barring.rb:13:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Call Barring - Allow non-international call (TCP) - Skipped (No PSTN support) - Call with PSTN=true to run test Call Barring - Reject international call (TCP) - Skipped (No PSTN support) - Call with PSTN=true to run test Call Barring - Inbound Rejection (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/call-barring.rb:130:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Call Diversion AS - Unconditional (TCP) - Skipped (No Call Diversion AS hostname provided) - Call with CDIV_AS= Call Diversion AS - Busy (TCP) - Skipped (No Call Diversion AS hostname provided) - Call with CDIV_AS= Call Diversion AS - No answer (TCP) - Skipped (No Call Diversion AS hostname provided) - Call with CDIV_AS= Call Diversion - Not registered (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/call-diversion.rb:80:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Call Diversion - Not reachable (not registered) (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/call-diversion.rb:101:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Call Diversion - Not reachable (408) (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/call-diversion.rb:124:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Call Diversion - Not reachable (503) (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/call-diversion.rb:159:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Call Diversion - Not reachable (500) (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/call-diversion.rb:193:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Call Diversion - Busy (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/call-diversion.rb:227:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Call Diversion - Unconditional (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/call-diversion.rb:258:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Call Diversion - No answer (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/call-diversion.rb:289:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Call Diversion - Bad target URI (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/call-diversion.rb:355:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Call Diversion - Audio-only call (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/call-diversion.rb:384:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Call Diversion - Audio-video call (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/call-diversion.rb:418:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Call Forking - Mainline (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/call-forking.rb:13:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Call Forking - Endpoint offline (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/call-forking.rb:108:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Call Forking - Endpoint offline while ringing (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/call-forking.rb:183:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Call Waiting - Accepted (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/call-waiting.rb:13:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Call Waiting - Cancelled (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/call-waiting.rb:123:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' CANCEL - Mainline (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/cancel.rb:13:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Filtering - Accept-Contact (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/contact-filtering.rb:12:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Accept-Contact with response (SFR 511195) (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/contact-filtering.rb:44:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Filtering - Accept-Contact no match (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/contact-filtering.rb:91:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Filtering - Accept-Contact negated match (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/contact-filtering.rb:118:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Filtering - RFC3841 example (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/contact-filtering.rb:152:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Filtering - Reject-Contact no match (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/contact-filtering.rb:236:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Filtering - Reject-Contact match (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/contact-filtering.rb:269:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Gemini - INVITE - VoIP device answers (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Mobile device answers (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - VoIP device rejects (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Mobile device rejects (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Mobile device rejects with a 480 (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Both reject, choose mobile response (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Both reject, choose VoIP response (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Successful call with GR (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Failed call with GR (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Successful call with Accept-Contact (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Failed call with Accept-Contact (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - SUBSCRIBE - Mobile Notifies (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - SUBSCRIBE - Joint 408 (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= GRUU - REGISTER - two bindings with and without GRUU (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/gruu.rb:29:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' GRUU - REGISTER - binding suggested GRUU (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/gruu.rb:48:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' GRUU - REGISTER - instance ID requires escaping (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/gruu.rb:69:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' GRUU - REGISTER - three bindings with GRUUs (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/gruu.rb:84:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' GRUU - Call - first endpoint GRUU as target (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/gruu.rb:106:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' GRUU - Call - second endpoint GRUU as target (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/gruu.rb:142:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' GRUU - Call - only GRUU as target (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/gruu.rb:178:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' GRUU - Call - AoR as target (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/gruu.rb:214:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' GRUU - Call - unknown GRUU as target (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/gruu.rb:250:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' GRUU - Call - unknown GRUU as target - no GRUUs assigned (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/gruu.rb:278:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' GRUU - Call - Reject-Contact interop (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/gruu.rb:306:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' GRUU - Call - Accept-Contact interop (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/gruu.rb:336:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' GRUU - Call - AoR with other param as target (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/gruu.rb:375:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' GRUU - Call - GRUU with other param as target (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/gruu.rb:411:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' ISC Interface - Terminating (TCP) - Skipped (No hostname given) - Call with HOST_NAME= ISC Interface - Terminating (UDP AS) (TCP) - Skipped (No hostname given) - Call with HOST_NAME= ISC Interface - Terminating Failed (TCP) - Skipped (No hostname given) - Call with HOST_NAME= ISC Interface - Third-party Registration (TCP) - Skipped (No hostname given) - Call with HOST_NAME= ISC Interface - Third-party Registration - implicit registration (TCP) - Skipped (No hostname given) - Call with HOST_NAME= ISC Interface - Redirect (TCP) - Skipped (No hostname given) - Call with HOST_NAME= ISC Interface - B2BUA (TCP) - Skipped (No hostname given) - Call with HOST_NAME= Live Call - Dial out to a real number (TCP) - Skipped (No live number given) - Call with LIVENUMBER= Memento - Incorrect Password (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Wrong Call List (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Basic Call (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Unknown Number (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Rejected Call (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Cancelled Call (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Privacy Call (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Barred Call (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Busy Call Forwarding (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Nonce-Count - Mainline (TCP) - Skipped (No nonce-count support) - Call with NONCE_COUNT=Y to run test Nonce-Count - Reject Re-Use (TCP) - Skipped (No nonce-count support) - Call with NONCE_COUNT=Y to run test Off-net calls - tel: URI (TCP) - Skipped (No off-net number given) - Call with OFF_NET_TEL= Off-net calls - sip: URI (TCP) - Skipped (No off-net number given) - Call with OFF_NET_TEL= SUBSCRIBE - reg-event (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/subscribe.rb:24:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' SUBSCRIBE - reg-event with a GRUU (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/subscribe.rb:75:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' SUBSCRIBE - Subscription timeout (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/subscribe.rb:112:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' SUBSCRIBE - Registration timeout (TCP) - Skipped (Not running with short registrations) - Call with SHORT_REG=Y to run test Multiple SUBSCRIBErs to one UE's reg-event (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/subscribe.rb:228:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Message - URN URIs (TCP) - Skipped (No hostname given) - Call with HOST_NAME= Message - URN URIs to AS (TCP) - Skipped (No hostname given) - Call with HOST_NAME= Listing existing numbers failed with HTTP code 502 Detailed error output: {"Upstream error"=>"599", "Upstream URL"=>"http://homestead-prov.default.svc.cluster.local:8889/public/sip%3A6505550113%40default.svc.cluster.local/associated_private_ids"} 52 failures out of 96 tests run Basic Call - SDP (TCP) at 2020-07-15 14:38:43 +0000 Basic Call - Tel URIs (TCP) at 2020-07-15 14:38:44 +0000 Basic Call - Unknown number (TCP) at 2020-07-15 14:38:44 +0000 Basic Call - Rejected by remote endpoint (TCP) at 2020-07-15 14:38:44 +0000 Basic Call - Messages - Pager model (TCP) at 2020-07-15 14:38:44 +0000 Basic Call - Pracks (TCP) at 2020-07-15 14:38:45 +0000 Basic Registration (TCP) at 2020-07-15 14:38:45 +0000 Multiple Identities (TCP) at 2020-07-15 14:38:45 +0000 Call Barring - Outbound Rejection (TCP) at 2020-07-15 14:38:45 +0000 Call Barring - Inbound Rejection (TCP) at 2020-07-15 14:38:45 +0000 Call Diversion - Not registered (TCP) at 2020-07-15 14:38:45 +0000 Call Diversion - Not reachable (not registered) (TCP) at 2020-07-15 14:38:45 +0000 Call Diversion - Not reachable (408) (TCP) at 2020-07-15 14:38:45 +0000 Call Diversion - Not reachable (503) (TCP) at 2020-07-15 14:38:46 +0000 Call Diversion - Not reachable (500) (TCP) at 2020-07-15 14:38:46 +0000 Call Diversion - Busy (TCP) at 2020-07-15 14:38:46 +0000 Call Diversion - Unconditional (TCP) at 2020-07-15 14:38:46 +0000 Call Diversion - No answer (TCP) at 2020-07-15 14:38:46 +0000 Call Diversion - Bad target URI (TCP) at 2020-07-15 14:38:46 +0000 Call Diversion - Audio-only call (TCP) at 2020-07-15 14:38:47 +0000 Call Diversion - Audio-video call (TCP) at 2020-07-15 14:38:47 +0000 Call Forking - Mainline (TCP) at 2020-07-15 14:38:47 +0000 Call Forking - Endpoint offline (TCP) at 2020-07-15 14:38:47 +0000 Call Forking - Endpoint offline while ringing (TCP) at 2020-07-15 14:38:47 +0000 Call Waiting - Accepted (TCP) at 2020-07-15 14:38:48 +0000 Call Waiting - Cancelled (TCP) at 2020-07-15 14:38:48 +0000 CANCEL - Mainline (TCP) at 2020-07-15 14:38:48 +0000 Filtering - Accept-Contact (TCP) at 2020-07-15 14:38:48 +0000 Accept-Contact with response (SFR 511195) (TCP) at 2020-07-15 14:38:48 +0000 Filtering - Accept-Contact no match (TCP) at 2020-07-15 14:38:49 +0000 Filtering - Accept-Contact negated match (TCP) at 2020-07-15 14:38:49 +0000 Filtering - RFC3841 example (TCP) at 2020-07-15 14:38:49 +0000 Filtering - Reject-Contact no match (TCP) at 2020-07-15 14:38:49 +0000 Filtering - Reject-Contact match (TCP) at 2020-07-15 14:38:49 +0000 GRUU - REGISTER - two bindings with and without GRUU (TCP) at 2020-07-15 14:38:50 +0000 GRUU - REGISTER - binding suggested GRUU (TCP) at 2020-07-15 14:38:50 +0000 GRUU - REGISTER - instance ID requires escaping (TCP) at 2020-07-15 14:38:50 +0000 GRUU - REGISTER - three bindings with GRUUs (TCP) at 2020-07-15 14:38:50 +0000 GRUU - Call - first endpoint GRUU as target (TCP) at 2020-07-15 14:38:50 +0000 GRUU - Call - second endpoint GRUU as target (TCP) at 2020-07-15 14:38:51 +0000 GRUU - Call - only GRUU as target (TCP) at 2020-07-15 14:38:51 +0000 GRUU - Call - AoR as target (TCP) at 2020-07-15 14:38:51 +0000 GRUU - Call - unknown GRUU as target (TCP) at 2020-07-15 14:38:51 +0000 GRUU - Call - unknown GRUU as target - no GRUUs assigned (TCP) at 2020-07-15 14:38:52 +0000 GRUU - Call - Reject-Contact interop (TCP) at 2020-07-15 14:38:52 +0000 GRUU - Call - Accept-Contact interop (TCP) at 2020-07-15 14:38:52 +0000 GRUU - Call - AoR with other param as target (TCP) at 2020-07-15 14:38:52 +0000 GRUU - Call - GRUU with other param as target (TCP) at 2020-07-15 14:38:52 +0000 SUBSCRIBE - reg-event (TCP) at 2020-07-15 14:38:53 +0000 SUBSCRIBE - reg-event with a GRUU (TCP) at 2020-07-15 14:38:53 +0000 SUBSCRIBE - Subscription timeout (TCP) at 2020-07-15 14:38:53 +0000 Multiple SUBSCRIBErs to one UE's reg-event (TCP) at 2020-07-15 14:38:53 +0000 43 tests skipped Error logs, including Call-IDs of failed calls, are in the 'logfiles' directory 2020-07-15 14:38:55,711 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | k8s_vims | functest | 05:17 | FAIL | +-------------------+------------------+------------------+----------------+ 2020-07-15 14:38:55,732 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_config_map: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'configmaps', 'name': 'env-vars', 'retry_after_seconds': None, 'uid': 'fffbe536-a9e4-4fc1-a876-21bc0598b036'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-15 14:38:55,798 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_pod: {'api_version': 'v1', 'code': None, 'details': None, 'kind': 'Pod', 'message': None, 'metadata': {'_continue': None, 'resource_version': '1042489', 'self_link': '/api/v1/namespaces/default/pods/live-test'}, 'reason': None, 'status': "{'phase': 'Failed', 'conditions': [{'type': 'Initialized', " "'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': " "'2020-07-15T14:38:34Z'}, {'type': 'Ready', 'status': 'False', " "'lastProbeTime': None, 'lastTransitionTime': " "'2020-07-15T14:38:55Z', 'reason': 'ContainersNotReady', 'message': " "'containers with unready status: [live-test]'}, {'type': " "'ContainersReady', 'status': 'False', 'lastProbeTime': None, " "'lastTransitionTime': '2020-07-15T14:38:55Z', 'reason': " "'ContainersNotReady', 'message': 'containers with unready status: " "[live-test]'}, {'type': 'PodScheduled', 'status': 'True', " "'lastProbeTime': None, 'lastTransitionTime': " "'2020-07-15T14:38:34Z'}], 'hostIP': '172.18.0.5', 'podIP': " "'10.244.1.43', 'startTime': '2020-07-15T14:38:34Z', " "'containerStatuses': [{'name': 'live-test', 'state': " "{'terminated': {'exitCode': 1, 'reason': 'Error', 'startedAt': " "'2020-07-15T14:38:39Z', 'finishedAt': '2020-07-15T14:38:54Z', " "'containerID': " "'containerd://abe93b666c9faa14f63549f6dd61db0a8c3205685cceee108c9bb5d9d19d6b14'}}, " "'lastState': {}, 'ready': False, 'restartCount': 0, 'image': " "'docker.io/ollivier/clearwater-live-test:latest', 'imageID': " "'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', " "'containerID': " "'containerd://abe93b666c9faa14f63549f6dd61db0a8c3205685cceee108c9bb5d9d19d6b14'}], " "'qosClass': 'BestEffort'}"} 2020-07-15 14:38:56,179 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'astaire', 'retry_after_seconds': None, 'uid': 'd48fa86b-cb50-4292-809a-be08cb1a5333'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-15 14:38:56,236 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'astaire', 'retry_after_seconds': None, 'uid': '09b3990a-5c53-4505-b959-f9fbb56534be'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-15 14:38:56,244 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'bono', 'retry_after_seconds': None, 'uid': 'c7d6ebd8-a408-43db-b0b4-2c25424d8b1b'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-15 14:38:56,275 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'bono', 'retry_after_seconds': None, 'uid': '73b60387-c469-4e65-88fe-95dea62b6e83'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-15 14:38:56,285 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'cassandra', 'retry_after_seconds': None, 'uid': '58757469-bb46-4e13-b1b3-6975ce393a66'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-15 14:38:56,316 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'cassandra', 'retry_after_seconds': None, 'uid': '61837994-538c-4658-91a3-b52e98841d3b'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-15 14:38:56,371 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'chronos', 'retry_after_seconds': None, 'uid': '15c34867-a879-463c-b5ba-9346b4e16e93'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-15 14:38:56,422 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'chronos', 'retry_after_seconds': None, 'uid': '8eecb065-b0b3-4862-9933-512e4caafcd2'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-15 14:38:56,809 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'ellis', 'retry_after_seconds': None, 'uid': '8b571c0e-9aed-474d-b36b-47189dd6b27a'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-15 14:38:56,890 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'ellis', 'retry_after_seconds': None, 'uid': '7705e2f4-eb5b-463c-aea6-235910dab748'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-15 14:38:56,961 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'etcd', 'retry_after_seconds': None, 'uid': '87c6ea83-e892-4d3b-9660-fef8d6426a75'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-15 14:38:57,032 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'etcd', 'retry_after_seconds': None, 'uid': 'e9433ea0-266c-4701-873c-51241bd88eeb'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-15 14:38:57,072 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'homer', 'retry_after_seconds': None, 'uid': 'a50654d8-5759-4b14-b0c0-c96d44e244a0'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-15 14:38:57,172 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'homer', 'retry_after_seconds': None, 'uid': '349eafda-16e7-4b09-804d-57c7a668f3ee'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-15 14:38:57,498 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'homestead', 'retry_after_seconds': None, 'uid': '71366f1e-26ec-4ac2-84b2-55cf1731d728'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-15 14:38:57,569 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'homestead', 'retry_after_seconds': None, 'uid': 'a40fe445-cf0b-43b8-be5a-8f8183bd9b95'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-15 14:38:57,709 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'homestead-prov', 'retry_after_seconds': None, 'uid': '8d5df381-c48e-4efc-9e9f-c79a0bf96cc5'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-15 14:38:58,251 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'homestead-prov', 'retry_after_seconds': None, 'uid': '4b41e35e-a332-43e0-a089-41bb6f03bece'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-15 14:38:58,323 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'ralf', 'retry_after_seconds': None, 'uid': '5d905c8e-6cfe-4b91-9eb2-cbef1b4ca843'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-15 14:38:58,570 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'ralf', 'retry_after_seconds': None, 'uid': 'be906506-dbb8-4bee-9c30-670ba30e14b3'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-15 14:38:58,786 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'sprout', 'retry_after_seconds': None, 'uid': '3baf95af-ef52-4f16-a57f-62f80bcd945a'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-15 14:38:59,280 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'sprout', 'retry_after_seconds': None, 'uid': '727c3cbd-c6ed-4314-8f9c-bf7ee89c4472'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-15 14:38:59,571 - xtesting.core.testcase - DEBUG - Publishing /var/lib/xtesting/results/functest-kubernetes.log ('text/plain', None)