2020-07-23 12:50:24,460 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+ | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_DST_URL | s3://artifacts.opnfv.org/functest-kubernetes/1Y35V0XKEI82/functest-kubernetes-opnfv-functest-kubernetes-cnf-hunter-k8s_vims-run-39 | | S3_ENDPOINT_URL | https://storage.googleapis.com | | DEPLOY_SCENARIO | k8-nosdn-nofeature-noha | | BUILD_TAG | 1Y35V0XKEI82 | | DEBUG | true | | INSTALLER_TYPE | unknown | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | HTTP_DST_URL | http://artifacts.opnfv.org/functest-kubernetes/1Y35V0XKEI82/functest-kubernetes-opnfv-functest-kubernetes-cnf-hunter-k8s_vims-run-39 | | NODE_NAME | lf-virtual1-1 | +-------------------------+----------------------------------------------------------------------------------------------------------------------------------------------+ 2020-07-23 12:50:24,466 - xtesting.ci.run_tests - DEBUG - No env file /var/lib/xtesting/conf/env_file found 2020-07-23 12:50:24,466 - xtesting.ci.run_tests - DEBUG - Test args: k8s_vims 2020-07-23 12:50:24,470 - xtesting.ci.run_tests - INFO - Loading test case 'k8s_vims'... 2020-07-23 12:50:24,658 - xtesting.ci.run_tests - INFO - Running test case 'k8s_vims'... 2020-07-23 12:50:24,679 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_config_map: {'api_version': 'v1', 'binary_data': None, 'data': {u'ADDITIONAL_SHARED_CONFIG': '', u'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370006', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': '139a2ee0-cce3-11ea-b2c9-0242ac120008'}} 2020-07-23 12:50:24,747 - functest_kubernetes.ims.ims - INFO - Deployment astaire created 2020-07-23 12:50:24,747 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {u'ADDITIONAL_SHARED_CONFIG': '', u'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370006', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': '139a2ee0-cce3-11ea-b2c9-0242ac120008'}} 2020-07-23 12:50:24,795 - functest_kubernetes.ims.ims - INFO - Deployment bono created 2020-07-23 12:50:24,796 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {u'ADDITIONAL_SHARED_CONFIG': '', u'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370006', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': '139a2ee0-cce3-11ea-b2c9-0242ac120008'}} 2020-07-23 12:50:24,839 - functest_kubernetes.ims.ims - INFO - Deployment cassandra created 2020-07-23 12:50:24,840 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {u'ADDITIONAL_SHARED_CONFIG': '', u'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370006', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': '139a2ee0-cce3-11ea-b2c9-0242ac120008'}} 2020-07-23 12:50:24,896 - functest_kubernetes.ims.ims - INFO - Deployment chronos created 2020-07-23 12:50:24,896 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {u'ADDITIONAL_SHARED_CONFIG': '', u'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370006', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': '139a2ee0-cce3-11ea-b2c9-0242ac120008'}} 2020-07-23 12:50:24,949 - functest_kubernetes.ims.ims - INFO - Deployment ellis created 2020-07-23 12:50:24,949 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {u'ADDITIONAL_SHARED_CONFIG': '', u'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370006', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': '139a2ee0-cce3-11ea-b2c9-0242ac120008'}} 2020-07-23 12:50:25,043 - functest_kubernetes.ims.ims - INFO - Deployment etcd created 2020-07-23 12:50:25,043 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {u'ADDITIONAL_SHARED_CONFIG': '', u'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370006', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': '139a2ee0-cce3-11ea-b2c9-0242ac120008'}} 2020-07-23 12:50:25,084 - functest_kubernetes.ims.ims - INFO - Deployment homer created 2020-07-23 12:50:25,084 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {u'ADDITIONAL_SHARED_CONFIG': '', u'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370006', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': '139a2ee0-cce3-11ea-b2c9-0242ac120008'}} 2020-07-23 12:50:25,141 - functest_kubernetes.ims.ims - INFO - Deployment homestead created 2020-07-23 12:50:25,141 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {u'ADDITIONAL_SHARED_CONFIG': '', u'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370006', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': '139a2ee0-cce3-11ea-b2c9-0242ac120008'}} 2020-07-23 12:50:25,182 - functest_kubernetes.ims.ims - INFO - Deployment homestead-prov created 2020-07-23 12:50:25,182 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {u'ADDITIONAL_SHARED_CONFIG': '', u'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370006', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': '139a2ee0-cce3-11ea-b2c9-0242ac120008'}} 2020-07-23 12:50:25,230 - functest_kubernetes.ims.ims - INFO - Deployment ralf created 2020-07-23 12:50:25,230 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {u'ADDITIONAL_SHARED_CONFIG': '', u'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370006', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': '139a2ee0-cce3-11ea-b2c9-0242ac120008'}} 2020-07-23 12:50:25,265 - functest_kubernetes.ims.ims - INFO - Deployment sprout created 2020-07-23 12:50:25,265 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {u'ADDITIONAL_SHARED_CONFIG': '', u'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370006', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': '139a2ee0-cce3-11ea-b2c9-0242ac120008'}} 2020-07-23 12:50:25,333 - functest_kubernetes.ims.ims - INFO - Service astaire created 2020-07-23 12:50:25,333 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {u'ADDITIONAL_SHARED_CONFIG': '', u'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370006', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': '139a2ee0-cce3-11ea-b2c9-0242ac120008'}} 2020-07-23 12:50:25,369 - functest_kubernetes.ims.ims - INFO - Service bono created 2020-07-23 12:50:25,369 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {u'ADDITIONAL_SHARED_CONFIG': '', u'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370006', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': '139a2ee0-cce3-11ea-b2c9-0242ac120008'}} 2020-07-23 12:50:25,539 - functest_kubernetes.ims.ims - INFO - Service cassandra created 2020-07-23 12:50:25,539 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {u'ADDITIONAL_SHARED_CONFIG': '', u'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370006', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': '139a2ee0-cce3-11ea-b2c9-0242ac120008'}} 2020-07-23 12:50:26,100 - functest_kubernetes.ims.ims - INFO - Service chronos created 2020-07-23 12:50:26,101 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {u'ADDITIONAL_SHARED_CONFIG': '', u'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370006', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': '139a2ee0-cce3-11ea-b2c9-0242ac120008'}} 2020-07-23 12:50:26,174 - functest_kubernetes.ims.ims - INFO - Service ellis created 2020-07-23 12:50:26,174 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {u'ADDITIONAL_SHARED_CONFIG': '', u'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370006', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': '139a2ee0-cce3-11ea-b2c9-0242ac120008'}} 2020-07-23 12:50:26,286 - functest_kubernetes.ims.ims - INFO - Service etcd created 2020-07-23 12:50:26,287 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {u'ADDITIONAL_SHARED_CONFIG': '', u'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370006', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': '139a2ee0-cce3-11ea-b2c9-0242ac120008'}} 2020-07-23 12:50:26,362 - functest_kubernetes.ims.ims - INFO - Service homer created 2020-07-23 12:50:26,363 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {u'ADDITIONAL_SHARED_CONFIG': '', u'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370006', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': '139a2ee0-cce3-11ea-b2c9-0242ac120008'}} 2020-07-23 12:50:26,496 - functest_kubernetes.ims.ims - INFO - Service homestead created 2020-07-23 12:50:26,497 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {u'ADDITIONAL_SHARED_CONFIG': '', u'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370006', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': '139a2ee0-cce3-11ea-b2c9-0242ac120008'}} 2020-07-23 12:50:26,556 - functest_kubernetes.ims.ims - INFO - Service homestead-prov created 2020-07-23 12:50:26,556 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {u'ADDITIONAL_SHARED_CONFIG': '', u'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370006', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': '139a2ee0-cce3-11ea-b2c9-0242ac120008'}} 2020-07-23 12:50:26,577 - functest_kubernetes.ims.ims - INFO - Service ralf created 2020-07-23 12:50:26,577 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {u'ADDITIONAL_SHARED_CONFIG': '', u'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370006', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': '139a2ee0-cce3-11ea-b2c9-0242ac120008'}} 2020-07-23 12:50:26,697 - functest_kubernetes.ims.ims - INFO - Service sprout created 2020-07-23 12:50:26,697 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {u'ADDITIONAL_SHARED_CONFIG': '', u'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370006', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': '139a2ee0-cce3-11ea-b2c9-0242ac120008'}} 2020-07-23 12:50:26,707 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'observedGeneration': 1, u'updatedReplicas': 1, u'unavailableReplicas': 1, u'conditions': [{u'status': u'False', u'lastUpdateTime': u'2020-07-23T12:50:25Z', u'lastTransitionTime': u'2020-07-23T12:50:25Z', u'reason': u'MinimumReplicasUnavailable', u'message': u'Deployment does not have minimum availability.', u'type': u'Available'}, {u'status': u'True', u'lastUpdateTime': u'2020-07-23T12:50:26Z', u'lastTransitionTime': u'2020-07-23T12:50:25Z', u'reason': u'ReplicaSetUpdated', u'message': u'ReplicaSet "etcd-c8fddbb95" is progressing.', u'type': u'Progressing'}], u'replicas': 1}, u'kind': u'Deployment', u'spec': {u'progressDeadlineSeconds': 600, u'replicas': 1, u'strategy': {u'rollingUpdate': {u'maxSurge': u'25%', u'maxUnavailable': u'25%'}, u'type': u'RollingUpdate'}, u'template': {u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'schedulerName': u'default-scheduler', u'terminationGracePeriodSeconds': 30, u'restartPolicy': u'Always', u'imagePullSecrets': [{}], u'containers': [{u'livenessProbe': {u'tcpSocket': {u'port': 4001}, u'timeoutSeconds': 1, u'initialDelaySeconds': 300, u'periodSeconds': 10, u'successThreshold': 1, u'failureThreshold': 3}, u'terminationMessagePath': u'/dev/termination-log', u'name': u'etcd', u'image': u'quay.io/coreos/etcd:v2.2.5', u'args': [u'--name', u'$(MY_POD_NAME)', u'--advertise-client-urls', u'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', u'--listen-client-urls', u'http://0.0.0.0:2379,http://0.0.0.0:4001', u'--initial-advertise-peer-urls', u'http://$(MY_POD_IP):2380', u'--listen-peer-urls', u'http://0.0.0.0:2380', u'--initial-cluster', u'$(MY_POD_NAME)=http://$(MY_POD_IP):2380', u'--initial-cluster-state', u'new'], u'terminationMessagePolicy': u'File', u'env': [{u'valueFrom': {u'fieldRef': {u'fieldPath': u'status.podIP', u'apiVersion': u'v1'}}, u'name': u'MY_POD_IP'}, {u'valueFrom': {u'fieldRef': {u'fieldPath': u'metadata.name', u'apiVersion': u'v1'}}, u'name': u'MY_POD_NAME'}], u'imagePullPolicy': u'IfNotPresent', u'readinessProbe': {u'successThreshold': 1, u'tcpSocket': {u'port': 4001}, u'failureThreshold': 3, u'timeoutSeconds': 1, u'periodSeconds': 10}, u'ports': [{u'protocol': u'TCP', u'containerPort': 2379}, {u'protocol': u'TCP', u'containerPort': 2380}, {u'protocol': u'TCP', u'containerPort': 4001}], u'resources': {}}]}, u'metadata': {u'labels': {u'instance-type': u'etcd-pod'}, u'creationTimestamp': None}}, u'revisionHistoryLimit': 10, u'selector': {u'matchLabels': {u'instance-type': u'etcd-pod'}}}, u'apiVersion': u'apps/v1', u'metadata': {u'name': u'etcd', u'generation': 1, u'namespace': u'default', u'resourceVersion': u'2370131', u'creationTimestamp': u'2020-07-23T12:50:24Z', u'annotations': {u'deployment.kubernetes.io/revision': u'1'}, u'selfLink': u'/apis/apps/v1/namespaces/default/deployments/etcd', u'uid': u'13ca41c4-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {u'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'etcd', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370131', 'self_link': '/apis/apps/v1/namespaces/default/deployments/etcd', 'uid': '13ca41c4-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {u'instance-type': 'etcd-pod'}}, 'strategy': {'rolling_update': {'max_surge': u'25%', 'max_unavailable': u'25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {u'instance-type': 'etcd-pod'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': ['--name', '$(MY_POD_NAME)', '--advertise-client-urls', 'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', '--listen-client-urls', 'http://0.0.0.0:2379,http://0.0.0.0:4001', '--initial-advertise-peer-urls', 'http://$(MY_POD_IP):2380', '--listen-peer-urls', 'http://0.0.0.0:2380', '--initial-cluster', '$(MY_POD_NAME)=http://$(MY_POD_IP):2380', '--initial-cluster-state', 'new'], 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}, {'name': 'MY_POD_NAME', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'metadata.name'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': None, 'image': 'quay.io/coreos/etcd:v2.2.5', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 300, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 4001}, 'timeout_seconds': 1}, 'name': 'etcd', 'ports': [{'container_port': 2379, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 2380, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 4001, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 4001}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 50, 26, tzinfo=tzlocal()), 'message': 'ReplicaSet "etcd-c8fddbb95" is progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, u'type': u'ADDED'} 2020-07-23 12:50:26,774 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'observedGeneration': 1, u'updatedReplicas': 1, u'unavailableReplicas': 1, u'conditions': [{u'status': u'False', u'lastUpdateTime': u'2020-07-23T12:50:25Z', u'lastTransitionTime': u'2020-07-23T12:50:25Z', u'reason': u'MinimumReplicasUnavailable', u'message': u'Deployment does not have minimum availability.', u'type': u'Available'}, {u'status': u'True', u'lastUpdateTime': u'2020-07-23T12:50:26Z', u'lastTransitionTime': u'2020-07-23T12:50:25Z', u'reason': u'ReplicaSetUpdated', u'message': u'ReplicaSet "homer-58cfb54cd9" is progressing.', u'type': u'Progressing'}], u'replicas': 1}, u'kind': u'Deployment', u'spec': {u'progressDeadlineSeconds': 600, u'replicas': 1, u'strategy': {u'rollingUpdate': {u'maxSurge': u'25%', u'maxUnavailable': u'25%'}, u'type': u'RollingUpdate'}, u'template': {u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'schedulerName': u'default-scheduler', u'terminationGracePeriodSeconds': 30, u'restartPolicy': u'Always', u'initContainers': [{u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-cassandra', u'image': u'busybox:1.28', u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}], u'imagePullSecrets': [{}], u'containers': [{u'livenessProbe': {u'tcpSocket': {u'port': 7888}, u'timeoutSeconds': 1, u'initialDelaySeconds': 30, u'periodSeconds': 10, u'successThreshold': 1, u'failureThreshold': 3}, u'terminationMessagePath': u'/dev/termination-log', u'name': u'homer', u'envFrom': [{u'configMapRef': {u'name': u'env-vars'}}], u'image': u'ollivier/clearwater-homer:latest', u'terminationMessagePolicy': u'File', u'env': [{u'valueFrom': {u'fieldRef': {u'fieldPath': u'status.podIP', u'apiVersion': u'v1'}}, u'name': u'MY_POD_IP'}], u'imagePullPolicy': u'Always', u'readinessProbe': {u'successThreshold': 1, u'tcpSocket': {u'port': 7888}, u'failureThreshold': 3, u'timeoutSeconds': 1, u'periodSeconds': 10}, u'ports': [{u'protocol': u'TCP', u'containerPort': 22}, {u'protocol': u'TCP', u'containerPort': 7888}], u'resources': {}}]}, u'metadata': {u'labels': {u'service': u'homer'}, u'creationTimestamp': None}}, u'revisionHistoryLimit': 10, u'selector': {u'matchLabels': {u'service': u'homer'}}}, u'apiVersion': u'apps/v1', u'metadata': {u'name': u'homer', u'generation': 1, u'namespace': u'default', u'resourceVersion': u'2370125', u'creationTimestamp': u'2020-07-23T12:50:25Z', u'annotations': {u'deployment.kubernetes.io/revision': u'1'}, u'selfLink': u'/apis/apps/v1/namespaces/default/deployments/homer', u'uid': u'13d524a5-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {u'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homer', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370125', 'self_link': '/apis/apps/v1/namespaces/default/deployments/homer', 'uid': '13d524a5-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {u'service': 'homer'}}, 'strategy': {'rolling_update': {'max_surge': u'25%', 'max_unavailable': u'25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {u'service': 'homer'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homer:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'name': 'homer', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 50, 26, tzinfo=tzlocal()), 'message': 'ReplicaSet "homer-58cfb54cd9" is progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, u'type': u'ADDED'} 2020-07-23 12:50:26,816 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'observedGeneration': 1, u'updatedReplicas': 1, u'unavailableReplicas': 1, u'conditions': [{u'status': u'False', u'lastUpdateTime': u'2020-07-23T12:50:26Z', u'lastTransitionTime': u'2020-07-23T12:50:26Z', u'reason': u'MinimumReplicasUnavailable', u'message': u'Deployment does not have minimum availability.', u'type': u'Available'}, {u'status': u'True', u'lastUpdateTime': u'2020-07-23T12:50:26Z', u'lastTransitionTime': u'2020-07-23T12:50:25Z', u'reason': u'ReplicaSetUpdated', u'message': u'ReplicaSet "homestead-prov-745965b8" is progressing.', u'type': u'Progressing'}], u'replicas': 1}, u'kind': u'Deployment', u'spec': {u'progressDeadlineSeconds': 600, u'replicas': 1, u'strategy': {u'rollingUpdate': {u'maxSurge': u'25%', u'maxUnavailable': u'25%'}, u'type': u'RollingUpdate'}, u'template': {u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'schedulerName': u'default-scheduler', u'terminationGracePeriodSeconds': 30, u'restartPolicy': u'Always', u'initContainers': [{u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-homestead', u'image': u'busybox:1.28', u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}], u'imagePullSecrets': [{}], u'containers': [{u'livenessProbe': {u'timeoutSeconds': 1, u'exec': {u'command': [u'/bin/bash', u'/usr/share/clearwater/bin/poll_homestead-prov.sh']}, u'initialDelaySeconds': 60, u'periodSeconds': 10, u'successThreshold': 1, u'failureThreshold': 3}, u'terminationMessagePath': u'/dev/termination-log', u'name': u'homestead-prov', u'envFrom': [{u'configMapRef': {u'name': u'env-vars'}}], u'image': u'ollivier/clearwater-homestead-prov:latest', u'terminationMessagePolicy': u'File', u'env': [{u'valueFrom': {u'fieldRef': {u'fieldPath': u'status.podIP', u'apiVersion': u'v1'}}, u'name': u'MY_POD_IP'}], u'imagePullPolicy': u'Always', u'readinessProbe': {u'successThreshold': 1, u'periodSeconds': 10, u'failureThreshold': 3, u'timeoutSeconds': 1, u'exec': {u'command': [u'/bin/bash', u'/usr/share/clearwater/bin/poll_homestead-prov.sh']}}, u'ports': [{u'protocol': u'TCP', u'containerPort': 22}, {u'protocol': u'TCP', u'containerPort': 8889}], u'resources': {}}]}, u'metadata': {u'labels': {u'snmp': u'enabled', u'service': u'homestead-prov'}, u'creationTimestamp': None}}, u'revisionHistoryLimit': 10, u'selector': {u'matchLabels': {u'service': u'homestead-prov'}}}, u'apiVersion': u'apps/v1', u'metadata': {u'name': u'homestead-prov', u'generation': 1, u'namespace': u'default', u'resourceVersion': u'2370132', u'creationTimestamp': u'2020-07-23T12:50:25Z', u'annotations': {u'deployment.kubernetes.io/revision': u'1'}, u'selfLink': u'/apis/apps/v1/namespaces/default/deployments/homestead-prov', u'uid': u'13e44c0c-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {u'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homestead-prov', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370132', 'self_link': '/apis/apps/v1/namespaces/default/deployments/homestead-prov', 'uid': '13e44c0c-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {u'service': 'homestead-prov'}}, 'strategy': {'rolling_update': {'max_surge': u'25%', 'max_unavailable': u'25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {u'service': 'homestead-prov', u'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead-prov:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead-prov', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8889, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 26, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 50, 26, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 50, 26, tzinfo=tzlocal()), 'message': 'ReplicaSet "homestead-prov-745965b8" is progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, u'type': u'ADDED'} 2020-07-23 12:50:26,915 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'observedGeneration': 1, u'updatedReplicas': 1, u'unavailableReplicas': 1, u'conditions': [{u'status': u'False', u'lastUpdateTime': u'2020-07-23T12:50:24Z', u'lastTransitionTime': u'2020-07-23T12:50:24Z', u'reason': u'MinimumReplicasUnavailable', u'message': u'Deployment does not have minimum availability.', u'type': u'Available'}, {u'status': u'True', u'lastUpdateTime': u'2020-07-23T12:50:24Z', u'lastTransitionTime': u'2020-07-23T12:50:24Z', u'reason': u'ReplicaSetUpdated', u'message': u'ReplicaSet "bono-9858d478b" is progressing.', u'type': u'Progressing'}], u'replicas': 1}, u'kind': u'Deployment', u'spec': {u'progressDeadlineSeconds': 600, u'replicas': 1, u'strategy': {u'rollingUpdate': {u'maxSurge': u'25%', u'maxUnavailable': u'25%'}, u'type': u'RollingUpdate'}, u'template': {u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'schedulerName': u'default-scheduler', u'terminationGracePeriodSeconds': 30, u'restartPolicy': u'Always', u'volumes': [{u'emptyDir': {}, u'name': u'bonologs'}], u'initContainers': [{u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-sprout', u'image': u'busybox:1.28', u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}], u'imagePullSecrets': [{}], u'containers': [{u'livenessProbe': {u'timeoutSeconds': 1, u'exec': {u'command': [u'/bin/bash', u'/usr/share/kubernetes/liveness.sh', u'3478 5060 5062']}, u'initialDelaySeconds': 30, u'periodSeconds': 10, u'successThreshold': 1, u'failureThreshold': 3}, u'terminationMessagePath': u'/dev/termination-log', u'name': u'bono', u'envFrom': [{u'configMapRef': {u'name': u'env-vars'}}], u'image': u'ollivier/clearwater-bono:latest', u'volumeMounts': [{u'mountPath': u'/var/log/bono', u'name': u'bonologs'}], u'terminationMessagePolicy': u'File', u'env': [{u'valueFrom': {u'fieldRef': {u'fieldPath': u'status.podIP', u'apiVersion': u'v1'}}, u'name': u'MY_POD_IP'}], u'imagePullPolicy': u'Always', u'readinessProbe': {u'successThreshold': 1, u'periodSeconds': 10, u'failureThreshold': 3, u'timeoutSeconds': 1, u'exec': {u'command': [u'/bin/bash', u'/usr/share/kubernetes/liveness.sh', u'3478 5060 5062']}}, u'ports': [{u'protocol': u'TCP', u'containerPort': 22}, {u'protocol': u'TCP', u'containerPort': 3478}, {u'protocol': u'TCP', u'containerPort': 5060}, {u'protocol': u'TCP', u'containerPort': 5062}, {u'protocol': u'UDP', u'containerPort': 5060}, {u'protocol': u'UDP', u'containerPort': 5062}], u'resources': {}}, {u'terminationMessagePath': u'/dev/termination-log', u'name': u'tailer', u'image': u'busybox', u'volumeMounts': [{u'mountPath': u'/var/log/bono', u'name': u'bonologs'}], u'terminationMessagePolicy': u'File', u'command': [u'tail', u'-F', u'/var/log/bono/bono_current.txt'], u'imagePullPolicy': u'Always', u'resources': {}}]}, u'metadata': {u'labels': {u'snmp': u'enabled', u'service': u'bono'}, u'creationTimestamp': None}}, u'revisionHistoryLimit': 10, u'selector': {u'matchLabels': {u'service': u'bono'}}}, u'apiVersion': u'apps/v1', u'metadata': {u'name': u'bono', u'generation': 1, u'namespace': u'default', u'resourceVersion': u'2370042', u'creationTimestamp': u'2020-07-23T12:50:24Z', u'annotations': {u'deployment.kubernetes.io/revision': u'1'}, u'selfLink': u'/apis/apps/v1/namespaces/default/deployments/bono', u'uid': u'13aa120b-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {u'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'bono', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370042', 'self_link': '/apis/apps/v1/namespaces/default/deployments/bono', 'uid': '13aa120b-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {u'service': 'bono'}}, 'strategy': {'rolling_update': {'max_surge': u'25%', 'max_unavailable': u'25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {u'service': 'bono', u'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-bono:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 5062']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'bono', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 3478, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5060, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5062, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5060, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'UDP'}, {'container_port': 5062, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'UDP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 5062']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/bono', 'mount_propagation': None, 'name': 'bonologs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/bono/bono_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/bono', 'mount_propagation': None, 'name': 'bonologs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'bonologs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'message': 'ReplicaSet "bono-9858d478b" is progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, u'type': u'ADDED'} 2020-07-23 12:50:26,982 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'observedGeneration': 1, u'updatedReplicas': 1, u'unavailableReplicas': 1, u'conditions': [{u'status': u'False', u'lastUpdateTime': u'2020-07-23T12:50:25Z', u'lastTransitionTime': u'2020-07-23T12:50:25Z', u'reason': u'MinimumReplicasUnavailable', u'message': u'Deployment does not have minimum availability.', u'type': u'Available'}, {u'status': u'True', u'lastUpdateTime': u'2020-07-23T12:50:25Z', u'lastTransitionTime': u'2020-07-23T12:50:24Z', u'reason': u'ReplicaSetUpdated', u'message': u'ReplicaSet "cassandra-6d8c846bfc" is progressing.', u'type': u'Progressing'}], u'replicas': 1}, u'kind': u'Deployment', u'spec': {u'progressDeadlineSeconds': 600, u'replicas': 1, u'strategy': {u'rollingUpdate': {u'maxSurge': u'25%', u'maxUnavailable': u'25%'}, u'type': u'RollingUpdate'}, u'template': {u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'schedulerName': u'default-scheduler', u'terminationGracePeriodSeconds': 30, u'restartPolicy': u'Always', u'initContainers': [{u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-etcd', u'image': u'busybox:1.28', u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup etcd; do echo waiting for etcd to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}], u'imagePullSecrets': [{}], u'containers': [{u'livenessProbe': {u'timeoutSeconds': 1, u'exec': {u'command': [u'/bin/bash', u'/usr/share/kubernetes/liveness.sh', u'7000 9042 9160']}, u'initialDelaySeconds': 600, u'periodSeconds': 10, u'successThreshold': 1, u'failureThreshold': 3}, u'terminationMessagePath': u'/dev/termination-log', u'name': u'cassandra', u'envFrom': [{u'configMapRef': {u'name': u'env-vars'}}], u'image': u'ollivier/clearwater-cassandra:latest', u'terminationMessagePolicy': u'File', u'env': [{u'valueFrom': {u'fieldRef': {u'fieldPath': u'status.podIP', u'apiVersion': u'v1'}}, u'name': u'MY_POD_IP'}], u'imagePullPolicy': u'Always', u'readinessProbe': {u'successThreshold': 1, u'periodSeconds': 10, u'failureThreshold': 3, u'timeoutSeconds': 1, u'exec': {u'command': [u'/bin/bash', u'/usr/share/kubernetes/liveness.sh', u'7000 9042 9160']}}, u'ports': [{u'protocol': u'TCP', u'containerPort': 22}, {u'protocol': u'TCP', u'containerPort': 7001}, {u'protocol': u'TCP', u'containerPort': 9042}, {u'protocol': u'TCP', u'containerPort': 9160}], u'resources': {}}]}, u'metadata': {u'labels': {u'service': u'cassandra'}, u'creationTimestamp': None}}, u'revisionHistoryLimit': 10, u'selector': {u'matchLabels': {u'service': u'cassandra'}}}, u'apiVersion': u'apps/v1', u'metadata': {u'name': u'cassandra', u'generation': 1, u'namespace': u'default', u'resourceVersion': u'2370068', u'creationTimestamp': u'2020-07-23T12:50:24Z', u'annotations': {u'deployment.kubernetes.io/revision': u'1'}, u'selfLink': u'/apis/apps/v1/namespaces/default/deployments/cassandra', u'uid': u'13b0e0f0-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {u'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'cassandra', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370068', 'self_link': '/apis/apps/v1/namespaces/default/deployments/cassandra', 'uid': '13b0e0f0-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {u'service': 'cassandra'}}, 'strategy': {'rolling_update': {'max_surge': u'25%', 'max_unavailable': u'25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {u'service': 'cassandra'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-cassandra:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 9160']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 600, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'cassandra', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7001, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 9042, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 9160, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 9160']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup etcd; do echo waiting for etcd to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-etcd', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'message': 'ReplicaSet "cassandra-6d8c846bfc" is progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, u'type': u'ADDED'} 2020-07-23 12:50:27,030 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'observedGeneration': 1, u'updatedReplicas': 1, u'unavailableReplicas': 1, u'conditions': [{u'status': u'False', u'lastUpdateTime': u'2020-07-23T12:50:24Z', u'lastTransitionTime': u'2020-07-23T12:50:24Z', u'reason': u'MinimumReplicasUnavailable', u'message': u'Deployment does not have minimum availability.', u'type': u'Available'}, {u'status': u'True', u'lastUpdateTime': u'2020-07-23T12:50:24Z', u'lastTransitionTime': u'2020-07-23T12:50:24Z', u'reason': u'ReplicaSetUpdated', u'message': u'ReplicaSet "astaire-6c565bf445" is progressing.', u'type': u'Progressing'}], u'replicas': 1}, u'kind': u'Deployment', u'spec': {u'progressDeadlineSeconds': 600, u'replicas': 1, u'strategy': {u'rollingUpdate': {u'maxSurge': u'25%', u'maxUnavailable': u'25%'}, u'type': u'RollingUpdate'}, u'template': {u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'schedulerName': u'default-scheduler', u'terminationGracePeriodSeconds': 120, u'restartPolicy': u'Always', u'volumes': [{u'emptyDir': {}, u'name': u'astairelogs'}], u'initContainers': [{u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-cassandra', u'image': u'busybox:1.28', u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}], u'imagePullSecrets': [{}], u'containers': [{u'livenessProbe': {u'successThreshold': 1, u'tcpSocket': {u'port': 11311}, u'failureThreshold': 9, u'timeoutSeconds': 1, u'periodSeconds': 10}, u'terminationMessagePath': u'/dev/termination-log', u'name': u'astaire', u'envFrom': [{u'configMapRef': {u'name': u'env-vars'}}], u'image': u'ollivier/clearwater-astaire:latest', u'volumeMounts': [{u'mountPath': u'/var/log/astaire', u'name': u'astairelogs'}], u'terminationMessagePolicy': u'File', u'lifecycle': {u'preStop': {u'exec': {u'command': [u'/bin/bash', u'-c', u'/usr/bin/pre-stop']}}}, u'env': [{u'valueFrom': {u'fieldRef': {u'fieldPath': u'status.podIP', u'apiVersion': u'v1'}}, u'name': u'MY_POD_IP'}], u'imagePullPolicy': u'Always', u'readinessProbe': {u'successThreshold': 1, u'tcpSocket': {u'port': 11311}, u'failureThreshold': 3, u'timeoutSeconds': 1, u'periodSeconds': 10}, u'ports': [{u'protocol': u'TCP', u'containerPort': 22}, {u'protocol': u'TCP', u'containerPort': 11211}, {u'protocol': u'TCP', u'containerPort': 11311}], u'resources': {}}, {u'terminationMessagePath': u'/dev/termination-log', u'name': u'tailer', u'image': u'busybox', u'volumeMounts': [{u'mountPath': u'/var/log/astaire', u'name': u'astairelogs'}], u'terminationMessagePolicy': u'File', u'command': [u'tail', u'-F', u'/var/log/astaire/astaire_current.txt'], u'imagePullPolicy': u'Always', u'resources': {}}]}, u'metadata': {u'labels': {u'service': u'astaire'}, u'creationTimestamp': None}}, u'revisionHistoryLimit': 10, u'selector': {u'matchLabels': {u'service': u'astaire'}}}, u'apiVersion': u'apps/v1', u'metadata': {u'name': u'astaire', u'generation': 1, u'namespace': u'default', u'resourceVersion': u'2370035', u'creationTimestamp': u'2020-07-23T12:50:24Z', u'annotations': {u'deployment.kubernetes.io/revision': u'1'}, u'selfLink': u'/apis/apps/v1/namespaces/default/deployments/astaire', u'uid': u'13a0e4fe-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {u'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'astaire', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370035', 'self_link': '/apis/apps/v1/namespaces/default/deployments/astaire', 'uid': '13a0e4fe-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {u'service': 'astaire'}}, 'strategy': {'rolling_update': {'max_surge': u'25%', 'max_unavailable': u'25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {u'service': 'astaire'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-astaire:latest', 'image_pull_policy': 'Always', 'lifecycle': {'post_start': None, 'pre_stop': {'_exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}, 'http_get': None, 'tcp_socket': None}}, 'liveness_probe': {'_exec': None, 'failure_threshold': 9, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 11311}, 'timeout_seconds': 1}, 'name': 'astaire', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 11211, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 11311, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 11311}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/astaire', 'mount_propagation': None, 'name': 'astairelogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/astaire/astaire_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/astaire', 'mount_propagation': None, 'name': 'astairelogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 120, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'astairelogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'message': 'ReplicaSet "astaire-6c565bf445" is progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, u'type': u'ADDED'} 2020-07-23 12:50:27,087 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'observedGeneration': 1, u'updatedReplicas': 1, u'unavailableReplicas': 1, u'conditions': [{u'status': u'False', u'lastUpdateTime': u'2020-07-23T12:50:25Z', u'lastTransitionTime': u'2020-07-23T12:50:25Z', u'reason': u'MinimumReplicasUnavailable', u'message': u'Deployment does not have minimum availability.', u'type': u'Available'}, {u'status': u'True', u'lastUpdateTime': u'2020-07-23T12:50:25Z', u'lastTransitionTime': u'2020-07-23T12:50:24Z', u'reason': u'ReplicaSetUpdated', u'message': u'ReplicaSet "chronos-59fcbd7b47" is progressing.', u'type': u'Progressing'}], u'replicas': 1}, u'kind': u'Deployment', u'spec': {u'progressDeadlineSeconds': 600, u'replicas': 1, u'strategy': {u'rollingUpdate': {u'maxSurge': u'25%', u'maxUnavailable': u'25%'}, u'type': u'RollingUpdate'}, u'template': {u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'schedulerName': u'default-scheduler', u'terminationGracePeriodSeconds': 120, u'restartPolicy': u'Always', u'volumes': [{u'emptyDir': {}, u'name': u'chronoslogs'}], u'initContainers': [{u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-cassandra', u'image': u'busybox:1.28', u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}], u'imagePullSecrets': [{}], u'containers': [{u'livenessProbe': {u'successThreshold': 1, u'tcpSocket': {u'port': 7253}, u'failureThreshold': 9, u'timeoutSeconds': 1, u'periodSeconds': 10}, u'terminationMessagePath': u'/dev/termination-log', u'name': u'chronos', u'envFrom': [{u'configMapRef': {u'name': u'env-vars'}}], u'image': u'ollivier/clearwater-chronos:latest', u'volumeMounts': [{u'mountPath': u'/var/log/chronos', u'name': u'chronoslogs'}], u'terminationMessagePolicy': u'File', u'lifecycle': {u'preStop': {u'exec': {u'command': [u'/bin/bash', u'-c', u'/usr/bin/pre-stop']}}}, u'env': [{u'valueFrom': {u'fieldRef': {u'fieldPath': u'status.podIP', u'apiVersion': u'v1'}}, u'name': u'MY_POD_IP'}], u'imagePullPolicy': u'Always', u'readinessProbe': {u'successThreshold': 1, u'tcpSocket': {u'port': 7253}, u'failureThreshold': 3, u'timeoutSeconds': 1, u'periodSeconds': 10}, u'ports': [{u'protocol': u'TCP', u'containerPort': 22}, {u'protocol': u'TCP', u'containerPort': 7253}], u'resources': {}}, {u'terminationMessagePath': u'/dev/termination-log', u'name': u'tailer', u'image': u'busybox', u'volumeMounts': [{u'mountPath': u'/var/log/chronos', u'name': u'chronoslogs'}], u'terminationMessagePolicy': u'File', u'command': [u'tail', u'-F', u'/var/log/chronos/chronos_current.txt'], u'imagePullPolicy': u'Always', u'resources': {}}]}, u'metadata': {u'labels': {u'service': u'chronos'}, u'creationTimestamp': None}}, u'revisionHistoryLimit': 10, u'selector': {u'matchLabels': {u'service': u'chronos'}}}, u'apiVersion': u'apps/v1', u'metadata': {u'name': u'chronos', u'generation': 1, u'labels': {u'service': u'chronos'}, u'namespace': u'default', u'resourceVersion': u'2370118', u'creationTimestamp': u'2020-07-23T12:50:24Z', u'annotations': {u'deployment.kubernetes.io/revision': u'1'}, u'selfLink': u'/apis/apps/v1/namespaces/default/deployments/chronos', u'uid': u'13b7acd6-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {u'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {u'service': 'chronos'}, 'managed_fields': None, 'name': 'chronos', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370118', 'self_link': '/apis/apps/v1/namespaces/default/deployments/chronos', 'uid': '13b7acd6-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {u'service': 'chronos'}}, 'strategy': {'rolling_update': {'max_surge': u'25%', 'max_unavailable': u'25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {u'service': 'chronos'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-chronos:latest', 'image_pull_policy': 'Always', 'lifecycle': {'post_start': None, 'pre_stop': {'_exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}, 'http_get': None, 'tcp_socket': None}}, 'liveness_probe': {'_exec': None, 'failure_threshold': 9, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7253}, 'timeout_seconds': 1}, 'name': 'chronos', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7253, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7253}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/chronos', 'mount_propagation': None, 'name': 'chronoslogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/chronos/chronos_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/chronos', 'mount_propagation': None, 'name': 'chronoslogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 120, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'chronoslogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'message': 'ReplicaSet "chronos-59fcbd7b47" is progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, u'type': u'ADDED'} 2020-07-23 12:50:27,144 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'observedGeneration': 1, u'updatedReplicas': 1, u'unavailableReplicas': 1, u'conditions': [{u'status': u'False', u'lastUpdateTime': u'2020-07-23T12:50:25Z', u'lastTransitionTime': u'2020-07-23T12:50:25Z', u'reason': u'MinimumReplicasUnavailable', u'message': u'Deployment does not have minimum availability.', u'type': u'Available'}, {u'status': u'True', u'lastUpdateTime': u'2020-07-23T12:50:25Z', u'lastTransitionTime': u'2020-07-23T12:50:24Z', u'reason': u'ReplicaSetUpdated', u'message': u'ReplicaSet "ellis-6d885b94fc" is progressing.', u'type': u'Progressing'}], u'replicas': 1}, u'kind': u'Deployment', u'spec': {u'progressDeadlineSeconds': 600, u'replicas': 1, u'strategy': {u'rollingUpdate': {u'maxSurge': u'25%', u'maxUnavailable': u'25%'}, u'type': u'RollingUpdate'}, u'template': {u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'schedulerName': u'default-scheduler', u'terminationGracePeriodSeconds': 30, u'restartPolicy': u'Always', u'initContainers': [{u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-homestead-prov', u'image': u'busybox:1.28', u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup homestead-prov; do echo waiting for homestead-prov to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}, {u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-sprout', u'image': u'busybox:1.28', u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}], u'imagePullSecrets': [{}], u'containers': [{u'livenessProbe': {u'tcpSocket': {u'port': 80}, u'timeoutSeconds': 1, u'initialDelaySeconds': 30, u'periodSeconds': 10, u'successThreshold': 1, u'failureThreshold': 3}, u'terminationMessagePath': u'/dev/termination-log', u'name': u'ellis', u'envFrom': [{u'configMapRef': {u'name': u'env-vars'}}], u'image': u'ollivier/clearwater-ellis:latest', u'terminationMessagePolicy': u'File', u'env': [{u'valueFrom': {u'fieldRef': {u'fieldPath': u'status.podIP', u'apiVersion': u'v1'}}, u'name': u'MY_POD_IP'}], u'imagePullPolicy': u'Always', u'readinessProbe': {u'successThreshold': 1, u'tcpSocket': {u'port': 80}, u'failureThreshold': 3, u'timeoutSeconds': 1, u'periodSeconds': 10}, u'ports': [{u'protocol': u'TCP', u'containerPort': 22}, {u'protocol': u'TCP', u'containerPort': 80}], u'resources': {}}]}, u'metadata': {u'labels': {u'service': u'ellis'}, u'creationTimestamp': None}}, u'revisionHistoryLimit': 10, u'selector': {u'matchLabels': {u'service': u'ellis'}}}, u'apiVersion': u'apps/v1', u'metadata': {u'name': u'ellis', u'generation': 1, u'namespace': u'default', u'resourceVersion': u'2370080', u'creationTimestamp': u'2020-07-23T12:50:24Z', u'annotations': {u'deployment.kubernetes.io/revision': u'1'}, u'selfLink': u'/apis/apps/v1/namespaces/default/deployments/ellis', u'uid': u'13c0761c-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {u'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'ellis', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370080', 'self_link': '/apis/apps/v1/namespaces/default/deployments/ellis', 'uid': '13c0761c-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {u'service': 'ellis'}}, 'strategy': {'rolling_update': {'max_surge': u'25%', 'max_unavailable': u'25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {u'service': 'ellis'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-ellis:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 80}, 'timeout_seconds': 1}, 'name': 'ellis', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 80, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 80}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup homestead-prov; do echo waiting for homestead-prov to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead-prov', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'message': 'ReplicaSet "ellis-6d885b94fc" is progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, u'type': u'ADDED'} 2020-07-23 12:50:27,191 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'observedGeneration': 1, u'updatedReplicas': 1, u'unavailableReplicas': 1, u'conditions': [{u'status': u'False', u'lastUpdateTime': u'2020-07-23T12:50:26Z', u'lastTransitionTime': u'2020-07-23T12:50:26Z', u'reason': u'MinimumReplicasUnavailable', u'message': u'Deployment does not have minimum availability.', u'type': u'Available'}, {u'status': u'True', u'lastUpdateTime': u'2020-07-23T12:50:26Z', u'lastTransitionTime': u'2020-07-23T12:50:25Z', u'reason': u'ReplicaSetUpdated', u'message': u'ReplicaSet "homestead-7dbf49f967" is progressing.', u'type': u'Progressing'}], u'replicas': 1}, u'kind': u'Deployment', u'spec': {u'progressDeadlineSeconds': 600, u'replicas': 1, u'strategy': {u'rollingUpdate': {u'maxSurge': u'25%', u'maxUnavailable': u'25%'}, u'type': u'RollingUpdate'}, u'template': {u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'schedulerName': u'default-scheduler', u'terminationGracePeriodSeconds': 30, u'restartPolicy': u'Always', u'volumes': [{u'emptyDir': {}, u'name': u'homesteadlogs'}], u'initContainers': [{u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-cassandra', u'image': u'busybox:1.28', u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}, {u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-astaire', u'image': u'busybox:1.28', u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup astaire; do echo waiting for astaire to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}], u'imagePullSecrets': [{}], u'containers': [{u'livenessProbe': {u'timeoutSeconds': 1, u'exec': {u'command': [u'/bin/bash', u'/usr/share/kubernetes/liveness.sh', u'8888']}, u'initialDelaySeconds': 60, u'periodSeconds': 10, u'successThreshold': 1, u'failureThreshold': 3}, u'terminationMessagePath': u'/dev/termination-log', u'name': u'homestead', u'envFrom': [{u'configMapRef': {u'name': u'env-vars'}}], u'image': u'ollivier/clearwater-homestead:latest', u'volumeMounts': [{u'mountPath': u'/var/log/homestead', u'name': u'homesteadlogs'}], u'terminationMessagePolicy': u'File', u'env': [{u'valueFrom': {u'fieldRef': {u'fieldPath': u'status.podIP', u'apiVersion': u'v1'}}, u'name': u'MY_POD_IP'}], u'imagePullPolicy': u'Always', u'readinessProbe': {u'successThreshold': 1, u'periodSeconds': 10, u'failureThreshold': 3, u'timeoutSeconds': 1, u'exec': {u'command': [u'/bin/bash', u'/usr/share/kubernetes/liveness.sh', u'8888']}}, u'ports': [{u'protocol': u'TCP', u'containerPort': 22}, {u'protocol': u'TCP', u'containerPort': 8888}], u'resources': {}}, {u'terminationMessagePath': u'/dev/termination-log', u'name': u'tailer', u'image': u'busybox', u'volumeMounts': [{u'mountPath': u'/var/log/homestead', u'name': u'homesteadlogs'}], u'terminationMessagePolicy': u'File', u'command': [u'tail', u'-F', u'/var/log/homestead/homestead_current.txt'], u'imagePullPolicy': u'Always', u'resources': {}}]}, u'metadata': {u'labels': {u'snmp': u'enabled', u'service': u'homestead'}, u'creationTimestamp': None}}, u'revisionHistoryLimit': 10, u'selector': {u'matchLabels': {u'service': u'homestead'}}}, u'apiVersion': u'apps/v1', u'metadata': {u'name': u'homestead', u'generation': 1, u'namespace': u'default', u'resourceVersion': u'2370138', u'creationTimestamp': u'2020-07-23T12:50:25Z', u'annotations': {u'deployment.kubernetes.io/revision': u'1'}, u'selfLink': u'/apis/apps/v1/namespaces/default/deployments/homestead', u'uid': u'13dc3f56-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {u'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homestead', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370138', 'self_link': '/apis/apps/v1/namespaces/default/deployments/homestead', 'uid': '13dc3f56-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {u'service': 'homestead'}}, 'strategy': {'rolling_update': {'max_surge': u'25%', 'max_unavailable': u'25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {u'service': 'homestead', u'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/homestead', 'mount_propagation': None, 'name': 'homesteadlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/homestead/homestead_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/homestead', 'mount_propagation': None, 'name': 'homesteadlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until nslookup astaire; do echo waiting for astaire to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-astaire', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'homesteadlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 26, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 50, 26, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 50, 26, tzinfo=tzlocal()), 'message': 'ReplicaSet "homestead-7dbf49f967" is progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, u'type': u'ADDED'} 2020-07-23 12:50:27,252 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'observedGeneration': 1, u'updatedReplicas': 1, u'unavailableReplicas': 1, u'conditions': [{u'status': u'False', u'lastUpdateTime': u'2020-07-23T12:50:26Z', u'lastTransitionTime': u'2020-07-23T12:50:26Z', u'reason': u'MinimumReplicasUnavailable', u'message': u'Deployment does not have minimum availability.', u'type': u'Available'}, {u'status': u'True', u'lastUpdateTime': u'2020-07-23T12:50:26Z', u'lastTransitionTime': u'2020-07-23T12:50:26Z', u'reason': u'ReplicaSetUpdated', u'message': u'ReplicaSet "ralf-744548cc6d" is progressing.', u'type': u'Progressing'}], u'replicas': 1}, u'kind': u'Deployment', u'spec': {u'progressDeadlineSeconds': 600, u'replicas': 1, u'strategy': {u'rollingUpdate': {u'maxSurge': u'25%', u'maxUnavailable': u'25%'}, u'type': u'RollingUpdate'}, u'template': {u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'schedulerName': u'default-scheduler', u'terminationGracePeriodSeconds': 30, u'restartPolicy': u'Always', u'volumes': [{u'emptyDir': {}, u'name': u'ralflogs'}], u'initContainers': [{u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-cassandra', u'image': u'busybox:1.28', u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}], u'imagePullSecrets': [{}], u'containers': [{u'livenessProbe': {u'tcpSocket': {u'port': 10888}, u'timeoutSeconds': 1, u'initialDelaySeconds': 30, u'periodSeconds': 10, u'successThreshold': 1, u'failureThreshold': 3}, u'terminationMessagePath': u'/dev/termination-log', u'name': u'ralf', u'envFrom': [{u'configMapRef': {u'name': u'env-vars'}}], u'image': u'ollivier/clearwater-ralf:latest', u'volumeMounts': [{u'mountPath': u'/var/log/ralf', u'name': u'ralflogs'}], u'terminationMessagePolicy': u'File', u'env': [{u'valueFrom': {u'fieldRef': {u'fieldPath': u'status.podIP', u'apiVersion': u'v1'}}, u'name': u'MY_POD_IP'}], u'imagePullPolicy': u'Always', u'readinessProbe': {u'successThreshold': 1, u'tcpSocket': {u'port': 10888}, u'failureThreshold': 3, u'timeoutSeconds': 1, u'periodSeconds': 10}, u'ports': [{u'protocol': u'TCP', u'containerPort': 22}, {u'protocol': u'TCP', u'containerPort': 10888}], u'resources': {}}, {u'terminationMessagePath': u'/dev/termination-log', u'name': u'tailer', u'image': u'busybox', u'volumeMounts': [{u'mountPath': u'/var/log/ralf', u'name': u'ralflogs'}], u'terminationMessagePolicy': u'File', u'command': [u'tail', u'-F', u'/var/log/ralf/ralf_current.txt'], u'imagePullPolicy': u'Always', u'resources': {}}]}, u'metadata': {u'labels': {u'snmp': u'enabled', u'service': u'ralf'}, u'creationTimestamp': None}}, u'revisionHistoryLimit': 10, u'selector': {u'matchLabels': {u'service': u'ralf'}}}, u'apiVersion': u'apps/v1', u'metadata': {u'name': u'ralf', u'generation': 1, u'namespace': u'default', u'resourceVersion': u'2370156', u'creationTimestamp': u'2020-07-23T12:50:25Z', u'annotations': {u'deployment.kubernetes.io/revision': u'1'}, u'selfLink': u'/apis/apps/v1/namespaces/default/deployments/ralf', u'uid': u'13eb1524-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {u'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'ralf', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370156', 'self_link': '/apis/apps/v1/namespaces/default/deployments/ralf', 'uid': '13eb1524-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {u'service': 'ralf'}}, 'strategy': {'rolling_update': {'max_surge': u'25%', 'max_unavailable': u'25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {u'service': 'ralf', u'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-ralf:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'name': 'ralf', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 10888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'ralflogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 26, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 50, 26, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 26, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 50, 26, tzinfo=tzlocal()), 'message': 'ReplicaSet "ralf-744548cc6d" is progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, u'type': u'ADDED'} 2020-07-23 12:50:27,306 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'observedGeneration': 1, u'updatedReplicas': 1, u'unavailableReplicas': 1, u'conditions': [{u'status': u'False', u'lastUpdateTime': u'2020-07-23T12:50:26Z', u'lastTransitionTime': u'2020-07-23T12:50:26Z', u'reason': u'MinimumReplicasUnavailable', u'message': u'Deployment does not have minimum availability.', u'type': u'Available'}, {u'status': u'True', u'lastUpdateTime': u'2020-07-23T12:50:26Z', u'lastTransitionTime': u'2020-07-23T12:50:26Z', u'reason': u'ReplicaSetUpdated', u'message': u'ReplicaSet "sprout-fb8745f94" is progressing.', u'type': u'Progressing'}], u'replicas': 1}, u'kind': u'Deployment', u'spec': {u'progressDeadlineSeconds': 600, u'replicas': 1, u'strategy': {u'rollingUpdate': {u'maxSurge': u'25%', u'maxUnavailable': u'25%'}, u'type': u'RollingUpdate'}, u'template': {u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'schedulerName': u'default-scheduler', u'terminationGracePeriodSeconds': 30, u'restartPolicy': u'Always', u'volumes': [{u'emptyDir': {}, u'name': u'sproutlogs'}], u'initContainers': [{u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-ralf', u'image': u'busybox:1.28', u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup ralf; do echo waiting for ralf to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}, {u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-chronos', u'image': u'busybox:1.28', u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup chronos; do echo waiting for chronos to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}, {u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-homestead', u'image': u'busybox:1.28', u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}], u'imagePullSecrets': [{}], u'containers': [{u'livenessProbe': {u'timeoutSeconds': 1, u'exec': {u'command': [u'/bin/bash', u'/usr/share/kubernetes/liveness.sh', u'5052 5054']}, u'initialDelaySeconds': 30, u'periodSeconds': 3, u'successThreshold': 1, u'failureThreshold': 3}, u'terminationMessagePath': u'/dev/termination-log', u'name': u'sprout', u'envFrom': [{u'configMapRef': {u'name': u'env-vars'}}], u'image': u'ollivier/clearwater-sprout:latest', u'volumeMounts': [{u'mountPath': u'/var/log/sprout', u'name': u'sproutlogs'}], u'terminationMessagePolicy': u'File', u'env': [{u'valueFrom': {u'fieldRef': {u'fieldPath': u'status.podIP', u'apiVersion': u'v1'}}, u'name': u'MY_POD_IP'}], u'imagePullPolicy': u'Always', u'readinessProbe': {u'successThreshold': 1, u'periodSeconds': 10, u'failureThreshold': 3, u'timeoutSeconds': 1, u'exec': {u'command': [u'/bin/bash', u'/usr/share/kubernetes/liveness.sh', u'5052 5054']}}, u'ports': [{u'protocol': u'TCP', u'containerPort': 22}], u'resources': {}}, {u'terminationMessagePath': u'/dev/termination-log', u'name': u'tailer', u'image': u'busybox', u'volumeMounts': [{u'mountPath': u'/var/log/sprout', u'name': u'sproutlogs'}], u'terminationMessagePolicy': u'File', u'command': [u'tail', u'-F', u'/var/log/sprout/sprout_current.txt'], u'imagePullPolicy': u'Always', u'resources': {}}]}, u'metadata': {u'labels': {u'snmp': u'enabled', u'service': u'sprout'}, u'creationTimestamp': None}}, u'revisionHistoryLimit': 10, u'selector': {u'matchLabels': {u'service': u'sprout'}}}, u'apiVersion': u'apps/v1', u'metadata': {u'name': u'sprout', u'generation': 1, u'namespace': u'default', u'resourceVersion': u'2370155', u'creationTimestamp': u'2020-07-23T12:50:25Z', u'annotations': {u'deployment.kubernetes.io/revision': u'1'}, u'selfLink': u'/apis/apps/v1/namespaces/default/deployments/sprout', u'uid': u'13f2cd09-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {u'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'sprout', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370155', 'self_link': '/apis/apps/v1/namespaces/default/deployments/sprout', 'uid': '13f2cd09-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {u'service': 'sprout'}}, 'strategy': {'rolling_update': {'max_surge': u'25%', 'max_unavailable': u'25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {u'service': 'sprout', u'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-sprout:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 3, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'sprout', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup ralf; do echo waiting for ralf to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-ralf', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until nslookup chronos; do echo waiting for chronos to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-chronos', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'sproutlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 26, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 50, 26, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 26, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 50, 26, tzinfo=tzlocal()), 'message': 'ReplicaSet "sprout-fb8745f94" is progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, u'type': u'ADDED'} 2020-07-23 12:50:39,279 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'replicas': 1, u'observedGeneration': 1, u'updatedReplicas': 1, u'availableReplicas': 1, u'readyReplicas': 1, u'conditions': [{u'status': u'True', u'lastUpdateTime': u'2020-07-23T12:50:39Z', u'lastTransitionTime': u'2020-07-23T12:50:39Z', u'reason': u'MinimumReplicasAvailable', u'message': u'Deployment has minimum availability.', u'type': u'Available'}, {u'status': u'True', u'lastUpdateTime': u'2020-07-23T12:50:39Z', u'lastTransitionTime': u'2020-07-23T12:50:25Z', u'reason': u'NewReplicaSetAvailable', u'message': u'ReplicaSet "etcd-c8fddbb95" has successfully progressed.', u'type': u'Progressing'}]}, u'kind': u'Deployment', u'spec': {u'progressDeadlineSeconds': 600, u'replicas': 1, u'strategy': {u'rollingUpdate': {u'maxSurge': u'25%', u'maxUnavailable': u'25%'}, u'type': u'RollingUpdate'}, u'template': {u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'schedulerName': u'default-scheduler', u'terminationGracePeriodSeconds': 30, u'restartPolicy': u'Always', u'imagePullSecrets': [{}], u'containers': [{u'livenessProbe': {u'tcpSocket': {u'port': 4001}, u'timeoutSeconds': 1, u'initialDelaySeconds': 300, u'periodSeconds': 10, u'successThreshold': 1, u'failureThreshold': 3}, u'terminationMessagePath': u'/dev/termination-log', u'name': u'etcd', u'image': u'quay.io/coreos/etcd:v2.2.5', u'args': [u'--name', u'$(MY_POD_NAME)', u'--advertise-client-urls', u'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', u'--listen-client-urls', u'http://0.0.0.0:2379,http://0.0.0.0:4001', u'--initial-advertise-peer-urls', u'http://$(MY_POD_IP):2380', u'--listen-peer-urls', u'http://0.0.0.0:2380', u'--initial-cluster', u'$(MY_POD_NAME)=http://$(MY_POD_IP):2380', u'--initial-cluster-state', u'new'], u'terminationMessagePolicy': u'File', u'env': [{u'valueFrom': {u'fieldRef': {u'fieldPath': u'status.podIP', u'apiVersion': u'v1'}}, u'name': u'MY_POD_IP'}, {u'valueFrom': {u'fieldRef': {u'fieldPath': u'metadata.name', u'apiVersion': u'v1'}}, u'name': u'MY_POD_NAME'}], u'imagePullPolicy': u'IfNotPresent', u'readinessProbe': {u'successThreshold': 1, u'tcpSocket': {u'port': 4001}, u'failureThreshold': 3, u'timeoutSeconds': 1, u'periodSeconds': 10}, u'ports': [{u'protocol': u'TCP', u'containerPort': 2379}, {u'protocol': u'TCP', u'containerPort': 2380}, {u'protocol': u'TCP', u'containerPort': 4001}], u'resources': {}}]}, u'metadata': {u'labels': {u'instance-type': u'etcd-pod'}, u'creationTimestamp': None}}, u'revisionHistoryLimit': 10, u'selector': {u'matchLabels': {u'instance-type': u'etcd-pod'}}}, u'apiVersion': u'apps/v1', u'metadata': {u'name': u'etcd', u'generation': 1, u'namespace': u'default', u'resourceVersion': u'2370248', u'creationTimestamp': u'2020-07-23T12:50:24Z', u'annotations': {u'deployment.kubernetes.io/revision': u'1'}, u'selfLink': u'/apis/apps/v1/namespaces/default/deployments/etcd', u'uid': u'13ca41c4-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {u'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'etcd', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370248', 'self_link': '/apis/apps/v1/namespaces/default/deployments/etcd', 'uid': '13ca41c4-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {u'instance-type': 'etcd-pod'}}, 'strategy': {'rolling_update': {'max_surge': u'25%', 'max_unavailable': u'25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {u'instance-type': 'etcd-pod'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': ['--name', '$(MY_POD_NAME)', '--advertise-client-urls', 'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', '--listen-client-urls', 'http://0.0.0.0:2379,http://0.0.0.0:4001', '--initial-advertise-peer-urls', 'http://$(MY_POD_IP):2380', '--listen-peer-urls', 'http://0.0.0.0:2380', '--initial-cluster', '$(MY_POD_NAME)=http://$(MY_POD_IP):2380', '--initial-cluster-state', 'new'], 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}, {'name': 'MY_POD_NAME', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'metadata.name'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': None, 'image': 'quay.io/coreos/etcd:v2.2.5', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 300, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 4001}, 'timeout_seconds': 1}, 'name': 'etcd', 'ports': [{'container_port': 2379, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 2380, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 4001, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 4001}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 39, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 50, 39, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 50, 39, tzinfo=tzlocal()), 'message': 'ReplicaSet "etcd-c8fddbb95" has successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, u'type': u'MODIFIED'} 2020-07-23 12:50:39,321 - functest_kubernetes.ims.ims - INFO - etcd started in 14.66 sec 2020-07-23 12:52:05,966 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'replicas': 1, u'observedGeneration': 1, u'updatedReplicas': 1, u'availableReplicas': 1, u'readyReplicas': 1, u'conditions': [{u'status': u'True', u'lastUpdateTime': u'2020-07-23T12:52:05Z', u'lastTransitionTime': u'2020-07-23T12:52:05Z', u'reason': u'MinimumReplicasAvailable', u'message': u'Deployment has minimum availability.', u'type': u'Available'}, {u'status': u'True', u'lastUpdateTime': u'2020-07-23T12:52:05Z', u'lastTransitionTime': u'2020-07-23T12:50:24Z', u'reason': u'NewReplicaSetAvailable', u'message': u'ReplicaSet "cassandra-6d8c846bfc" has successfully progressed.', u'type': u'Progressing'}]}, u'kind': u'Deployment', u'spec': {u'progressDeadlineSeconds': 600, u'replicas': 1, u'strategy': {u'rollingUpdate': {u'maxSurge': u'25%', u'maxUnavailable': u'25%'}, u'type': u'RollingUpdate'}, u'template': {u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'schedulerName': u'default-scheduler', u'terminationGracePeriodSeconds': 30, u'restartPolicy': u'Always', u'initContainers': [{u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-etcd', u'image': u'busybox:1.28', u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup etcd; do echo waiting for etcd to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}], u'imagePullSecrets': [{}], u'containers': [{u'livenessProbe': {u'timeoutSeconds': 1, u'exec': {u'command': [u'/bin/bash', u'/usr/share/kubernetes/liveness.sh', u'7000 9042 9160']}, u'initialDelaySeconds': 600, u'periodSeconds': 10, u'successThreshold': 1, u'failureThreshold': 3}, u'terminationMessagePath': u'/dev/termination-log', u'name': u'cassandra', u'envFrom': [{u'configMapRef': {u'name': u'env-vars'}}], u'image': u'ollivier/clearwater-cassandra:latest', u'terminationMessagePolicy': u'File', u'env': [{u'valueFrom': {u'fieldRef': {u'fieldPath': u'status.podIP', u'apiVersion': u'v1'}}, u'name': u'MY_POD_IP'}], u'imagePullPolicy': u'Always', u'readinessProbe': {u'successThreshold': 1, u'periodSeconds': 10, u'failureThreshold': 3, u'timeoutSeconds': 1, u'exec': {u'command': [u'/bin/bash', u'/usr/share/kubernetes/liveness.sh', u'7000 9042 9160']}}, u'ports': [{u'protocol': u'TCP', u'containerPort': 22}, {u'protocol': u'TCP', u'containerPort': 7001}, {u'protocol': u'TCP', u'containerPort': 9042}, {u'protocol': u'TCP', u'containerPort': 9160}], u'resources': {}}]}, u'metadata': {u'labels': {u'service': u'cassandra'}, u'creationTimestamp': None}}, u'revisionHistoryLimit': 10, u'selector': {u'matchLabels': {u'service': u'cassandra'}}}, u'apiVersion': u'apps/v1', u'metadata': {u'name': u'cassandra', u'generation': 1, u'namespace': u'default', u'resourceVersion': u'2370429', u'creationTimestamp': u'2020-07-23T12:50:24Z', u'annotations': {u'deployment.kubernetes.io/revision': u'1'}, u'selfLink': u'/apis/apps/v1/namespaces/default/deployments/cassandra', u'uid': u'13b0e0f0-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {u'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'cassandra', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370429', 'self_link': '/apis/apps/v1/namespaces/default/deployments/cassandra', 'uid': '13b0e0f0-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {u'service': 'cassandra'}}, 'strategy': {'rolling_update': {'max_surge': u'25%', 'max_unavailable': u'25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {u'service': 'cassandra'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-cassandra:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 9160']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 600, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'cassandra', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7001, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 9042, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 9160, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 9160']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup etcd; do echo waiting for etcd to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-etcd', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 23, 12, 52, 5, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 52, 5, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 52, 5, tzinfo=tzlocal()), 'message': 'ReplicaSet "cassandra-6d8c846bfc" has successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, u'type': u'MODIFIED'} 2020-07-23 12:52:06,012 - functest_kubernetes.ims.ims - INFO - cassandra started in 101.35 sec 2020-07-23 12:52:55,114 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'replicas': 1, u'observedGeneration': 1, u'updatedReplicas': 1, u'availableReplicas': 1, u'readyReplicas': 1, u'conditions': [{u'status': u'True', u'lastUpdateTime': u'2020-07-23T12:52:54Z', u'lastTransitionTime': u'2020-07-23T12:52:54Z', u'reason': u'MinimumReplicasAvailable', u'message': u'Deployment has minimum availability.', u'type': u'Available'}, {u'status': u'True', u'lastUpdateTime': u'2020-07-23T12:52:54Z', u'lastTransitionTime': u'2020-07-23T12:50:25Z', u'reason': u'NewReplicaSetAvailable', u'message': u'ReplicaSet "homer-58cfb54cd9" has successfully progressed.', u'type': u'Progressing'}]}, u'kind': u'Deployment', u'spec': {u'progressDeadlineSeconds': 600, u'replicas': 1, u'strategy': {u'rollingUpdate': {u'maxSurge': u'25%', u'maxUnavailable': u'25%'}, u'type': u'RollingUpdate'}, u'template': {u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'schedulerName': u'default-scheduler', u'terminationGracePeriodSeconds': 30, u'restartPolicy': u'Always', u'initContainers': [{u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-cassandra', u'image': u'busybox:1.28', u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}], u'imagePullSecrets': [{}], u'containers': [{u'livenessProbe': {u'tcpSocket': {u'port': 7888}, u'timeoutSeconds': 1, u'initialDelaySeconds': 30, u'periodSeconds': 10, u'successThreshold': 1, u'failureThreshold': 3}, u'terminationMessagePath': u'/dev/termination-log', u'name': u'homer', u'envFrom': [{u'configMapRef': {u'name': u'env-vars'}}], u'image': u'ollivier/clearwater-homer:latest', u'terminationMessagePolicy': u'File', u'env': [{u'valueFrom': {u'fieldRef': {u'fieldPath': u'status.podIP', u'apiVersion': u'v1'}}, u'name': u'MY_POD_IP'}], u'imagePullPolicy': u'Always', u'readinessProbe': {u'successThreshold': 1, u'tcpSocket': {u'port': 7888}, u'failureThreshold': 3, u'timeoutSeconds': 1, u'periodSeconds': 10}, u'ports': [{u'protocol': u'TCP', u'containerPort': 22}, {u'protocol': u'TCP', u'containerPort': 7888}], u'resources': {}}]}, u'metadata': {u'labels': {u'service': u'homer'}, u'creationTimestamp': None}}, u'revisionHistoryLimit': 10, u'selector': {u'matchLabels': {u'service': u'homer'}}}, u'apiVersion': u'apps/v1', u'metadata': {u'name': u'homer', u'generation': 1, u'namespace': u'default', u'resourceVersion': u'2370562', u'creationTimestamp': u'2020-07-23T12:50:25Z', u'annotations': {u'deployment.kubernetes.io/revision': u'1'}, u'selfLink': u'/apis/apps/v1/namespaces/default/deployments/homer', u'uid': u'13d524a5-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {u'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homer', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370562', 'self_link': '/apis/apps/v1/namespaces/default/deployments/homer', 'uid': '13d524a5-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {u'service': 'homer'}}, 'strategy': {'rolling_update': {'max_surge': u'25%', 'max_unavailable': u'25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {u'service': 'homer'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homer:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'name': 'homer', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 23, 12, 52, 54, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 52, 54, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 52, 54, tzinfo=tzlocal()), 'message': 'ReplicaSet "homer-58cfb54cd9" has successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, u'type': u'MODIFIED'} 2020-07-23 12:52:55,160 - functest_kubernetes.ims.ims - INFO - homer started in 150.50 sec 2020-07-23 12:52:56,632 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'replicas': 1, u'observedGeneration': 1, u'updatedReplicas': 1, u'availableReplicas': 1, u'readyReplicas': 1, u'conditions': [{u'status': u'True', u'lastUpdateTime': u'2020-07-23T12:52:56Z', u'lastTransitionTime': u'2020-07-23T12:52:56Z', u'reason': u'MinimumReplicasAvailable', u'message': u'Deployment has minimum availability.', u'type': u'Available'}, {u'status': u'True', u'lastUpdateTime': u'2020-07-23T12:52:56Z', u'lastTransitionTime': u'2020-07-23T12:50:26Z', u'reason': u'NewReplicaSetAvailable', u'message': u'ReplicaSet "ralf-744548cc6d" has successfully progressed.', u'type': u'Progressing'}]}, u'kind': u'Deployment', u'spec': {u'progressDeadlineSeconds': 600, u'replicas': 1, u'strategy': {u'rollingUpdate': {u'maxSurge': u'25%', u'maxUnavailable': u'25%'}, u'type': u'RollingUpdate'}, u'template': {u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'schedulerName': u'default-scheduler', u'terminationGracePeriodSeconds': 30, u'restartPolicy': u'Always', u'volumes': [{u'emptyDir': {}, u'name': u'ralflogs'}], u'initContainers': [{u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-cassandra', u'image': u'busybox:1.28', u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}], u'imagePullSecrets': [{}], u'containers': [{u'livenessProbe': {u'tcpSocket': {u'port': 10888}, u'timeoutSeconds': 1, u'initialDelaySeconds': 30, u'periodSeconds': 10, u'successThreshold': 1, u'failureThreshold': 3}, u'terminationMessagePath': u'/dev/termination-log', u'name': u'ralf', u'envFrom': [{u'configMapRef': {u'name': u'env-vars'}}], u'image': u'ollivier/clearwater-ralf:latest', u'volumeMounts': [{u'mountPath': u'/var/log/ralf', u'name': u'ralflogs'}], u'terminationMessagePolicy': u'File', u'env': [{u'valueFrom': {u'fieldRef': {u'fieldPath': u'status.podIP', u'apiVersion': u'v1'}}, u'name': u'MY_POD_IP'}], u'imagePullPolicy': u'Always', u'readinessProbe': {u'successThreshold': 1, u'tcpSocket': {u'port': 10888}, u'failureThreshold': 3, u'timeoutSeconds': 1, u'periodSeconds': 10}, u'ports': [{u'protocol': u'TCP', u'containerPort': 22}, {u'protocol': u'TCP', u'containerPort': 10888}], u'resources': {}}, {u'terminationMessagePath': u'/dev/termination-log', u'name': u'tailer', u'image': u'busybox', u'volumeMounts': [{u'mountPath': u'/var/log/ralf', u'name': u'ralflogs'}], u'terminationMessagePolicy': u'File', u'command': [u'tail', u'-F', u'/var/log/ralf/ralf_current.txt'], u'imagePullPolicy': u'Always', u'resources': {}}]}, u'metadata': {u'labels': {u'snmp': u'enabled', u'service': u'ralf'}, u'creationTimestamp': None}}, u'revisionHistoryLimit': 10, u'selector': {u'matchLabels': {u'service': u'ralf'}}}, u'apiVersion': u'apps/v1', u'metadata': {u'name': u'ralf', u'generation': 1, u'namespace': u'default', u'resourceVersion': u'2370573', u'creationTimestamp': u'2020-07-23T12:50:25Z', u'annotations': {u'deployment.kubernetes.io/revision': u'1'}, u'selfLink': u'/apis/apps/v1/namespaces/default/deployments/ralf', u'uid': u'13eb1524-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {u'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'ralf', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370573', 'self_link': '/apis/apps/v1/namespaces/default/deployments/ralf', 'uid': '13eb1524-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {u'service': 'ralf'}}, 'strategy': {'rolling_update': {'max_surge': u'25%', 'max_unavailable': u'25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {u'service': 'ralf', u'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-ralf:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'name': 'ralf', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 10888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'ralflogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 23, 12, 52, 56, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 52, 56, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 26, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 52, 56, tzinfo=tzlocal()), 'message': 'ReplicaSet "ralf-744548cc6d" has successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, u'type': u'MODIFIED'} 2020-07-23 12:52:56,687 - functest_kubernetes.ims.ims - INFO - ralf started in 152.03 sec 2020-07-23 12:53:02,990 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'replicas': 1, u'observedGeneration': 1, u'updatedReplicas': 1, u'availableReplicas': 1, u'readyReplicas': 1, u'conditions': [{u'status': u'True', u'lastUpdateTime': u'2020-07-23T12:53:02Z', u'lastTransitionTime': u'2020-07-23T12:53:02Z', u'reason': u'MinimumReplicasAvailable', u'message': u'Deployment has minimum availability.', u'type': u'Available'}, {u'status': u'True', u'lastUpdateTime': u'2020-07-23T12:53:02Z', u'lastTransitionTime': u'2020-07-23T12:50:24Z', u'reason': u'NewReplicaSetAvailable', u'message': u'ReplicaSet "chronos-59fcbd7b47" has successfully progressed.', u'type': u'Progressing'}]}, u'kind': u'Deployment', u'spec': {u'progressDeadlineSeconds': 600, u'replicas': 1, u'strategy': {u'rollingUpdate': {u'maxSurge': u'25%', u'maxUnavailable': u'25%'}, u'type': u'RollingUpdate'}, u'template': {u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'schedulerName': u'default-scheduler', u'terminationGracePeriodSeconds': 120, u'restartPolicy': u'Always', u'volumes': [{u'emptyDir': {}, u'name': u'chronoslogs'}], u'initContainers': [{u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-cassandra', u'image': u'busybox:1.28', u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}], u'imagePullSecrets': [{}], u'containers': [{u'livenessProbe': {u'successThreshold': 1, u'tcpSocket': {u'port': 7253}, u'failureThreshold': 9, u'timeoutSeconds': 1, u'periodSeconds': 10}, u'terminationMessagePath': u'/dev/termination-log', u'name': u'chronos', u'envFrom': [{u'configMapRef': {u'name': u'env-vars'}}], u'image': u'ollivier/clearwater-chronos:latest', u'volumeMounts': [{u'mountPath': u'/var/log/chronos', u'name': u'chronoslogs'}], u'terminationMessagePolicy': u'File', u'lifecycle': {u'preStop': {u'exec': {u'command': [u'/bin/bash', u'-c', u'/usr/bin/pre-stop']}}}, u'env': [{u'valueFrom': {u'fieldRef': {u'fieldPath': u'status.podIP', u'apiVersion': u'v1'}}, u'name': u'MY_POD_IP'}], u'imagePullPolicy': u'Always', u'readinessProbe': {u'successThreshold': 1, u'tcpSocket': {u'port': 7253}, u'failureThreshold': 3, u'timeoutSeconds': 1, u'periodSeconds': 10}, u'ports': [{u'protocol': u'TCP', u'containerPort': 22}, {u'protocol': u'TCP', u'containerPort': 7253}], u'resources': {}}, {u'terminationMessagePath': u'/dev/termination-log', u'name': u'tailer', u'image': u'busybox', u'volumeMounts': [{u'mountPath': u'/var/log/chronos', u'name': u'chronoslogs'}], u'terminationMessagePolicy': u'File', u'command': [u'tail', u'-F', u'/var/log/chronos/chronos_current.txt'], u'imagePullPolicy': u'Always', u'resources': {}}]}, u'metadata': {u'labels': {u'service': u'chronos'}, u'creationTimestamp': None}}, u'revisionHistoryLimit': 10, u'selector': {u'matchLabels': {u'service': u'chronos'}}}, u'apiVersion': u'apps/v1', u'metadata': {u'name': u'chronos', u'generation': 1, u'labels': {u'service': u'chronos'}, u'namespace': u'default', u'resourceVersion': u'2370591', u'creationTimestamp': u'2020-07-23T12:50:24Z', u'annotations': {u'deployment.kubernetes.io/revision': u'1'}, u'selfLink': u'/apis/apps/v1/namespaces/default/deployments/chronos', u'uid': u'13b7acd6-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {u'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {u'service': 'chronos'}, 'managed_fields': None, 'name': 'chronos', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370591', 'self_link': '/apis/apps/v1/namespaces/default/deployments/chronos', 'uid': '13b7acd6-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {u'service': 'chronos'}}, 'strategy': {'rolling_update': {'max_surge': u'25%', 'max_unavailable': u'25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {u'service': 'chronos'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-chronos:latest', 'image_pull_policy': 'Always', 'lifecycle': {'post_start': None, 'pre_stop': {'_exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}, 'http_get': None, 'tcp_socket': None}}, 'liveness_probe': {'_exec': None, 'failure_threshold': 9, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7253}, 'timeout_seconds': 1}, 'name': 'chronos', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7253, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7253}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/chronos', 'mount_propagation': None, 'name': 'chronoslogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/chronos/chronos_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/chronos', 'mount_propagation': None, 'name': 'chronoslogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 120, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'chronoslogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 23, 12, 53, 2, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 53, 2, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 53, 2, tzinfo=tzlocal()), 'message': 'ReplicaSet "chronos-59fcbd7b47" has successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, u'type': u'MODIFIED'} 2020-07-23 12:53:03,052 - functest_kubernetes.ims.ims - INFO - chronos started in 158.39 sec 2020-07-23 12:53:38,920 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'replicas': 1, u'observedGeneration': 1, u'updatedReplicas': 1, u'availableReplicas': 1, u'readyReplicas': 1, u'conditions': [{u'status': u'True', u'lastUpdateTime': u'2020-07-23T12:53:38Z', u'lastTransitionTime': u'2020-07-23T12:53:38Z', u'reason': u'MinimumReplicasAvailable', u'message': u'Deployment has minimum availability.', u'type': u'Available'}, {u'status': u'True', u'lastUpdateTime': u'2020-07-23T12:53:38Z', u'lastTransitionTime': u'2020-07-23T12:50:24Z', u'reason': u'NewReplicaSetAvailable', u'message': u'ReplicaSet "astaire-6c565bf445" has successfully progressed.', u'type': u'Progressing'}]}, u'kind': u'Deployment', u'spec': {u'progressDeadlineSeconds': 600, u'replicas': 1, u'strategy': {u'rollingUpdate': {u'maxSurge': u'25%', u'maxUnavailable': u'25%'}, u'type': u'RollingUpdate'}, u'template': {u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'schedulerName': u'default-scheduler', u'terminationGracePeriodSeconds': 120, u'restartPolicy': u'Always', u'volumes': [{u'emptyDir': {}, u'name': u'astairelogs'}], u'initContainers': [{u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-cassandra', u'image': u'busybox:1.28', u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}], u'imagePullSecrets': [{}], u'containers': [{u'livenessProbe': {u'successThreshold': 1, u'tcpSocket': {u'port': 11311}, u'failureThreshold': 9, u'timeoutSeconds': 1, u'periodSeconds': 10}, u'terminationMessagePath': u'/dev/termination-log', u'name': u'astaire', u'envFrom': [{u'configMapRef': {u'name': u'env-vars'}}], u'image': u'ollivier/clearwater-astaire:latest', u'volumeMounts': [{u'mountPath': u'/var/log/astaire', u'name': u'astairelogs'}], u'terminationMessagePolicy': u'File', u'lifecycle': {u'preStop': {u'exec': {u'command': [u'/bin/bash', u'-c', u'/usr/bin/pre-stop']}}}, u'env': [{u'valueFrom': {u'fieldRef': {u'fieldPath': u'status.podIP', u'apiVersion': u'v1'}}, u'name': u'MY_POD_IP'}], u'imagePullPolicy': u'Always', u'readinessProbe': {u'successThreshold': 1, u'tcpSocket': {u'port': 11311}, u'failureThreshold': 3, u'timeoutSeconds': 1, u'periodSeconds': 10}, u'ports': [{u'protocol': u'TCP', u'containerPort': 22}, {u'protocol': u'TCP', u'containerPort': 11211}, {u'protocol': u'TCP', u'containerPort': 11311}], u'resources': {}}, {u'terminationMessagePath': u'/dev/termination-log', u'name': u'tailer', u'image': u'busybox', u'volumeMounts': [{u'mountPath': u'/var/log/astaire', u'name': u'astairelogs'}], u'terminationMessagePolicy': u'File', u'command': [u'tail', u'-F', u'/var/log/astaire/astaire_current.txt'], u'imagePullPolicy': u'Always', u'resources': {}}]}, u'metadata': {u'labels': {u'service': u'astaire'}, u'creationTimestamp': None}}, u'revisionHistoryLimit': 10, u'selector': {u'matchLabels': {u'service': u'astaire'}}}, u'apiVersion': u'apps/v1', u'metadata': {u'name': u'astaire', u'generation': 1, u'namespace': u'default', u'resourceVersion': u'2370676', u'creationTimestamp': u'2020-07-23T12:50:24Z', u'annotations': {u'deployment.kubernetes.io/revision': u'1'}, u'selfLink': u'/apis/apps/v1/namespaces/default/deployments/astaire', u'uid': u'13a0e4fe-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {u'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'astaire', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370676', 'self_link': '/apis/apps/v1/namespaces/default/deployments/astaire', 'uid': '13a0e4fe-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {u'service': 'astaire'}}, 'strategy': {'rolling_update': {'max_surge': u'25%', 'max_unavailable': u'25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {u'service': 'astaire'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-astaire:latest', 'image_pull_policy': 'Always', 'lifecycle': {'post_start': None, 'pre_stop': {'_exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}, 'http_get': None, 'tcp_socket': None}}, 'liveness_probe': {'_exec': None, 'failure_threshold': 9, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 11311}, 'timeout_seconds': 1}, 'name': 'astaire', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 11211, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 11311, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 11311}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/astaire', 'mount_propagation': None, 'name': 'astairelogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/astaire/astaire_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/astaire', 'mount_propagation': None, 'name': 'astairelogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 120, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'astairelogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 23, 12, 53, 38, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 53, 38, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 53, 38, tzinfo=tzlocal()), 'message': 'ReplicaSet "astaire-6c565bf445" has successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, u'type': u'MODIFIED'} 2020-07-23 12:53:38,985 - functest_kubernetes.ims.ims - INFO - astaire started in 194.33 sec 2020-07-23 12:54:00,838 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'replicas': 1, u'observedGeneration': 1, u'updatedReplicas': 1, u'availableReplicas': 1, u'readyReplicas': 1, u'conditions': [{u'status': u'True', u'lastUpdateTime': u'2020-07-23T12:54:00Z', u'lastTransitionTime': u'2020-07-23T12:54:00Z', u'reason': u'MinimumReplicasAvailable', u'message': u'Deployment has minimum availability.', u'type': u'Available'}, {u'status': u'True', u'lastUpdateTime': u'2020-07-23T12:54:00Z', u'lastTransitionTime': u'2020-07-23T12:50:25Z', u'reason': u'NewReplicaSetAvailable', u'message': u'ReplicaSet "homestead-7dbf49f967" has successfully progressed.', u'type': u'Progressing'}]}, u'kind': u'Deployment', u'spec': {u'progressDeadlineSeconds': 600, u'replicas': 1, u'strategy': {u'rollingUpdate': {u'maxSurge': u'25%', u'maxUnavailable': u'25%'}, u'type': u'RollingUpdate'}, u'template': {u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'schedulerName': u'default-scheduler', u'terminationGracePeriodSeconds': 30, u'restartPolicy': u'Always', u'volumes': [{u'emptyDir': {}, u'name': u'homesteadlogs'}], u'initContainers': [{u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-cassandra', u'image': u'busybox:1.28', u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}, {u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-astaire', u'image': u'busybox:1.28', u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup astaire; do echo waiting for astaire to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}], u'imagePullSecrets': [{}], u'containers': [{u'livenessProbe': {u'timeoutSeconds': 1, u'exec': {u'command': [u'/bin/bash', u'/usr/share/kubernetes/liveness.sh', u'8888']}, u'initialDelaySeconds': 60, u'periodSeconds': 10, u'successThreshold': 1, u'failureThreshold': 3}, u'terminationMessagePath': u'/dev/termination-log', u'name': u'homestead', u'envFrom': [{u'configMapRef': {u'name': u'env-vars'}}], u'image': u'ollivier/clearwater-homestead:latest', u'volumeMounts': [{u'mountPath': u'/var/log/homestead', u'name': u'homesteadlogs'}], u'terminationMessagePolicy': u'File', u'env': [{u'valueFrom': {u'fieldRef': {u'fieldPath': u'status.podIP', u'apiVersion': u'v1'}}, u'name': u'MY_POD_IP'}], u'imagePullPolicy': u'Always', u'readinessProbe': {u'successThreshold': 1, u'periodSeconds': 10, u'failureThreshold': 3, u'timeoutSeconds': 1, u'exec': {u'command': [u'/bin/bash', u'/usr/share/kubernetes/liveness.sh', u'8888']}}, u'ports': [{u'protocol': u'TCP', u'containerPort': 22}, {u'protocol': u'TCP', u'containerPort': 8888}], u'resources': {}}, {u'terminationMessagePath': u'/dev/termination-log', u'name': u'tailer', u'image': u'busybox', u'volumeMounts': [{u'mountPath': u'/var/log/homestead', u'name': u'homesteadlogs'}], u'terminationMessagePolicy': u'File', u'command': [u'tail', u'-F', u'/var/log/homestead/homestead_current.txt'], u'imagePullPolicy': u'Always', u'resources': {}}]}, u'metadata': {u'labels': {u'snmp': u'enabled', u'service': u'homestead'}, u'creationTimestamp': None}}, u'revisionHistoryLimit': 10, u'selector': {u'matchLabels': {u'service': u'homestead'}}}, u'apiVersion': u'apps/v1', u'metadata': {u'name': u'homestead', u'generation': 1, u'namespace': u'default', u'resourceVersion': u'2370732', u'creationTimestamp': u'2020-07-23T12:50:25Z', u'annotations': {u'deployment.kubernetes.io/revision': u'1'}, u'selfLink': u'/apis/apps/v1/namespaces/default/deployments/homestead', u'uid': u'13dc3f56-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {u'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homestead', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370732', 'self_link': '/apis/apps/v1/namespaces/default/deployments/homestead', 'uid': '13dc3f56-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {u'service': 'homestead'}}, 'strategy': {'rolling_update': {'max_surge': u'25%', 'max_unavailable': u'25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {u'service': 'homestead', u'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/homestead', 'mount_propagation': None, 'name': 'homesteadlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/homestead/homestead_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/homestead', 'mount_propagation': None, 'name': 'homesteadlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until nslookup astaire; do echo waiting for astaire to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-astaire', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'homesteadlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 23, 12, 54, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 54, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 54, tzinfo=tzlocal()), 'message': 'ReplicaSet "homestead-7dbf49f967" has successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, u'type': u'MODIFIED'} 2020-07-23 12:54:00,899 - functest_kubernetes.ims.ims - INFO - homestead started in 216.24 sec 2020-07-23 12:54:43,774 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'replicas': 1, u'observedGeneration': 1, u'updatedReplicas': 1, u'availableReplicas': 1, u'readyReplicas': 1, u'conditions': [{u'status': u'True', u'lastUpdateTime': u'2020-07-23T12:54:43Z', u'lastTransitionTime': u'2020-07-23T12:54:43Z', u'reason': u'MinimumReplicasAvailable', u'message': u'Deployment has minimum availability.', u'type': u'Available'}, {u'status': u'True', u'lastUpdateTime': u'2020-07-23T12:54:43Z', u'lastTransitionTime': u'2020-07-23T12:50:26Z', u'reason': u'NewReplicaSetAvailable', u'message': u'ReplicaSet "sprout-fb8745f94" has successfully progressed.', u'type': u'Progressing'}]}, u'kind': u'Deployment', u'spec': {u'progressDeadlineSeconds': 600, u'replicas': 1, u'strategy': {u'rollingUpdate': {u'maxSurge': u'25%', u'maxUnavailable': u'25%'}, u'type': u'RollingUpdate'}, u'template': {u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'schedulerName': u'default-scheduler', u'terminationGracePeriodSeconds': 30, u'restartPolicy': u'Always', u'volumes': [{u'emptyDir': {}, u'name': u'sproutlogs'}], u'initContainers': [{u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-ralf', u'image': u'busybox:1.28', u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup ralf; do echo waiting for ralf to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}, {u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-chronos', u'image': u'busybox:1.28', u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup chronos; do echo waiting for chronos to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}, {u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-homestead', u'image': u'busybox:1.28', u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}], u'imagePullSecrets': [{}], u'containers': [{u'livenessProbe': {u'timeoutSeconds': 1, u'exec': {u'command': [u'/bin/bash', u'/usr/share/kubernetes/liveness.sh', u'5052 5054']}, u'initialDelaySeconds': 30, u'periodSeconds': 3, u'successThreshold': 1, u'failureThreshold': 3}, u'terminationMessagePath': u'/dev/termination-log', u'name': u'sprout', u'envFrom': [{u'configMapRef': {u'name': u'env-vars'}}], u'image': u'ollivier/clearwater-sprout:latest', u'volumeMounts': [{u'mountPath': u'/var/log/sprout', u'name': u'sproutlogs'}], u'terminationMessagePolicy': u'File', u'env': [{u'valueFrom': {u'fieldRef': {u'fieldPath': u'status.podIP', u'apiVersion': u'v1'}}, u'name': u'MY_POD_IP'}], u'imagePullPolicy': u'Always', u'readinessProbe': {u'successThreshold': 1, u'periodSeconds': 10, u'failureThreshold': 3, u'timeoutSeconds': 1, u'exec': {u'command': [u'/bin/bash', u'/usr/share/kubernetes/liveness.sh', u'5052 5054']}}, u'ports': [{u'protocol': u'TCP', u'containerPort': 22}], u'resources': {}}, {u'terminationMessagePath': u'/dev/termination-log', u'name': u'tailer', u'image': u'busybox', u'volumeMounts': [{u'mountPath': u'/var/log/sprout', u'name': u'sproutlogs'}], u'terminationMessagePolicy': u'File', u'command': [u'tail', u'-F', u'/var/log/sprout/sprout_current.txt'], u'imagePullPolicy': u'Always', u'resources': {}}]}, u'metadata': {u'labels': {u'snmp': u'enabled', u'service': u'sprout'}, u'creationTimestamp': None}}, u'revisionHistoryLimit': 10, u'selector': {u'matchLabels': {u'service': u'sprout'}}}, u'apiVersion': u'apps/v1', u'metadata': {u'name': u'sprout', u'generation': 1, u'namespace': u'default', u'resourceVersion': u'2370829', u'creationTimestamp': u'2020-07-23T12:50:25Z', u'annotations': {u'deployment.kubernetes.io/revision': u'1'}, u'selfLink': u'/apis/apps/v1/namespaces/default/deployments/sprout', u'uid': u'13f2cd09-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {u'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'sprout', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370829', 'self_link': '/apis/apps/v1/namespaces/default/deployments/sprout', 'uid': '13f2cd09-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {u'service': 'sprout'}}, 'strategy': {'rolling_update': {'max_surge': u'25%', 'max_unavailable': u'25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {u'service': 'sprout', u'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-sprout:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 3, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'sprout', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup ralf; do echo waiting for ralf to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-ralf', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until nslookup chronos; do echo waiting for chronos to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-chronos', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'sproutlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 23, 12, 54, 43, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 54, 43, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 26, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 54, 43, tzinfo=tzlocal()), 'message': 'ReplicaSet "sprout-fb8745f94" has successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, u'type': u'MODIFIED'} 2020-07-23 12:54:43,852 - functest_kubernetes.ims.ims - INFO - sprout started in 259.19 sec 2020-07-23 12:54:45,088 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'replicas': 1, u'observedGeneration': 1, u'updatedReplicas': 1, u'availableReplicas': 1, u'readyReplicas': 1, u'conditions': [{u'status': u'True', u'lastUpdateTime': u'2020-07-23T12:54:45Z', u'lastTransitionTime': u'2020-07-23T12:54:45Z', u'reason': u'MinimumReplicasAvailable', u'message': u'Deployment has minimum availability.', u'type': u'Available'}, {u'status': u'True', u'lastUpdateTime': u'2020-07-23T12:54:45Z', u'lastTransitionTime': u'2020-07-23T12:50:25Z', u'reason': u'NewReplicaSetAvailable', u'message': u'ReplicaSet "homestead-prov-745965b8" has successfully progressed.', u'type': u'Progressing'}]}, u'kind': u'Deployment', u'spec': {u'progressDeadlineSeconds': 600, u'replicas': 1, u'strategy': {u'rollingUpdate': {u'maxSurge': u'25%', u'maxUnavailable': u'25%'}, u'type': u'RollingUpdate'}, u'template': {u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'schedulerName': u'default-scheduler', u'terminationGracePeriodSeconds': 30, u'restartPolicy': u'Always', u'initContainers': [{u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-homestead', u'image': u'busybox:1.28', u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}], u'imagePullSecrets': [{}], u'containers': [{u'livenessProbe': {u'timeoutSeconds': 1, u'exec': {u'command': [u'/bin/bash', u'/usr/share/clearwater/bin/poll_homestead-prov.sh']}, u'initialDelaySeconds': 60, u'periodSeconds': 10, u'successThreshold': 1, u'failureThreshold': 3}, u'terminationMessagePath': u'/dev/termination-log', u'name': u'homestead-prov', u'envFrom': [{u'configMapRef': {u'name': u'env-vars'}}], u'image': u'ollivier/clearwater-homestead-prov:latest', u'terminationMessagePolicy': u'File', u'env': [{u'valueFrom': {u'fieldRef': {u'fieldPath': u'status.podIP', u'apiVersion': u'v1'}}, u'name': u'MY_POD_IP'}], u'imagePullPolicy': u'Always', u'readinessProbe': {u'successThreshold': 1, u'periodSeconds': 10, u'failureThreshold': 3, u'timeoutSeconds': 1, u'exec': {u'command': [u'/bin/bash', u'/usr/share/clearwater/bin/poll_homestead-prov.sh']}}, u'ports': [{u'protocol': u'TCP', u'containerPort': 22}, {u'protocol': u'TCP', u'containerPort': 8889}], u'resources': {}}]}, u'metadata': {u'labels': {u'snmp': u'enabled', u'service': u'homestead-prov'}, u'creationTimestamp': None}}, u'revisionHistoryLimit': 10, u'selector': {u'matchLabels': {u'service': u'homestead-prov'}}}, u'apiVersion': u'apps/v1', u'metadata': {u'name': u'homestead-prov', u'generation': 1, u'namespace': u'default', u'resourceVersion': u'2370836', u'creationTimestamp': u'2020-07-23T12:50:25Z', u'annotations': {u'deployment.kubernetes.io/revision': u'1'}, u'selfLink': u'/apis/apps/v1/namespaces/default/deployments/homestead-prov', u'uid': u'13e44c0c-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {u'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homestead-prov', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370836', 'self_link': '/apis/apps/v1/namespaces/default/deployments/homestead-prov', 'uid': '13e44c0c-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {u'service': 'homestead-prov'}}, 'strategy': {'rolling_update': {'max_surge': u'25%', 'max_unavailable': u'25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {u'service': 'homestead-prov', u'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead-prov:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead-prov', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8889, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 23, 12, 54, 45, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 54, 45, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 54, 45, tzinfo=tzlocal()), 'message': 'ReplicaSet "homestead-prov-745965b8" has successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, u'type': u'MODIFIED'} 2020-07-23 12:54:45,133 - functest_kubernetes.ims.ims - INFO - homestead-prov started in 260.47 sec 2020-07-23 12:55:17,134 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'replicas': 1, u'observedGeneration': 1, u'updatedReplicas': 1, u'availableReplicas': 1, u'readyReplicas': 1, u'conditions': [{u'status': u'True', u'lastUpdateTime': u'2020-07-23T12:55:17Z', u'lastTransitionTime': u'2020-07-23T12:55:17Z', u'reason': u'MinimumReplicasAvailable', u'message': u'Deployment has minimum availability.', u'type': u'Available'}, {u'status': u'True', u'lastUpdateTime': u'2020-07-23T12:55:17Z', u'lastTransitionTime': u'2020-07-23T12:50:24Z', u'reason': u'NewReplicaSetAvailable', u'message': u'ReplicaSet "bono-9858d478b" has successfully progressed.', u'type': u'Progressing'}]}, u'kind': u'Deployment', u'spec': {u'progressDeadlineSeconds': 600, u'replicas': 1, u'strategy': {u'rollingUpdate': {u'maxSurge': u'25%', u'maxUnavailable': u'25%'}, u'type': u'RollingUpdate'}, u'template': {u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'schedulerName': u'default-scheduler', u'terminationGracePeriodSeconds': 30, u'restartPolicy': u'Always', u'volumes': [{u'emptyDir': {}, u'name': u'bonologs'}], u'initContainers': [{u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-sprout', u'image': u'busybox:1.28', u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}], u'imagePullSecrets': [{}], u'containers': [{u'livenessProbe': {u'timeoutSeconds': 1, u'exec': {u'command': [u'/bin/bash', u'/usr/share/kubernetes/liveness.sh', u'3478 5060 5062']}, u'initialDelaySeconds': 30, u'periodSeconds': 10, u'successThreshold': 1, u'failureThreshold': 3}, u'terminationMessagePath': u'/dev/termination-log', u'name': u'bono', u'envFrom': [{u'configMapRef': {u'name': u'env-vars'}}], u'image': u'ollivier/clearwater-bono:latest', u'volumeMounts': [{u'mountPath': u'/var/log/bono', u'name': u'bonologs'}], u'terminationMessagePolicy': u'File', u'env': [{u'valueFrom': {u'fieldRef': {u'fieldPath': u'status.podIP', u'apiVersion': u'v1'}}, u'name': u'MY_POD_IP'}], u'imagePullPolicy': u'Always', u'readinessProbe': {u'successThreshold': 1, u'periodSeconds': 10, u'failureThreshold': 3, u'timeoutSeconds': 1, u'exec': {u'command': [u'/bin/bash', u'/usr/share/kubernetes/liveness.sh', u'3478 5060 5062']}}, u'ports': [{u'protocol': u'TCP', u'containerPort': 22}, {u'protocol': u'TCP', u'containerPort': 3478}, {u'protocol': u'TCP', u'containerPort': 5060}, {u'protocol': u'TCP', u'containerPort': 5062}, {u'protocol': u'UDP', u'containerPort': 5060}, {u'protocol': u'UDP', u'containerPort': 5062}], u'resources': {}}, {u'terminationMessagePath': u'/dev/termination-log', u'name': u'tailer', u'image': u'busybox', u'volumeMounts': [{u'mountPath': u'/var/log/bono', u'name': u'bonologs'}], u'terminationMessagePolicy': u'File', u'command': [u'tail', u'-F', u'/var/log/bono/bono_current.txt'], u'imagePullPolicy': u'Always', u'resources': {}}]}, u'metadata': {u'labels': {u'snmp': u'enabled', u'service': u'bono'}, u'creationTimestamp': None}}, u'revisionHistoryLimit': 10, u'selector': {u'matchLabels': {u'service': u'bono'}}}, u'apiVersion': u'apps/v1', u'metadata': {u'name': u'bono', u'generation': 1, u'namespace': u'default', u'resourceVersion': u'2370914', u'creationTimestamp': u'2020-07-23T12:50:24Z', u'annotations': {u'deployment.kubernetes.io/revision': u'1'}, u'selfLink': u'/apis/apps/v1/namespaces/default/deployments/bono', u'uid': u'13aa120b-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {u'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'bono', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370914', 'self_link': '/apis/apps/v1/namespaces/default/deployments/bono', 'uid': '13aa120b-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {u'service': 'bono'}}, 'strategy': {'rolling_update': {'max_surge': u'25%', 'max_unavailable': u'25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {u'service': 'bono', u'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-bono:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 5062']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'bono', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 3478, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5060, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5062, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5060, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'UDP'}, {'container_port': 5062, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'UDP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 5062']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/bono', 'mount_propagation': None, 'name': 'bonologs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/bono/bono_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/bono', 'mount_propagation': None, 'name': 'bonologs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'bonologs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 23, 12, 55, 17, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 55, 17, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 55, 17, tzinfo=tzlocal()), 'message': 'ReplicaSet "bono-9858d478b" has successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, u'type': u'MODIFIED'} 2020-07-23 12:55:17,205 - functest_kubernetes.ims.ims - INFO - bono started in 292.55 sec 2020-07-23 12:55:26,866 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'replicas': 1, u'observedGeneration': 1, u'updatedReplicas': 1, u'availableReplicas': 1, u'readyReplicas': 1, u'conditions': [{u'status': u'True', u'lastUpdateTime': u'2020-07-23T12:55:26Z', u'lastTransitionTime': u'2020-07-23T12:55:26Z', u'reason': u'MinimumReplicasAvailable', u'message': u'Deployment has minimum availability.', u'type': u'Available'}, {u'status': u'True', u'lastUpdateTime': u'2020-07-23T12:55:26Z', u'lastTransitionTime': u'2020-07-23T12:50:24Z', u'reason': u'NewReplicaSetAvailable', u'message': u'ReplicaSet "ellis-6d885b94fc" has successfully progressed.', u'type': u'Progressing'}]}, u'kind': u'Deployment', u'spec': {u'progressDeadlineSeconds': 600, u'replicas': 1, u'strategy': {u'rollingUpdate': {u'maxSurge': u'25%', u'maxUnavailable': u'25%'}, u'type': u'RollingUpdate'}, u'template': {u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'schedulerName': u'default-scheduler', u'terminationGracePeriodSeconds': 30, u'restartPolicy': u'Always', u'initContainers': [{u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-homestead-prov', u'image': u'busybox:1.28', u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup homestead-prov; do echo waiting for homestead-prov to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}, {u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-sprout', u'image': u'busybox:1.28', u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}], u'imagePullSecrets': [{}], u'containers': [{u'livenessProbe': {u'tcpSocket': {u'port': 80}, u'timeoutSeconds': 1, u'initialDelaySeconds': 30, u'periodSeconds': 10, u'successThreshold': 1, u'failureThreshold': 3}, u'terminationMessagePath': u'/dev/termination-log', u'name': u'ellis', u'envFrom': [{u'configMapRef': {u'name': u'env-vars'}}], u'image': u'ollivier/clearwater-ellis:latest', u'terminationMessagePolicy': u'File', u'env': [{u'valueFrom': {u'fieldRef': {u'fieldPath': u'status.podIP', u'apiVersion': u'v1'}}, u'name': u'MY_POD_IP'}], u'imagePullPolicy': u'Always', u'readinessProbe': {u'successThreshold': 1, u'tcpSocket': {u'port': 80}, u'failureThreshold': 3, u'timeoutSeconds': 1, u'periodSeconds': 10}, u'ports': [{u'protocol': u'TCP', u'containerPort': 22}, {u'protocol': u'TCP', u'containerPort': 80}], u'resources': {}}]}, u'metadata': {u'labels': {u'service': u'ellis'}, u'creationTimestamp': None}}, u'revisionHistoryLimit': 10, u'selector': {u'matchLabels': {u'service': u'ellis'}}}, u'apiVersion': u'apps/v1', u'metadata': {u'name': u'ellis', u'generation': 1, u'namespace': u'default', u'resourceVersion': u'2370936', u'creationTimestamp': u'2020-07-23T12:50:24Z', u'annotations': {u'deployment.kubernetes.io/revision': u'1'}, u'selfLink': u'/apis/apps/v1/namespaces/default/deployments/ellis', u'uid': u'13c0761c-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {u'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'ellis', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370936', 'self_link': '/apis/apps/v1/namespaces/default/deployments/ellis', 'uid': '13c0761c-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {u'service': 'ellis'}}, 'strategy': {'rolling_update': {'max_surge': u'25%', 'max_unavailable': u'25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {u'service': 'ellis'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-ellis:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 80}, 'timeout_seconds': 1}, 'name': 'ellis', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 80, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 80}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup homestead-prov; do echo waiting for homestead-prov to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead-prov', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 23, 12, 55, 26, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 55, 26, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 23, 12, 55, 26, tzinfo=tzlocal()), 'message': 'ReplicaSet "ellis-6d885b94fc" has successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, u'type': u'MODIFIED'} 2020-07-23 12:55:26,919 - functest_kubernetes.ims.ims - INFO - ellis started in 302.26 sec 2020-07-23 12:55:26,956 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'initContainerStatuses': [{u'restartCount': 0, u'name': u'wait-on-cassandra', u'image': u'docker.io/library/busybox:1.28', u'imageID': u'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', u'state': {u'terminated': {u'startedAt': u'2020-07-23T12:50:33Z', u'reason': u'Completed', u'finishedAt': u'2020-07-23T12:52:34Z', u'containerID': u'containerd://3e0bf102caf1921ad15bf73f126695a7912b7637db68a51ada4581b684b274a4', u'exitCode': 0}}, u'ready': True, u'lastState': {}, u'containerID': u'containerd://3e0bf102caf1921ad15bf73f126695a7912b7637db68a51ada4581b684b274a4'}, {u'restartCount': 0, u'name': u'wait-on-astaire', u'image': u'docker.io/library/busybox:1.28', u'imageID': u'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', u'state': {u'terminated': {u'startedAt': u'2020-07-23T12:52:37Z', u'reason': u'Completed', u'finishedAt': u'2020-07-23T12:53:41Z', u'containerID': u'containerd://d9179dc895028eb0b116d9dda5f8a1e962d6a1d5b0c4dabde98494a28d9f5d0a', u'exitCode': 0}}, u'ready': True, u'lastState': {}, u'containerID': u'containerd://d9179dc895028eb0b116d9dda5f8a1e962d6a1d5b0c4dabde98494a28d9f5d0a'}], u'qosClass': u'BestEffort', u'containerStatuses': [{u'restartCount': 0, u'name': u'homestead', u'image': u'docker.io/ollivier/clearwater-homestead:latest', u'imageID': u'docker.io/ollivier/clearwater-homestead@sha256:6eebbdbc9e424dd87b3d149b9fa1c779ad5c402e2f7ef414ec585a43ebb782d6', u'state': {u'running': {u'startedAt': u'2020-07-23T12:53:46Z'}}, u'ready': True, u'lastState': {}, u'containerID': u'containerd://3b38dface90a71c823af9828ad2c1baa2840978bdadf2a4ea05b90951e6c9c31'}, {u'restartCount': 0, u'name': u'tailer', u'image': u'docker.io/library/busybox:latest', u'imageID': u'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', u'state': {u'running': {u'startedAt': u'2020-07-23T12:53:48Z'}}, u'ready': True, u'lastState': {}, u'containerID': u'containerd://80881f553e8d709fb4ee77ea798691c2c6e767c93d0637380afaf277f73a10d7'}], u'podIP': u'10.244.1.85', u'startTime': u'2020-07-23T12:50:26Z', u'hostIP': u'172.18.0.2', u'phase': u'Running', u'conditions': [{u'status': u'True', u'lastProbeTime': None, u'type': u'Initialized', u'lastTransitionTime': u'2020-07-23T12:53:42Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'Ready', u'lastTransitionTime': u'2020-07-23T12:53:59Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'ContainersReady', u'lastTransitionTime': u'2020-07-23T12:53:59Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'PodScheduled', u'lastTransitionTime': u'2020-07-23T12:50:25Z'}]}, u'kind': u'Pod', u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'serviceAccountName': u'default', u'schedulerName': u'default-scheduler', u'enableServiceLinks': True, u'serviceAccount': u'default', u'priority': 0, u'terminationGracePeriodSeconds': 30, u'restartPolicy': u'Always', u'volumes': [{u'emptyDir': {}, u'name': u'homesteadlogs'}, {u'secret': {u'defaultMode': 420, u'secretName': u'default-token-pvhrj'}, u'name': u'default-token-pvhrj'}], u'tolerations': [{u'operator': u'Exists', u'tolerationSeconds': 300, u'effect': u'NoExecute', u'key': u'node.kubernetes.io/not-ready'}, {u'operator': u'Exists', u'tolerationSeconds': 300, u'effect': u'NoExecute', u'key': u'node.kubernetes.io/unreachable'}], u'initContainers': [{u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-cassandra', u'image': u'busybox:1.28', u'volumeMounts': [{u'readOnly': True, u'mountPath': u'/var/run/secrets/kubernetes.io/serviceaccount', u'name': u'default-token-pvhrj'}], u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}, {u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-astaire', u'image': u'busybox:1.28', u'volumeMounts': [{u'readOnly': True, u'mountPath': u'/var/run/secrets/kubernetes.io/serviceaccount', u'name': u'default-token-pvhrj'}], u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup astaire; do echo waiting for astaire to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}], u'imagePullSecrets': [{}], u'containers': [{u'livenessProbe': {u'timeoutSeconds': 1, u'exec': {u'command': [u'/bin/bash', u'/usr/share/kubernetes/liveness.sh', u'8888']}, u'initialDelaySeconds': 60, u'periodSeconds': 10, u'successThreshold': 1, u'failureThreshold': 3}, u'terminationMessagePath': u'/dev/termination-log', u'name': u'homestead', u'envFrom': [{u'configMapRef': {u'name': u'env-vars'}}], u'image': u'ollivier/clearwater-homestead:latest', u'volumeMounts': [{u'mountPath': u'/var/log/homestead', u'name': u'homesteadlogs'}, {u'readOnly': True, u'mountPath': u'/var/run/secrets/kubernetes.io/serviceaccount', u'name': u'default-token-pvhrj'}], u'terminationMessagePolicy': u'File', u'env': [{u'valueFrom': {u'fieldRef': {u'fieldPath': u'status.podIP', u'apiVersion': u'v1'}}, u'name': u'MY_POD_IP'}], u'imagePullPolicy': u'Always', u'readinessProbe': {u'successThreshold': 1, u'periodSeconds': 10, u'failureThreshold': 3, u'timeoutSeconds': 1, u'exec': {u'command': [u'/bin/bash', u'/usr/share/kubernetes/liveness.sh', u'8888']}}, u'ports': [{u'protocol': u'TCP', u'containerPort': 22}, {u'protocol': u'TCP', u'containerPort': 8888}], u'resources': {}}, {u'terminationMessagePath': u'/dev/termination-log', u'name': u'tailer', u'image': u'busybox', u'volumeMounts': [{u'mountPath': u'/var/log/homestead', u'name': u'homesteadlogs'}, {u'readOnly': True, u'mountPath': u'/var/run/secrets/kubernetes.io/serviceaccount', u'name': u'default-token-pvhrj'}], u'terminationMessagePolicy': u'File', u'command': [u'tail', u'-F', u'/var/log/homestead/homestead_current.txt'], u'imagePullPolicy': u'Always', u'resources': {}}], u'nodeName': u'hunter-worker2'}, u'apiVersion': u'v1', u'metadata': {u'name': u'homestead-7dbf49f967-j6577', u'labels': {u'pod-template-hash': u'7dbf49f967', u'snmp': u'enabled', u'service': u'homestead'}, u'namespace': u'default', u'ownerReferences': [{u'kind': u'ReplicaSet', u'name': u'homestead-7dbf49f967', u'apiVersion': u'apps/v1', u'controller': True, u'blockOwnerDeletion': True, u'uid': u'13e69cd0-cce3-11ea-b2c9-0242ac120008'}], u'resourceVersion': u'2370729', u'generateName': u'homestead-7dbf49f967-', u'creationTimestamp': u'2020-07-23T12:50:25Z', u'selfLink': u'/api/v1/namespaces/default/pods/homestead-7dbf49f967-j6577', u'uid': u'13e9bcf1-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'homestead-7dbf49f967-', 'generation': None, 'initializers': None, 'labels': {u'pod-template-hash': '7dbf49f967', u'service': 'homestead', u'snmp': 'enabled'}, 'managed_fields': None, 'name': 'homestead-7dbf49f967-j6577', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'homestead-7dbf49f967', 'uid': '13e69cd0-cce3-11ea-b2c9-0242ac120008'}], 'resource_version': '2370729', 'self_link': '/api/v1/namespaces/default/pods/homestead-7dbf49f967-j6577', 'uid': '13e9bcf1-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/homestead', 'mount_propagation': None, 'name': 'homesteadlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-pvhrj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/homestead/homestead_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/homestead', 'mount_propagation': None, 'name': 'homesteadlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-pvhrj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-pvhrj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until nslookup astaire; do echo waiting for astaire to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-astaire', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-pvhrj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'hunter-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'homesteadlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}, {'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-pvhrj', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-pvhrj'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 53, 42, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 53, 59, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 53, 59, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://3b38dface90a71c823af9828ad2c1baa2840978bdadf2a4ea05b90951e6c9c31', 'image': 'docker.io/ollivier/clearwater-homestead:latest', 'image_id': 'docker.io/ollivier/clearwater-homestead@sha256:6eebbdbc9e424dd87b3d149b9fa1c779ad5c402e2f7ef414ec585a43ebb782d6', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'homestead', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 23, 12, 53, 46, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}, {'container_id': 'containerd://80881f553e8d709fb4ee77ea798691c2c6e767c93d0637380afaf277f73a10d7', 'image': 'docker.io/library/busybox:latest', 'image_id': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'tailer', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 23, 12, 53, 48, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.2', 'init_container_statuses': [{'container_id': 'containerd://3e0bf102caf1921ad15bf73f126695a7912b7637db68a51ada4581b684b274a4', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-cassandra', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://3e0bf102caf1921ad15bf73f126695a7912b7637db68a51ada4581b684b274a4', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 23, 12, 52, 34, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 23, 12, 50, 33, tzinfo=tzlocal())}, 'waiting': None}}, {'container_id': 'containerd://d9179dc895028eb0b116d9dda5f8a1e962d6a1d5b0c4dabde98494a28d9f5d0a', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-astaire', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://d9179dc895028eb0b116d9dda5f8a1e962d6a1d5b0c4dabde98494a28d9f5d0a', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 23, 12, 53, 41, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 23, 12, 52, 37, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.85', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 23, 12, 50, 26, tzinfo=tzlocal())}}, u'type': u'ADDED'} 2020-07-23 12:55:27,042 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'initContainerStatuses': [{u'restartCount': 0, u'name': u'wait-on-sprout', u'image': u'docker.io/library/busybox:1.28', u'imageID': u'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', u'state': {u'terminated': {u'startedAt': u'2020-07-23T12:50:30Z', u'reason': u'Completed', u'finishedAt': u'2020-07-23T12:54:55Z', u'containerID': u'containerd://58aa8e0c11ff0b8bc6f63a408ba1840b1c3793c4ac06bc76fe7c2ca0214157dc', u'exitCode': 0}}, u'ready': True, u'lastState': {}, u'containerID': u'containerd://58aa8e0c11ff0b8bc6f63a408ba1840b1c3793c4ac06bc76fe7c2ca0214157dc'}], u'qosClass': u'BestEffort', u'containerStatuses': [{u'restartCount': 0, u'name': u'bono', u'image': u'docker.io/ollivier/clearwater-bono:latest', u'imageID': u'docker.io/ollivier/clearwater-bono@sha256:25b1c4759aa4dd92b752451e64f9df5f4a6336d74a15dd5914fbb83ab81ab9f4', u'state': {u'running': {u'startedAt': u'2020-07-23T12:55:02Z'}}, u'ready': True, u'lastState': {}, u'containerID': u'containerd://8d0b5fb33abb3e21f5de2303f25dbac178699eb47dcc308b916836c07348ba7d'}, {u'restartCount': 0, u'name': u'tailer', u'image': u'docker.io/library/busybox:latest', u'imageID': u'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', u'state': {u'running': {u'startedAt': u'2020-07-23T12:55:11Z'}}, u'ready': True, u'lastState': {}, u'containerID': u'containerd://924b9f2d001756bc2eae62a946752e4e8cb2b5e27d6d389c2c86eef449bb64db'}], u'podIP': u'10.244.1.82', u'startTime': u'2020-07-23T12:50:24Z', u'hostIP': u'172.18.0.2', u'phase': u'Running', u'conditions': [{u'status': u'True', u'lastProbeTime': None, u'type': u'Initialized', u'lastTransitionTime': u'2020-07-23T12:54:56Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'Ready', u'lastTransitionTime': u'2020-07-23T12:55:17Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'ContainersReady', u'lastTransitionTime': u'2020-07-23T12:55:17Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'PodScheduled', u'lastTransitionTime': u'2020-07-23T12:50:24Z'}]}, u'kind': u'Pod', u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'serviceAccountName': u'default', u'schedulerName': u'default-scheduler', u'enableServiceLinks': True, u'serviceAccount': u'default', u'priority': 0, u'terminationGracePeriodSeconds': 30, u'restartPolicy': u'Always', u'volumes': [{u'emptyDir': {}, u'name': u'bonologs'}, {u'secret': {u'defaultMode': 420, u'secretName': u'default-token-pvhrj'}, u'name': u'default-token-pvhrj'}], u'tolerations': [{u'operator': u'Exists', u'tolerationSeconds': 300, u'effect': u'NoExecute', u'key': u'node.kubernetes.io/not-ready'}, {u'operator': u'Exists', u'tolerationSeconds': 300, u'effect': u'NoExecute', u'key': u'node.kubernetes.io/unreachable'}], u'initContainers': [{u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-sprout', u'image': u'busybox:1.28', u'volumeMounts': [{u'readOnly': True, u'mountPath': u'/var/run/secrets/kubernetes.io/serviceaccount', u'name': u'default-token-pvhrj'}], u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}], u'imagePullSecrets': [{}], u'containers': [{u'livenessProbe': {u'timeoutSeconds': 1, u'exec': {u'command': [u'/bin/bash', u'/usr/share/kubernetes/liveness.sh', u'3478 5060 5062']}, u'initialDelaySeconds': 30, u'periodSeconds': 10, u'successThreshold': 1, u'failureThreshold': 3}, u'terminationMessagePath': u'/dev/termination-log', u'name': u'bono', u'envFrom': [{u'configMapRef': {u'name': u'env-vars'}}], u'image': u'ollivier/clearwater-bono:latest', u'volumeMounts': [{u'mountPath': u'/var/log/bono', u'name': u'bonologs'}, {u'readOnly': True, u'mountPath': u'/var/run/secrets/kubernetes.io/serviceaccount', u'name': u'default-token-pvhrj'}], u'terminationMessagePolicy': u'File', u'env': [{u'valueFrom': {u'fieldRef': {u'fieldPath': u'status.podIP', u'apiVersion': u'v1'}}, u'name': u'MY_POD_IP'}], u'imagePullPolicy': u'Always', u'readinessProbe': {u'successThreshold': 1, u'periodSeconds': 10, u'failureThreshold': 3, u'timeoutSeconds': 1, u'exec': {u'command': [u'/bin/bash', u'/usr/share/kubernetes/liveness.sh', u'3478 5060 5062']}}, u'ports': [{u'protocol': u'TCP', u'containerPort': 22}, {u'protocol': u'TCP', u'containerPort': 3478}, {u'protocol': u'TCP', u'containerPort': 5060}, {u'protocol': u'TCP', u'containerPort': 5062}, {u'protocol': u'UDP', u'containerPort': 5060}, {u'protocol': u'UDP', u'containerPort': 5062}], u'resources': {}}, {u'terminationMessagePath': u'/dev/termination-log', u'name': u'tailer', u'image': u'busybox', u'volumeMounts': [{u'mountPath': u'/var/log/bono', u'name': u'bonologs'}, {u'readOnly': True, u'mountPath': u'/var/run/secrets/kubernetes.io/serviceaccount', u'name': u'default-token-pvhrj'}], u'terminationMessagePolicy': u'File', u'command': [u'tail', u'-F', u'/var/log/bono/bono_current.txt'], u'imagePullPolicy': u'Always', u'resources': {}}], u'nodeName': u'hunter-worker2'}, u'apiVersion': u'v1', u'metadata': {u'name': u'bono-9858d478b-9scs6', u'labels': {u'pod-template-hash': u'9858d478b', u'snmp': u'enabled', u'service': u'bono'}, u'namespace': u'default', u'ownerReferences': [{u'kind': u'ReplicaSet', u'name': u'bono-9858d478b', u'apiVersion': u'apps/v1', u'controller': True, u'blockOwnerDeletion': True, u'uid': u'13ac4f58-cce3-11ea-b2c9-0242ac120008'}], u'resourceVersion': u'2370911', u'generateName': u'bono-9858d478b-', u'creationTimestamp': u'2020-07-23T12:50:24Z', u'selfLink': u'/api/v1/namespaces/default/pods/bono-9858d478b-9scs6', u'uid': u'13ad1e53-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'bono-9858d478b-', 'generation': None, 'initializers': None, 'labels': {u'pod-template-hash': '9858d478b', u'service': 'bono', u'snmp': 'enabled'}, 'managed_fields': None, 'name': 'bono-9858d478b-9scs6', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'bono-9858d478b', 'uid': '13ac4f58-cce3-11ea-b2c9-0242ac120008'}], 'resource_version': '2370911', 'self_link': '/api/v1/namespaces/default/pods/bono-9858d478b-9scs6', 'uid': '13ad1e53-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-bono:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 5062']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'bono', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 3478, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5060, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5062, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5060, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'UDP'}, {'container_port': 5062, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'UDP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 5062']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/bono', 'mount_propagation': None, 'name': 'bonologs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-pvhrj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/bono/bono_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/bono', 'mount_propagation': None, 'name': 'bonologs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-pvhrj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-pvhrj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'hunter-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'bonologs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}, {'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-pvhrj', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-pvhrj'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 54, 56, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 55, 17, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 55, 17, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://8d0b5fb33abb3e21f5de2303f25dbac178699eb47dcc308b916836c07348ba7d', 'image': 'docker.io/ollivier/clearwater-bono:latest', 'image_id': 'docker.io/ollivier/clearwater-bono@sha256:25b1c4759aa4dd92b752451e64f9df5f4a6336d74a15dd5914fbb83ab81ab9f4', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'bono', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 23, 12, 55, 2, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}, {'container_id': 'containerd://924b9f2d001756bc2eae62a946752e4e8cb2b5e27d6d389c2c86eef449bb64db', 'image': 'docker.io/library/busybox:latest', 'image_id': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'tailer', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 23, 12, 55, 11, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.2', 'init_container_statuses': [{'container_id': 'containerd://58aa8e0c11ff0b8bc6f63a408ba1840b1c3793c4ac06bc76fe7c2ca0214157dc', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-sprout', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://58aa8e0c11ff0b8bc6f63a408ba1840b1c3793c4ac06bc76fe7c2ca0214157dc', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 23, 12, 54, 55, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 23, 12, 50, 30, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.82', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal())}}, u'type': u'ADDED'} 2020-07-23 12:55:27,114 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'initContainerStatuses': [{u'restartCount': 0, u'name': u'wait-on-cassandra', u'image': u'docker.io/library/busybox:1.28', u'imageID': u'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', u'state': {u'terminated': {u'startedAt': u'2020-07-23T12:50:30Z', u'reason': u'Completed', u'finishedAt': u'2020-07-23T12:52:35Z', u'containerID': u'containerd://99ae3364f3ef067f952743247049ea288a493e2aed6ddb65c4780d58777632f4', u'exitCode': 0}}, u'ready': True, u'lastState': {}, u'containerID': u'containerd://99ae3364f3ef067f952743247049ea288a493e2aed6ddb65c4780d58777632f4'}], u'qosClass': u'BestEffort', u'containerStatuses': [{u'restartCount': 0, u'name': u'astaire', u'image': u'docker.io/ollivier/clearwater-astaire:latest', u'imageID': u'docker.io/ollivier/clearwater-astaire@sha256:24e9186a8be32af9559f4d198c5c423eaac0d6c7b827c5ab674f2d124385c2fb', u'state': {u'running': {u'startedAt': u'2020-07-23T12:52:51Z'}}, u'ready': True, u'lastState': {}, u'containerID': u'containerd://10413f5e52e9b4c28e2bcdaeff67879b52d85c0baa9c59992247ea81eab01e77'}, {u'restartCount': 0, u'name': u'tailer', u'image': u'docker.io/library/busybox:latest', u'imageID': u'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', u'state': {u'running': {u'startedAt': u'2020-07-23T12:52:55Z'}}, u'ready': True, u'lastState': {}, u'containerID': u'containerd://89bb5347844b0011da4c7eff49e2d76a4a88b2ad7038d1b1b9923bbb5732d203'}], u'podIP': u'10.244.2.157', u'startTime': u'2020-07-23T12:50:24Z', u'hostIP': u'172.18.0.4', u'phase': u'Running', u'conditions': [{u'status': u'True', u'lastProbeTime': None, u'type': u'Initialized', u'lastTransitionTime': u'2020-07-23T12:52:37Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'Ready', u'lastTransitionTime': u'2020-07-23T12:53:38Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'ContainersReady', u'lastTransitionTime': u'2020-07-23T12:53:38Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'PodScheduled', u'lastTransitionTime': u'2020-07-23T12:50:24Z'}]}, u'kind': u'Pod', u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'serviceAccountName': u'default', u'schedulerName': u'default-scheduler', u'enableServiceLinks': True, u'serviceAccount': u'default', u'priority': 0, u'terminationGracePeriodSeconds': 120, u'restartPolicy': u'Always', u'volumes': [{u'emptyDir': {}, u'name': u'astairelogs'}, {u'secret': {u'defaultMode': 420, u'secretName': u'default-token-pvhrj'}, u'name': u'default-token-pvhrj'}], u'tolerations': [{u'operator': u'Exists', u'tolerationSeconds': 300, u'effect': u'NoExecute', u'key': u'node.kubernetes.io/not-ready'}, {u'operator': u'Exists', u'tolerationSeconds': 300, u'effect': u'NoExecute', u'key': u'node.kubernetes.io/unreachable'}], u'initContainers': [{u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-cassandra', u'image': u'busybox:1.28', u'volumeMounts': [{u'readOnly': True, u'mountPath': u'/var/run/secrets/kubernetes.io/serviceaccount', u'name': u'default-token-pvhrj'}], u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}], u'imagePullSecrets': [{}], u'containers': [{u'livenessProbe': {u'successThreshold': 1, u'tcpSocket': {u'port': 11311}, u'failureThreshold': 9, u'timeoutSeconds': 1, u'periodSeconds': 10}, u'terminationMessagePath': u'/dev/termination-log', u'name': u'astaire', u'envFrom': [{u'configMapRef': {u'name': u'env-vars'}}], u'image': u'ollivier/clearwater-astaire:latest', u'volumeMounts': [{u'mountPath': u'/var/log/astaire', u'name': u'astairelogs'}, {u'readOnly': True, u'mountPath': u'/var/run/secrets/kubernetes.io/serviceaccount', u'name': u'default-token-pvhrj'}], u'terminationMessagePolicy': u'File', u'lifecycle': {u'preStop': {u'exec': {u'command': [u'/bin/bash', u'-c', u'/usr/bin/pre-stop']}}}, u'env': [{u'valueFrom': {u'fieldRef': {u'fieldPath': u'status.podIP', u'apiVersion': u'v1'}}, u'name': u'MY_POD_IP'}], u'imagePullPolicy': u'Always', u'readinessProbe': {u'successThreshold': 1, u'tcpSocket': {u'port': 11311}, u'failureThreshold': 3, u'timeoutSeconds': 1, u'periodSeconds': 10}, u'ports': [{u'protocol': u'TCP', u'containerPort': 22}, {u'protocol': u'TCP', u'containerPort': 11211}, {u'protocol': u'TCP', u'containerPort': 11311}], u'resources': {}}, {u'terminationMessagePath': u'/dev/termination-log', u'name': u'tailer', u'image': u'busybox', u'volumeMounts': [{u'mountPath': u'/var/log/astaire', u'name': u'astairelogs'}, {u'readOnly': True, u'mountPath': u'/var/run/secrets/kubernetes.io/serviceaccount', u'name': u'default-token-pvhrj'}], u'terminationMessagePolicy': u'File', u'command': [u'tail', u'-F', u'/var/log/astaire/astaire_current.txt'], u'imagePullPolicy': u'Always', u'resources': {}}], u'nodeName': u'hunter-worker'}, u'apiVersion': u'v1', u'metadata': {u'name': u'astaire-6c565bf445-bw24g', u'labels': {u'pod-template-hash': u'6c565bf445', u'service': u'astaire'}, u'namespace': u'default', u'ownerReferences': [{u'kind': u'ReplicaSet', u'name': u'astaire-6c565bf445', u'apiVersion': u'apps/v1', u'controller': True, u'blockOwnerDeletion': True, u'uid': u'13a593a6-cce3-11ea-b2c9-0242ac120008'}], u'resourceVersion': u'2370673', u'generateName': u'astaire-6c565bf445-', u'creationTimestamp': u'2020-07-23T12:50:24Z', u'selfLink': u'/api/v1/namespaces/default/pods/astaire-6c565bf445-bw24g', u'uid': u'13acf90e-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'astaire-6c565bf445-', 'generation': None, 'initializers': None, 'labels': {u'pod-template-hash': '6c565bf445', u'service': 'astaire'}, 'managed_fields': None, 'name': 'astaire-6c565bf445-bw24g', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'astaire-6c565bf445', 'uid': '13a593a6-cce3-11ea-b2c9-0242ac120008'}], 'resource_version': '2370673', 'self_link': '/api/v1/namespaces/default/pods/astaire-6c565bf445-bw24g', 'uid': '13acf90e-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-astaire:latest', 'image_pull_policy': 'Always', 'lifecycle': {'post_start': None, 'pre_stop': {'_exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}, 'http_get': None, 'tcp_socket': None}}, 'liveness_probe': {'_exec': None, 'failure_threshold': 9, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 11311}, 'timeout_seconds': 1}, 'name': 'astaire', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 11211, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 11311, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 11311}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/astaire', 'mount_propagation': None, 'name': 'astairelogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-pvhrj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/astaire/astaire_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/astaire', 'mount_propagation': None, 'name': 'astairelogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-pvhrj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-pvhrj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'hunter-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 120, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'astairelogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}, {'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-pvhrj', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-pvhrj'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 52, 37, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 53, 38, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 53, 38, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://10413f5e52e9b4c28e2bcdaeff67879b52d85c0baa9c59992247ea81eab01e77', 'image': 'docker.io/ollivier/clearwater-astaire:latest', 'image_id': 'docker.io/ollivier/clearwater-astaire@sha256:24e9186a8be32af9559f4d198c5c423eaac0d6c7b827c5ab674f2d124385c2fb', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'astaire', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 23, 12, 52, 51, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}, {'container_id': 'containerd://89bb5347844b0011da4c7eff49e2d76a4a88b2ad7038d1b1b9923bbb5732d203', 'image': 'docker.io/library/busybox:latest', 'image_id': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'tailer', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 23, 12, 52, 55, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.4', 'init_container_statuses': [{'container_id': 'containerd://99ae3364f3ef067f952743247049ea288a493e2aed6ddb65c4780d58777632f4', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-cassandra', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://99ae3364f3ef067f952743247049ea288a493e2aed6ddb65c4780d58777632f4', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 23, 12, 52, 35, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 23, 12, 50, 30, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.157', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal())}}, u'type': u'ADDED'} 2020-07-23 12:55:27,185 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'phase': u'Pending', u'qosClass': u'BestEffort'}, u'kind': u'Pod', u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'serviceAccountName': u'default', u'schedulerName': u'default-scheduler', u'enableServiceLinks': True, u'serviceAccount': u'default', u'priority': 0, u'terminationGracePeriodSeconds': 30, u'restartPolicy': u'Never', u'volumes': [{u'secret': {u'defaultMode': 420, u'secretName': u'default-token-pvhrj'}, u'name': u'default-token-pvhrj'}], u'tolerations': [{u'operator': u'Exists', u'tolerationSeconds': 300, u'effect': u'NoExecute', u'key': u'node.kubernetes.io/not-ready'}, {u'operator': u'Exists', u'tolerationSeconds': 300, u'effect': u'NoExecute', u'key': u'node.kubernetes.io/unreachable'}], u'containers': [{u'terminationMessagePath': u'/dev/termination-log', u'name': u'live-test', u'image': u'ollivier/clearwater-live-test:latest', u'volumeMounts': [{u'readOnly': True, u'mountPath': u'/var/run/secrets/kubernetes.io/serviceaccount', u'name': u'default-token-pvhrj'}], u'terminationMessagePolicy': u'File', u'imagePullPolicy': u'Always', u'resources': {}}]}, u'apiVersion': u'v1', u'metadata': {u'name': u'live-test', u'namespace': u'default', u'resourceVersion': u'2370937', u'creationTimestamp': u'2020-07-23T12:55:26Z', u'selfLink': u'/api/v1/namespaces/default/pods/live-test', u'uid': u'c7c44ba1-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 55, 26, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'live-test', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370937', 'self_link': '/api/v1/namespaces/default/pods/live-test', 'uid': 'c7c44ba1-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-pvhrj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Never', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-pvhrj', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-pvhrj'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': None, 'container_statuses': None, 'host_ip': None, 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Pending', 'pod_ip': None, 'qos_class': 'BestEffort', 'reason': None, 'start_time': None}}, u'type': u'ADDED'} 2020-07-23 12:55:27,209 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'initContainerStatuses': [{u'restartCount': 0, u'name': u'wait-on-etcd', u'image': u'docker.io/library/busybox:1.28', u'imageID': u'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', u'state': {u'terminated': {u'startedAt': u'2020-07-23T12:50:31Z', u'reason': u'Completed', u'finishedAt': u'2020-07-23T12:51:02Z', u'containerID': u'containerd://bb4a532201a85ada5938c6d38f022ed7d6db4a9cb650b55ccb9e0ec2f194f877', u'exitCode': 0}}, u'ready': True, u'lastState': {}, u'containerID': u'containerd://bb4a532201a85ada5938c6d38f022ed7d6db4a9cb650b55ccb9e0ec2f194f877'}], u'qosClass': u'BestEffort', u'containerStatuses': [{u'restartCount': 0, u'name': u'cassandra', u'image': u'docker.io/ollivier/clearwater-cassandra:latest', u'imageID': u'docker.io/ollivier/clearwater-cassandra@sha256:24f49e5e936930e808cd79cac72fd4f2dc87e97b33a9dedecf60d0eb1f655015', u'state': {u'running': {u'startedAt': u'2020-07-23T12:51:06Z'}}, u'ready': True, u'lastState': {}, u'containerID': u'containerd://8c493816117b8a10270b885229afdf87847c116c59974005da0ae6cb8f2701af'}], u'podIP': u'10.244.1.83', u'startTime': u'2020-07-23T12:50:25Z', u'hostIP': u'172.18.0.2', u'phase': u'Running', u'conditions': [{u'status': u'True', u'lastProbeTime': None, u'type': u'Initialized', u'lastTransitionTime': u'2020-07-23T12:51:03Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'Ready', u'lastTransitionTime': u'2020-07-23T12:52:05Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'ContainersReady', u'lastTransitionTime': u'2020-07-23T12:52:05Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'PodScheduled', u'lastTransitionTime': u'2020-07-23T12:50:24Z'}]}, u'kind': u'Pod', u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'serviceAccountName': u'default', u'schedulerName': u'default-scheduler', u'enableServiceLinks': True, u'serviceAccount': u'default', u'priority': 0, u'terminationGracePeriodSeconds': 30, u'restartPolicy': u'Always', u'volumes': [{u'secret': {u'defaultMode': 420, u'secretName': u'default-token-pvhrj'}, u'name': u'default-token-pvhrj'}], u'tolerations': [{u'operator': u'Exists', u'tolerationSeconds': 300, u'effect': u'NoExecute', u'key': u'node.kubernetes.io/not-ready'}, {u'operator': u'Exists', u'tolerationSeconds': 300, u'effect': u'NoExecute', u'key': u'node.kubernetes.io/unreachable'}], u'initContainers': [{u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-etcd', u'image': u'busybox:1.28', u'volumeMounts': [{u'readOnly': True, u'mountPath': u'/var/run/secrets/kubernetes.io/serviceaccount', u'name': u'default-token-pvhrj'}], u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup etcd; do echo waiting for etcd to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}], u'imagePullSecrets': [{}], u'containers': [{u'livenessProbe': {u'timeoutSeconds': 1, u'exec': {u'command': [u'/bin/bash', u'/usr/share/kubernetes/liveness.sh', u'7000 9042 9160']}, u'initialDelaySeconds': 600, u'periodSeconds': 10, u'successThreshold': 1, u'failureThreshold': 3}, u'terminationMessagePath': u'/dev/termination-log', u'name': u'cassandra', u'envFrom': [{u'configMapRef': {u'name': u'env-vars'}}], u'image': u'ollivier/clearwater-cassandra:latest', u'volumeMounts': [{u'readOnly': True, u'mountPath': u'/var/run/secrets/kubernetes.io/serviceaccount', u'name': u'default-token-pvhrj'}], u'terminationMessagePolicy': u'File', u'env': [{u'valueFrom': {u'fieldRef': {u'fieldPath': u'status.podIP', u'apiVersion': u'v1'}}, u'name': u'MY_POD_IP'}], u'imagePullPolicy': u'Always', u'readinessProbe': {u'successThreshold': 1, u'periodSeconds': 10, u'failureThreshold': 3, u'timeoutSeconds': 1, u'exec': {u'command': [u'/bin/bash', u'/usr/share/kubernetes/liveness.sh', u'7000 9042 9160']}}, u'ports': [{u'protocol': u'TCP', u'containerPort': 22}, {u'protocol': u'TCP', u'containerPort': 7001}, {u'protocol': u'TCP', u'containerPort': 9042}, {u'protocol': u'TCP', u'containerPort': 9160}], u'resources': {}}], u'nodeName': u'hunter-worker2'}, u'apiVersion': u'v1', u'metadata': {u'name': u'cassandra-6d8c846bfc-2ksjg', u'labels': {u'pod-template-hash': u'6d8c846bfc', u'service': u'cassandra'}, u'namespace': u'default', u'ownerReferences': [{u'kind': u'ReplicaSet', u'name': u'cassandra-6d8c846bfc', u'apiVersion': u'apps/v1', u'controller': True, u'blockOwnerDeletion': True, u'uid': u'13bbb496-cce3-11ea-b2c9-0242ac120008'}], u'resourceVersion': u'2370426', u'generateName': u'cassandra-6d8c846bfc-', u'creationTimestamp': u'2020-07-23T12:50:24Z', u'selfLink': u'/api/v1/namespaces/default/pods/cassandra-6d8c846bfc-2ksjg', u'uid': u'13c3de75-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'cassandra-6d8c846bfc-', 'generation': None, 'initializers': None, 'labels': {u'pod-template-hash': '6d8c846bfc', u'service': 'cassandra'}, 'managed_fields': None, 'name': 'cassandra-6d8c846bfc-2ksjg', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'cassandra-6d8c846bfc', 'uid': '13bbb496-cce3-11ea-b2c9-0242ac120008'}], 'resource_version': '2370426', 'self_link': '/api/v1/namespaces/default/pods/cassandra-6d8c846bfc-2ksjg', 'uid': '13c3de75-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-cassandra:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 9160']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 600, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'cassandra', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7001, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 9042, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 9160, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 9160']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-pvhrj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup etcd; do echo waiting for etcd to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-etcd', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-pvhrj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'hunter-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-pvhrj', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-pvhrj'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 51, 3, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 52, 5, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 52, 5, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://8c493816117b8a10270b885229afdf87847c116c59974005da0ae6cb8f2701af', 'image': 'docker.io/ollivier/clearwater-cassandra:latest', 'image_id': 'docker.io/ollivier/clearwater-cassandra@sha256:24f49e5e936930e808cd79cac72fd4f2dc87e97b33a9dedecf60d0eb1f655015', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'cassandra', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 23, 12, 51, 6, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.2', 'init_container_statuses': [{'container_id': 'containerd://bb4a532201a85ada5938c6d38f022ed7d6db4a9cb650b55ccb9e0ec2f194f877', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-etcd', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://bb4a532201a85ada5938c6d38f022ed7d6db4a9cb650b55ccb9e0ec2f194f877', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 23, 12, 51, 2, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 23, 12, 50, 31, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.83', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal())}}, u'type': u'ADDED'} 2020-07-23 12:55:27,263 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'initContainerStatuses': [{u'restartCount': 0, u'name': u'wait-on-cassandra', u'image': u'docker.io/library/busybox:1.28', u'imageID': u'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', u'state': {u'terminated': {u'startedAt': u'2020-07-23T12:50:34Z', u'reason': u'Completed', u'finishedAt': u'2020-07-23T12:52:35Z', u'containerID': u'containerd://2106b52960d7379b09dbe1ab8c19f74b375f278c7eda87df7eb9f66fa82044ae', u'exitCode': 0}}, u'ready': True, u'lastState': {}, u'containerID': u'containerd://2106b52960d7379b09dbe1ab8c19f74b375f278c7eda87df7eb9f66fa82044ae'}], u'qosClass': u'BestEffort', u'containerStatuses': [{u'restartCount': 0, u'name': u'homer', u'image': u'docker.io/ollivier/clearwater-homer:latest', u'imageID': u'docker.io/ollivier/clearwater-homer@sha256:69b5406c3dcf61c95a067571c873b8691dc7cb23b24dbe3749b0a1d2b7c08ca9', u'state': {u'running': {u'startedAt': u'2020-07-23T12:52:43Z'}}, u'ready': True, u'lastState': {}, u'containerID': u'containerd://c4d74d8bef161887aa655b9504438cf13a767e2100235b3eaa8ef8af595aef78'}], u'podIP': u'10.244.2.160', u'startTime': u'2020-07-23T12:50:25Z', u'hostIP': u'172.18.0.4', u'phase': u'Running', u'conditions': [{u'status': u'True', u'lastProbeTime': None, u'type': u'Initialized', u'lastTransitionTime': u'2020-07-23T12:52:36Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'Ready', u'lastTransitionTime': u'2020-07-23T12:52:54Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'ContainersReady', u'lastTransitionTime': u'2020-07-23T12:52:54Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'PodScheduled', u'lastTransitionTime': u'2020-07-23T12:50:25Z'}]}, u'kind': u'Pod', u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'serviceAccountName': u'default', u'schedulerName': u'default-scheduler', u'enableServiceLinks': True, u'serviceAccount': u'default', u'priority': 0, u'terminationGracePeriodSeconds': 30, u'restartPolicy': u'Always', u'volumes': [{u'secret': {u'defaultMode': 420, u'secretName': u'default-token-pvhrj'}, u'name': u'default-token-pvhrj'}], u'tolerations': [{u'operator': u'Exists', u'tolerationSeconds': 300, u'effect': u'NoExecute', u'key': u'node.kubernetes.io/not-ready'}, {u'operator': u'Exists', u'tolerationSeconds': 300, u'effect': u'NoExecute', u'key': u'node.kubernetes.io/unreachable'}], u'initContainers': [{u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-cassandra', u'image': u'busybox:1.28', u'volumeMounts': [{u'readOnly': True, u'mountPath': u'/var/run/secrets/kubernetes.io/serviceaccount', u'name': u'default-token-pvhrj'}], u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}], u'imagePullSecrets': [{}], u'containers': [{u'livenessProbe': {u'tcpSocket': {u'port': 7888}, u'timeoutSeconds': 1, u'initialDelaySeconds': 30, u'periodSeconds': 10, u'successThreshold': 1, u'failureThreshold': 3}, u'terminationMessagePath': u'/dev/termination-log', u'name': u'homer', u'envFrom': [{u'configMapRef': {u'name': u'env-vars'}}], u'image': u'ollivier/clearwater-homer:latest', u'volumeMounts': [{u'readOnly': True, u'mountPath': u'/var/run/secrets/kubernetes.io/serviceaccount', u'name': u'default-token-pvhrj'}], u'terminationMessagePolicy': u'File', u'env': [{u'valueFrom': {u'fieldRef': {u'fieldPath': u'status.podIP', u'apiVersion': u'v1'}}, u'name': u'MY_POD_IP'}], u'imagePullPolicy': u'Always', u'readinessProbe': {u'successThreshold': 1, u'tcpSocket': {u'port': 7888}, u'failureThreshold': 3, u'timeoutSeconds': 1, u'periodSeconds': 10}, u'ports': [{u'protocol': u'TCP', u'containerPort': 22}, {u'protocol': u'TCP', u'containerPort': 7888}], u'resources': {}}], u'nodeName': u'hunter-worker'}, u'apiVersion': u'v1', u'metadata': {u'name': u'homer-58cfb54cd9-gc4rl', u'labels': {u'pod-template-hash': u'58cfb54cd9', u'service': u'homer'}, u'namespace': u'default', u'ownerReferences': [{u'kind': u'ReplicaSet', u'name': u'homer-58cfb54cd9', u'apiVersion': u'apps/v1', u'controller': True, u'blockOwnerDeletion': True, u'uid': u'13d70aa2-cce3-11ea-b2c9-0242ac120008'}], u'resourceVersion': u'2370558', u'generateName': u'homer-58cfb54cd9-', u'creationTimestamp': u'2020-07-23T12:50:25Z', u'selfLink': u'/api/v1/namespaces/default/pods/homer-58cfb54cd9-gc4rl', u'uid': u'13e0efb0-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'homer-58cfb54cd9-', 'generation': None, 'initializers': None, 'labels': {u'pod-template-hash': '58cfb54cd9', u'service': 'homer'}, 'managed_fields': None, 'name': 'homer-58cfb54cd9-gc4rl', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'homer-58cfb54cd9', 'uid': '13d70aa2-cce3-11ea-b2c9-0242ac120008'}], 'resource_version': '2370558', 'self_link': '/api/v1/namespaces/default/pods/homer-58cfb54cd9-gc4rl', 'uid': '13e0efb0-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homer:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'name': 'homer', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-pvhrj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-pvhrj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'hunter-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-pvhrj', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-pvhrj'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 52, 36, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 52, 54, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 52, 54, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://c4d74d8bef161887aa655b9504438cf13a767e2100235b3eaa8ef8af595aef78', 'image': 'docker.io/ollivier/clearwater-homer:latest', 'image_id': 'docker.io/ollivier/clearwater-homer@sha256:69b5406c3dcf61c95a067571c873b8691dc7cb23b24dbe3749b0a1d2b7c08ca9', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'homer', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 23, 12, 52, 43, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.4', 'init_container_statuses': [{'container_id': 'containerd://2106b52960d7379b09dbe1ab8c19f74b375f278c7eda87df7eb9f66fa82044ae', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-cassandra', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://2106b52960d7379b09dbe1ab8c19f74b375f278c7eda87df7eb9f66fa82044ae', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 23, 12, 52, 35, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 23, 12, 50, 34, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.160', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal())}}, u'type': u'ADDED'} 2020-07-23 12:55:27,318 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'initContainerStatuses': [{u'restartCount': 0, u'name': u'wait-on-homestead', u'image': u'docker.io/library/busybox:1.28', u'imageID': u'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', u'state': {u'terminated': {u'startedAt': u'2020-07-23T12:50:35Z', u'reason': u'Completed', u'finishedAt': u'2020-07-23T12:54:15Z', u'containerID': u'containerd://465dd1bd7c53f68a39c0946ed1ff2cc029104cc09c65c0123648602152130105', u'exitCode': 0}}, u'ready': True, u'lastState': {}, u'containerID': u'containerd://465dd1bd7c53f68a39c0946ed1ff2cc029104cc09c65c0123648602152130105'}], u'qosClass': u'BestEffort', u'containerStatuses': [{u'restartCount': 0, u'name': u'homestead-prov', u'image': u'docker.io/ollivier/clearwater-homestead-prov:latest', u'imageID': u'docker.io/ollivier/clearwater-homestead-prov@sha256:21ea1bbce8747d80fc46c07ee0bdb94653036ee544413853074f39900798a7d8', u'state': {u'running': {u'startedAt': u'2020-07-23T12:54:29Z'}}, u'ready': True, u'lastState': {}, u'containerID': u'containerd://95944562efce0826862d28faaebf592fe2ff95ec3af45fb3ceef05dc43f2eccc'}], u'podIP': u'10.244.2.161', u'startTime': u'2020-07-23T12:50:26Z', u'hostIP': u'172.18.0.4', u'phase': u'Running', u'conditions': [{u'status': u'True', u'lastProbeTime': None, u'type': u'Initialized', u'lastTransitionTime': u'2020-07-23T12:54:21Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'Ready', u'lastTransitionTime': u'2020-07-23T12:54:44Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'ContainersReady', u'lastTransitionTime': u'2020-07-23T12:54:44Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'PodScheduled', u'lastTransitionTime': u'2020-07-23T12:50:25Z'}]}, u'kind': u'Pod', u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'serviceAccountName': u'default', u'schedulerName': u'default-scheduler', u'enableServiceLinks': True, u'serviceAccount': u'default', u'priority': 0, u'terminationGracePeriodSeconds': 30, u'restartPolicy': u'Always', u'volumes': [{u'secret': {u'defaultMode': 420, u'secretName': u'default-token-pvhrj'}, u'name': u'default-token-pvhrj'}], u'tolerations': [{u'operator': u'Exists', u'tolerationSeconds': 300, u'effect': u'NoExecute', u'key': u'node.kubernetes.io/not-ready'}, {u'operator': u'Exists', u'tolerationSeconds': 300, u'effect': u'NoExecute', u'key': u'node.kubernetes.io/unreachable'}], u'initContainers': [{u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-homestead', u'image': u'busybox:1.28', u'volumeMounts': [{u'readOnly': True, u'mountPath': u'/var/run/secrets/kubernetes.io/serviceaccount', u'name': u'default-token-pvhrj'}], u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}], u'imagePullSecrets': [{}], u'containers': [{u'livenessProbe': {u'timeoutSeconds': 1, u'exec': {u'command': [u'/bin/bash', u'/usr/share/clearwater/bin/poll_homestead-prov.sh']}, u'initialDelaySeconds': 60, u'periodSeconds': 10, u'successThreshold': 1, u'failureThreshold': 3}, u'terminationMessagePath': u'/dev/termination-log', u'name': u'homestead-prov', u'envFrom': [{u'configMapRef': {u'name': u'env-vars'}}], u'image': u'ollivier/clearwater-homestead-prov:latest', u'volumeMounts': [{u'readOnly': True, u'mountPath': u'/var/run/secrets/kubernetes.io/serviceaccount', u'name': u'default-token-pvhrj'}], u'terminationMessagePolicy': u'File', u'env': [{u'valueFrom': {u'fieldRef': {u'fieldPath': u'status.podIP', u'apiVersion': u'v1'}}, u'name': u'MY_POD_IP'}], u'imagePullPolicy': u'Always', u'readinessProbe': {u'successThreshold': 1, u'periodSeconds': 10, u'failureThreshold': 3, u'timeoutSeconds': 1, u'exec': {u'command': [u'/bin/bash', u'/usr/share/clearwater/bin/poll_homestead-prov.sh']}}, u'ports': [{u'protocol': u'TCP', u'containerPort': 22}, {u'protocol': u'TCP', u'containerPort': 8889}], u'resources': {}}], u'nodeName': u'hunter-worker'}, u'apiVersion': u'v1', u'metadata': {u'name': u'homestead-prov-745965b8-m5g8x', u'labels': {u'pod-template-hash': u'745965b8', u'snmp': u'enabled', u'service': u'homestead-prov'}, u'namespace': u'default', u'ownerReferences': [{u'kind': u'ReplicaSet', u'name': u'homestead-prov-745965b8', u'apiVersion': u'apps/v1', u'controller': True, u'blockOwnerDeletion': True, u'uid': u'13e78e98-cce3-11ea-b2c9-0242ac120008'}], u'resourceVersion': u'2370833', u'generateName': u'homestead-prov-745965b8-', u'creationTimestamp': u'2020-07-23T12:50:25Z', u'selfLink': u'/api/v1/namespaces/default/pods/homestead-prov-745965b8-m5g8x', u'uid': u'13e9eb88-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'homestead-prov-745965b8-', 'generation': None, 'initializers': None, 'labels': {u'pod-template-hash': '745965b8', u'service': 'homestead-prov', u'snmp': 'enabled'}, 'managed_fields': None, 'name': 'homestead-prov-745965b8-m5g8x', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'homestead-prov-745965b8', 'uid': '13e78e98-cce3-11ea-b2c9-0242ac120008'}], 'resource_version': '2370833', 'self_link': '/api/v1/namespaces/default/pods/homestead-prov-745965b8-m5g8x', 'uid': '13e9eb88-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead-prov:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead-prov', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8889, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-pvhrj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-pvhrj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'hunter-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-pvhrj', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-pvhrj'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 54, 21, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 54, 44, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 54, 44, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://95944562efce0826862d28faaebf592fe2ff95ec3af45fb3ceef05dc43f2eccc', 'image': 'docker.io/ollivier/clearwater-homestead-prov:latest', 'image_id': 'docker.io/ollivier/clearwater-homestead-prov@sha256:21ea1bbce8747d80fc46c07ee0bdb94653036ee544413853074f39900798a7d8', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'homestead-prov', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 23, 12, 54, 29, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.4', 'init_container_statuses': [{'container_id': 'containerd://465dd1bd7c53f68a39c0946ed1ff2cc029104cc09c65c0123648602152130105', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-homestead', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://465dd1bd7c53f68a39c0946ed1ff2cc029104cc09c65c0123648602152130105', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 23, 12, 54, 15, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 23, 12, 50, 35, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.161', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 23, 12, 50, 26, tzinfo=tzlocal())}}, u'type': u'ADDED'} 2020-07-23 12:55:27,374 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'initContainerStatuses': [{u'restartCount': 0, u'name': u'wait-on-cassandra', u'image': u'docker.io/library/busybox:1.28', u'imageID': u'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', u'state': {u'terminated': {u'startedAt': u'2020-07-23T12:50:34Z', u'reason': u'Completed', u'finishedAt': u'2020-07-23T12:52:34Z', u'containerID': u'containerd://a96087ca9b46394635b1104bf460243d8f18b1148ea0c8199957d875a63d7069', u'exitCode': 0}}, u'ready': True, u'lastState': {}, u'containerID': u'containerd://a96087ca9b46394635b1104bf460243d8f18b1148ea0c8199957d875a63d7069'}], u'qosClass': u'BestEffort', u'containerStatuses': [{u'restartCount': 0, u'name': u'ralf', u'image': u'docker.io/ollivier/clearwater-ralf:latest', u'imageID': u'docker.io/ollivier/clearwater-ralf@sha256:becf37bf5c8d9f81189d9d727c3c3ab7e032b7de3a710f7bbb264d35d442a344', u'state': {u'running': {u'startedAt': u'2020-07-23T12:52:42Z'}}, u'ready': True, u'lastState': {}, u'containerID': u'containerd://35fb7be6c0ef4d4694171b4975534c2feb3ca38831c6a7ab08116b8f8319cd83'}, {u'restartCount': 0, u'name': u'tailer', u'image': u'docker.io/library/busybox:latest', u'imageID': u'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', u'state': {u'running': {u'startedAt': u'2020-07-23T12:52:46Z'}}, u'ready': True, u'lastState': {}, u'containerID': u'containerd://20effa405a5bcbdd0ec92b24b3e54e143b8064a1862ab0335b8b6a03a65dfb46'}], u'podIP': u'10.244.1.86', u'startTime': u'2020-07-23T12:50:26Z', u'hostIP': u'172.18.0.2', u'phase': u'Running', u'conditions': [{u'status': u'True', u'lastProbeTime': None, u'type': u'Initialized', u'lastTransitionTime': u'2020-07-23T12:52:35Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'Ready', u'lastTransitionTime': u'2020-07-23T12:52:56Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'ContainersReady', u'lastTransitionTime': u'2020-07-23T12:52:56Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'PodScheduled', u'lastTransitionTime': u'2020-07-23T12:50:26Z'}]}, u'kind': u'Pod', u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'serviceAccountName': u'default', u'schedulerName': u'default-scheduler', u'enableServiceLinks': True, u'serviceAccount': u'default', u'priority': 0, u'terminationGracePeriodSeconds': 30, u'restartPolicy': u'Always', u'volumes': [{u'emptyDir': {}, u'name': u'ralflogs'}, {u'secret': {u'defaultMode': 420, u'secretName': u'default-token-pvhrj'}, u'name': u'default-token-pvhrj'}], u'tolerations': [{u'operator': u'Exists', u'tolerationSeconds': 300, u'effect': u'NoExecute', u'key': u'node.kubernetes.io/not-ready'}, {u'operator': u'Exists', u'tolerationSeconds': 300, u'effect': u'NoExecute', u'key': u'node.kubernetes.io/unreachable'}], u'initContainers': [{u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-cassandra', u'image': u'busybox:1.28', u'volumeMounts': [{u'readOnly': True, u'mountPath': u'/var/run/secrets/kubernetes.io/serviceaccount', u'name': u'default-token-pvhrj'}], u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}], u'imagePullSecrets': [{}], u'containers': [{u'livenessProbe': {u'tcpSocket': {u'port': 10888}, u'timeoutSeconds': 1, u'initialDelaySeconds': 30, u'periodSeconds': 10, u'successThreshold': 1, u'failureThreshold': 3}, u'terminationMessagePath': u'/dev/termination-log', u'name': u'ralf', u'envFrom': [{u'configMapRef': {u'name': u'env-vars'}}], u'image': u'ollivier/clearwater-ralf:latest', u'volumeMounts': [{u'mountPath': u'/var/log/ralf', u'name': u'ralflogs'}, {u'readOnly': True, u'mountPath': u'/var/run/secrets/kubernetes.io/serviceaccount', u'name': u'default-token-pvhrj'}], u'terminationMessagePolicy': u'File', u'env': [{u'valueFrom': {u'fieldRef': {u'fieldPath': u'status.podIP', u'apiVersion': u'v1'}}, u'name': u'MY_POD_IP'}], u'imagePullPolicy': u'Always', u'readinessProbe': {u'successThreshold': 1, u'tcpSocket': {u'port': 10888}, u'failureThreshold': 3, u'timeoutSeconds': 1, u'periodSeconds': 10}, u'ports': [{u'protocol': u'TCP', u'containerPort': 22}, {u'protocol': u'TCP', u'containerPort': 10888}], u'resources': {}}, {u'terminationMessagePath': u'/dev/termination-log', u'name': u'tailer', u'image': u'busybox', u'volumeMounts': [{u'mountPath': u'/var/log/ralf', u'name': u'ralflogs'}, {u'readOnly': True, u'mountPath': u'/var/run/secrets/kubernetes.io/serviceaccount', u'name': u'default-token-pvhrj'}], u'terminationMessagePolicy': u'File', u'command': [u'tail', u'-F', u'/var/log/ralf/ralf_current.txt'], u'imagePullPolicy': u'Always', u'resources': {}}], u'nodeName': u'hunter-worker2'}, u'apiVersion': u'v1', u'metadata': {u'name': u'ralf-744548cc6d-l9m8n', u'labels': {u'pod-template-hash': u'744548cc6d', u'snmp': u'enabled', u'service': u'ralf'}, u'namespace': u'default', u'ownerReferences': [{u'kind': u'ReplicaSet', u'name': u'ralf-744548cc6d', u'apiVersion': u'apps/v1', u'controller': True, u'blockOwnerDeletion': True, u'uid': u'14351e38-cce3-11ea-b2c9-0242ac120008'}], u'resourceVersion': u'2370570', u'generateName': u'ralf-744548cc6d-', u'creationTimestamp': u'2020-07-23T12:50:26Z', u'selfLink': u'/api/v1/namespaces/default/pods/ralf-744548cc6d-l9m8n', u'uid': u'14734e45-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 26, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'ralf-744548cc6d-', 'generation': None, 'initializers': None, 'labels': {u'pod-template-hash': '744548cc6d', u'service': 'ralf', u'snmp': 'enabled'}, 'managed_fields': None, 'name': 'ralf-744548cc6d-l9m8n', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'ralf-744548cc6d', 'uid': '14351e38-cce3-11ea-b2c9-0242ac120008'}], 'resource_version': '2370570', 'self_link': '/api/v1/namespaces/default/pods/ralf-744548cc6d-l9m8n', 'uid': '14734e45-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-ralf:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'name': 'ralf', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 10888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-pvhrj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-pvhrj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-pvhrj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'hunter-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'ralflogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}, {'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-pvhrj', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-pvhrj'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 52, 35, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 52, 56, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 52, 56, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 26, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://35fb7be6c0ef4d4694171b4975534c2feb3ca38831c6a7ab08116b8f8319cd83', 'image': 'docker.io/ollivier/clearwater-ralf:latest', 'image_id': 'docker.io/ollivier/clearwater-ralf@sha256:becf37bf5c8d9f81189d9d727c3c3ab7e032b7de3a710f7bbb264d35d442a344', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'ralf', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 23, 12, 52, 42, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}, {'container_id': 'containerd://20effa405a5bcbdd0ec92b24b3e54e143b8064a1862ab0335b8b6a03a65dfb46', 'image': 'docker.io/library/busybox:latest', 'image_id': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'tailer', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 23, 12, 52, 46, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.2', 'init_container_statuses': [{'container_id': 'containerd://a96087ca9b46394635b1104bf460243d8f18b1148ea0c8199957d875a63d7069', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-cassandra', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://a96087ca9b46394635b1104bf460243d8f18b1148ea0c8199957d875a63d7069', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 23, 12, 52, 34, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 23, 12, 50, 34, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.86', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 23, 12, 50, 26, tzinfo=tzlocal())}}, u'type': u'ADDED'} 2020-07-23 12:55:27,444 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'initContainerStatuses': [{u'restartCount': 0, u'name': u'wait-on-homestead-prov', u'image': u'docker.io/library/busybox:1.28', u'imageID': u'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', u'state': {u'terminated': {u'startedAt': u'2020-07-23T12:50:34Z', u'reason': u'Completed', u'finishedAt': u'2020-07-23T12:54:50Z', u'containerID': u'containerd://6c2ad7110f1d81915e5280bf739c89abebf545ecf54f823a46182864e4870538', u'exitCode': 0}}, u'ready': True, u'lastState': {}, u'containerID': u'containerd://6c2ad7110f1d81915e5280bf739c89abebf545ecf54f823a46182864e4870538'}, {u'restartCount': 0, u'name': u'wait-on-sprout', u'image': u'docker.io/library/busybox:1.28', u'imageID': u'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', u'state': {u'terminated': {u'startedAt': u'2020-07-23T12:54:54Z', u'reason': u'Completed', u'finishedAt': u'2020-07-23T12:54:56Z', u'containerID': u'containerd://659cf6604c99bdb87a90edf8b5ea9d3412fbc0fab48c5968981363e18d59d0b2', u'exitCode': 0}}, u'ready': True, u'lastState': {}, u'containerID': u'containerd://659cf6604c99bdb87a90edf8b5ea9d3412fbc0fab48c5968981363e18d59d0b2'}], u'qosClass': u'BestEffort', u'containerStatuses': [{u'restartCount': 0, u'name': u'ellis', u'image': u'docker.io/ollivier/clearwater-ellis:latest', u'imageID': u'docker.io/ollivier/clearwater-ellis@sha256:ba47a8963e0683886890de11cf65942f3460ec4e2ad313f1e0fe0d144b12969b', u'state': {u'running': {u'startedAt': u'2020-07-23T12:55:11Z'}}, u'ready': True, u'lastState': {}, u'containerID': u'containerd://bcf71e2e61af32afa78f2198f6cb806be7d7c0aca614536e6ae76a4e45bc1522'}], u'podIP': u'10.244.2.158', u'startTime': u'2020-07-23T12:50:25Z', u'hostIP': u'172.18.0.4', u'phase': u'Running', u'conditions': [{u'status': u'True', u'lastProbeTime': None, u'type': u'Initialized', u'lastTransitionTime': u'2020-07-23T12:54:57Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'Ready', u'lastTransitionTime': u'2020-07-23T12:55:26Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'ContainersReady', u'lastTransitionTime': u'2020-07-23T12:55:26Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'PodScheduled', u'lastTransitionTime': u'2020-07-23T12:50:25Z'}]}, u'kind': u'Pod', u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'serviceAccountName': u'default', u'schedulerName': u'default-scheduler', u'enableServiceLinks': True, u'serviceAccount': u'default', u'priority': 0, u'terminationGracePeriodSeconds': 30, u'restartPolicy': u'Always', u'volumes': [{u'secret': {u'defaultMode': 420, u'secretName': u'default-token-pvhrj'}, u'name': u'default-token-pvhrj'}], u'tolerations': [{u'operator': u'Exists', u'tolerationSeconds': 300, u'effect': u'NoExecute', u'key': u'node.kubernetes.io/not-ready'}, {u'operator': u'Exists', u'tolerationSeconds': 300, u'effect': u'NoExecute', u'key': u'node.kubernetes.io/unreachable'}], u'initContainers': [{u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-homestead-prov', u'image': u'busybox:1.28', u'volumeMounts': [{u'readOnly': True, u'mountPath': u'/var/run/secrets/kubernetes.io/serviceaccount', u'name': u'default-token-pvhrj'}], u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup homestead-prov; do echo waiting for homestead-prov to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}, {u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-sprout', u'image': u'busybox:1.28', u'volumeMounts': [{u'readOnly': True, u'mountPath': u'/var/run/secrets/kubernetes.io/serviceaccount', u'name': u'default-token-pvhrj'}], u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}], u'imagePullSecrets': [{}], u'containers': [{u'livenessProbe': {u'tcpSocket': {u'port': 80}, u'timeoutSeconds': 1, u'initialDelaySeconds': 30, u'periodSeconds': 10, u'successThreshold': 1, u'failureThreshold': 3}, u'terminationMessagePath': u'/dev/termination-log', u'name': u'ellis', u'envFrom': [{u'configMapRef': {u'name': u'env-vars'}}], u'image': u'ollivier/clearwater-ellis:latest', u'volumeMounts': [{u'readOnly': True, u'mountPath': u'/var/run/secrets/kubernetes.io/serviceaccount', u'name': u'default-token-pvhrj'}], u'terminationMessagePolicy': u'File', u'env': [{u'valueFrom': {u'fieldRef': {u'fieldPath': u'status.podIP', u'apiVersion': u'v1'}}, u'name': u'MY_POD_IP'}], u'imagePullPolicy': u'Always', u'readinessProbe': {u'successThreshold': 1, u'tcpSocket': {u'port': 80}, u'failureThreshold': 3, u'timeoutSeconds': 1, u'periodSeconds': 10}, u'ports': [{u'protocol': u'TCP', u'containerPort': 22}, {u'protocol': u'TCP', u'containerPort': 80}], u'resources': {}}], u'nodeName': u'hunter-worker'}, u'apiVersion': u'v1', u'metadata': {u'name': u'ellis-6d885b94fc-4fb82', u'labels': {u'pod-template-hash': u'6d885b94fc', u'service': u'ellis'}, u'namespace': u'default', u'ownerReferences': [{u'kind': u'ReplicaSet', u'name': u'ellis-6d885b94fc', u'apiVersion': u'apps/v1', u'controller': True, u'blockOwnerDeletion': True, u'uid': u'13c42519-cce3-11ea-b2c9-0242ac120008'}], u'resourceVersion': u'2370933', u'generateName': u'ellis-6d885b94fc-', u'creationTimestamp': u'2020-07-23T12:50:24Z', u'selfLink': u'/api/v1/namespaces/default/pods/ellis-6d885b94fc-4fb82', u'uid': u'13c90973-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'ellis-6d885b94fc-', 'generation': None, 'initializers': None, 'labels': {u'pod-template-hash': '6d885b94fc', u'service': 'ellis'}, 'managed_fields': None, 'name': 'ellis-6d885b94fc-4fb82', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'ellis-6d885b94fc', 'uid': '13c42519-cce3-11ea-b2c9-0242ac120008'}], 'resource_version': '2370933', 'self_link': '/api/v1/namespaces/default/pods/ellis-6d885b94fc-4fb82', 'uid': '13c90973-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-ellis:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 80}, 'timeout_seconds': 1}, 'name': 'ellis', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 80, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 80}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-pvhrj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup homestead-prov; do echo waiting for homestead-prov to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead-prov', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-pvhrj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-pvhrj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'hunter-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-pvhrj', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-pvhrj'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 54, 57, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 55, 26, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 55, 26, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://bcf71e2e61af32afa78f2198f6cb806be7d7c0aca614536e6ae76a4e45bc1522', 'image': 'docker.io/ollivier/clearwater-ellis:latest', 'image_id': 'docker.io/ollivier/clearwater-ellis@sha256:ba47a8963e0683886890de11cf65942f3460ec4e2ad313f1e0fe0d144b12969b', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'ellis', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 23, 12, 55, 11, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.4', 'init_container_statuses': [{'container_id': 'containerd://6c2ad7110f1d81915e5280bf739c89abebf545ecf54f823a46182864e4870538', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-homestead-prov', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://6c2ad7110f1d81915e5280bf739c89abebf545ecf54f823a46182864e4870538', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 23, 12, 54, 50, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 23, 12, 50, 34, tzinfo=tzlocal())}, 'waiting': None}}, {'container_id': 'containerd://659cf6604c99bdb87a90edf8b5ea9d3412fbc0fab48c5968981363e18d59d0b2', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-sprout', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://659cf6604c99bdb87a90edf8b5ea9d3412fbc0fab48c5968981363e18d59d0b2', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 23, 12, 54, 56, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 23, 12, 54, 54, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.158', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal())}}, u'type': u'ADDED'} 2020-07-23 12:55:27,519 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'initContainerStatuses': [{u'restartCount': 0, u'name': u'wait-on-cassandra', u'image': u'docker.io/library/busybox:1.28', u'imageID': u'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', u'state': {u'terminated': {u'startedAt': u'2020-07-23T12:50:34Z', u'reason': u'Completed', u'finishedAt': u'2020-07-23T12:52:35Z', u'containerID': u'containerd://f8d0dfa156b573ccef46c45f90bf1621d74706bdc5e01bf701fcc41875e32ccb', u'exitCode': 0}}, u'ready': True, u'lastState': {}, u'containerID': u'containerd://f8d0dfa156b573ccef46c45f90bf1621d74706bdc5e01bf701fcc41875e32ccb'}], u'qosClass': u'BestEffort', u'containerStatuses': [{u'restartCount': 0, u'name': u'chronos', u'image': u'docker.io/ollivier/clearwater-chronos:latest', u'imageID': u'docker.io/ollivier/clearwater-chronos@sha256:83359fb6320eefc0adbf56fcd4eb7a19be2c53dadaa4944a20510cc761536222', u'state': {u'running': {u'startedAt': u'2020-07-23T12:52:48Z'}}, u'ready': True, u'lastState': {}, u'containerID': u'containerd://6274d03334897bb19d357d86962e89ab98fce86a1f954d2e006dc56256cb1f70'}, {u'restartCount': 0, u'name': u'tailer', u'image': u'docker.io/library/busybox:latest', u'imageID': u'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', u'state': {u'running': {u'startedAt': u'2020-07-23T12:52:54Z'}}, u'ready': True, u'lastState': {}, u'containerID': u'containerd://67b1b4c476b6d9316b9eff6f48b2638772c0ee17c8385a24d4319c75850e50ba'}], u'podIP': u'10.244.2.159', u'startTime': u'2020-07-23T12:50:25Z', u'hostIP': u'172.18.0.4', u'phase': u'Running', u'conditions': [{u'status': u'True', u'lastProbeTime': None, u'type': u'Initialized', u'lastTransitionTime': u'2020-07-23T12:52:36Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'Ready', u'lastTransitionTime': u'2020-07-23T12:53:02Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'ContainersReady', u'lastTransitionTime': u'2020-07-23T12:53:02Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'PodScheduled', u'lastTransitionTime': u'2020-07-23T12:50:24Z'}]}, u'kind': u'Pod', u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'serviceAccountName': u'default', u'schedulerName': u'default-scheduler', u'enableServiceLinks': True, u'serviceAccount': u'default', u'priority': 0, u'terminationGracePeriodSeconds': 120, u'restartPolicy': u'Always', u'volumes': [{u'emptyDir': {}, u'name': u'chronoslogs'}, {u'secret': {u'defaultMode': 420, u'secretName': u'default-token-pvhrj'}, u'name': u'default-token-pvhrj'}], u'tolerations': [{u'operator': u'Exists', u'tolerationSeconds': 300, u'effect': u'NoExecute', u'key': u'node.kubernetes.io/not-ready'}, {u'operator': u'Exists', u'tolerationSeconds': 300, u'effect': u'NoExecute', u'key': u'node.kubernetes.io/unreachable'}], u'initContainers': [{u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-cassandra', u'image': u'busybox:1.28', u'volumeMounts': [{u'readOnly': True, u'mountPath': u'/var/run/secrets/kubernetes.io/serviceaccount', u'name': u'default-token-pvhrj'}], u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}], u'imagePullSecrets': [{}], u'containers': [{u'livenessProbe': {u'successThreshold': 1, u'tcpSocket': {u'port': 7253}, u'failureThreshold': 9, u'timeoutSeconds': 1, u'periodSeconds': 10}, u'terminationMessagePath': u'/dev/termination-log', u'name': u'chronos', u'envFrom': [{u'configMapRef': {u'name': u'env-vars'}}], u'image': u'ollivier/clearwater-chronos:latest', u'volumeMounts': [{u'mountPath': u'/var/log/chronos', u'name': u'chronoslogs'}, {u'readOnly': True, u'mountPath': u'/var/run/secrets/kubernetes.io/serviceaccount', u'name': u'default-token-pvhrj'}], u'terminationMessagePolicy': u'File', u'lifecycle': {u'preStop': {u'exec': {u'command': [u'/bin/bash', u'-c', u'/usr/bin/pre-stop']}}}, u'env': [{u'valueFrom': {u'fieldRef': {u'fieldPath': u'status.podIP', u'apiVersion': u'v1'}}, u'name': u'MY_POD_IP'}], u'imagePullPolicy': u'Always', u'readinessProbe': {u'successThreshold': 1, u'tcpSocket': {u'port': 7253}, u'failureThreshold': 3, u'timeoutSeconds': 1, u'periodSeconds': 10}, u'ports': [{u'protocol': u'TCP', u'containerPort': 22}, {u'protocol': u'TCP', u'containerPort': 7253}], u'resources': {}}, {u'terminationMessagePath': u'/dev/termination-log', u'name': u'tailer', u'image': u'busybox', u'volumeMounts': [{u'mountPath': u'/var/log/chronos', u'name': u'chronoslogs'}, {u'readOnly': True, u'mountPath': u'/var/run/secrets/kubernetes.io/serviceaccount', u'name': u'default-token-pvhrj'}], u'terminationMessagePolicy': u'File', u'command': [u'tail', u'-F', u'/var/log/chronos/chronos_current.txt'], u'imagePullPolicy': u'Always', u'resources': {}}], u'nodeName': u'hunter-worker'}, u'apiVersion': u'v1', u'metadata': {u'name': u'chronos-59fcbd7b47-lx2nr', u'labels': {u'pod-template-hash': u'59fcbd7b47', u'service': u'chronos'}, u'namespace': u'default', u'ownerReferences': [{u'kind': u'ReplicaSet', u'name': u'chronos-59fcbd7b47', u'apiVersion': u'apps/v1', u'controller': True, u'blockOwnerDeletion': True, u'uid': u'13bbf8da-cce3-11ea-b2c9-0242ac120008'}], u'resourceVersion': u'2370588', u'generateName': u'chronos-59fcbd7b47-', u'creationTimestamp': u'2020-07-23T12:50:24Z', u'selfLink': u'/api/v1/namespaces/default/pods/chronos-59fcbd7b47-lx2nr', u'uid': u'13c3e696-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'chronos-59fcbd7b47-', 'generation': None, 'initializers': None, 'labels': {u'pod-template-hash': '59fcbd7b47', u'service': 'chronos'}, 'managed_fields': None, 'name': 'chronos-59fcbd7b47-lx2nr', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'chronos-59fcbd7b47', 'uid': '13bbf8da-cce3-11ea-b2c9-0242ac120008'}], 'resource_version': '2370588', 'self_link': '/api/v1/namespaces/default/pods/chronos-59fcbd7b47-lx2nr', 'uid': '13c3e696-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-chronos:latest', 'image_pull_policy': 'Always', 'lifecycle': {'post_start': None, 'pre_stop': {'_exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}, 'http_get': None, 'tcp_socket': None}}, 'liveness_probe': {'_exec': None, 'failure_threshold': 9, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7253}, 'timeout_seconds': 1}, 'name': 'chronos', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7253, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7253}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/chronos', 'mount_propagation': None, 'name': 'chronoslogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-pvhrj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/chronos/chronos_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/chronos', 'mount_propagation': None, 'name': 'chronoslogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-pvhrj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-pvhrj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'hunter-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 120, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'chronoslogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}, {'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-pvhrj', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-pvhrj'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 52, 36, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 53, 2, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 53, 2, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 24, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://6274d03334897bb19d357d86962e89ab98fce86a1f954d2e006dc56256cb1f70', 'image': 'docker.io/ollivier/clearwater-chronos:latest', 'image_id': 'docker.io/ollivier/clearwater-chronos@sha256:83359fb6320eefc0adbf56fcd4eb7a19be2c53dadaa4944a20510cc761536222', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'chronos', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 23, 12, 52, 48, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}, {'container_id': 'containerd://67b1b4c476b6d9316b9eff6f48b2638772c0ee17c8385a24d4319c75850e50ba', 'image': 'docker.io/library/busybox:latest', 'image_id': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'tailer', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 23, 12, 52, 54, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.4', 'init_container_statuses': [{'container_id': 'containerd://f8d0dfa156b573ccef46c45f90bf1621d74706bdc5e01bf701fcc41875e32ccb', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-cassandra', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://f8d0dfa156b573ccef46c45f90bf1621d74706bdc5e01bf701fcc41875e32ccb', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 23, 12, 52, 35, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 23, 12, 50, 34, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.159', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal())}}, u'type': u'ADDED'} 2020-07-23 12:55:27,594 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'qosClass': u'BestEffort', u'containerStatuses': [{u'restartCount': 0, u'name': u'etcd', u'image': u'quay.io/coreos/etcd:v2.2.5', u'imageID': u'sha256:66590e2dd05422771324d8ffe9ad35165ba35db0842ac5e0f1668c2d56733860', u'state': {u'running': {u'startedAt': u'2020-07-23T12:50:33Z'}}, u'ready': True, u'lastState': {}, u'containerID': u'containerd://c8a79c47c78ab322c75eabbffd493489220eef6c43601e9edb107f4a648f3e29'}], u'podIP': u'10.244.1.84', u'startTime': u'2020-07-23T12:50:25Z', u'hostIP': u'172.18.0.2', u'phase': u'Running', u'conditions': [{u'status': u'True', u'lastProbeTime': None, u'type': u'Initialized', u'lastTransitionTime': u'2020-07-23T12:50:25Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'Ready', u'lastTransitionTime': u'2020-07-23T12:50:39Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'ContainersReady', u'lastTransitionTime': u'2020-07-23T12:50:39Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'PodScheduled', u'lastTransitionTime': u'2020-07-23T12:50:25Z'}]}, u'kind': u'Pod', u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'serviceAccountName': u'default', u'schedulerName': u'default-scheduler', u'enableServiceLinks': True, u'serviceAccount': u'default', u'priority': 0, u'terminationGracePeriodSeconds': 30, u'restartPolicy': u'Always', u'volumes': [{u'secret': {u'defaultMode': 420, u'secretName': u'default-token-pvhrj'}, u'name': u'default-token-pvhrj'}], u'tolerations': [{u'operator': u'Exists', u'tolerationSeconds': 300, u'effect': u'NoExecute', u'key': u'node.kubernetes.io/not-ready'}, {u'operator': u'Exists', u'tolerationSeconds': 300, u'effect': u'NoExecute', u'key': u'node.kubernetes.io/unreachable'}], u'imagePullSecrets': [{}], u'containers': [{u'livenessProbe': {u'tcpSocket': {u'port': 4001}, u'timeoutSeconds': 1, u'initialDelaySeconds': 300, u'periodSeconds': 10, u'successThreshold': 1, u'failureThreshold': 3}, u'terminationMessagePath': u'/dev/termination-log', u'name': u'etcd', u'image': u'quay.io/coreos/etcd:v2.2.5', u'args': [u'--name', u'$(MY_POD_NAME)', u'--advertise-client-urls', u'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', u'--listen-client-urls', u'http://0.0.0.0:2379,http://0.0.0.0:4001', u'--initial-advertise-peer-urls', u'http://$(MY_POD_IP):2380', u'--listen-peer-urls', u'http://0.0.0.0:2380', u'--initial-cluster', u'$(MY_POD_NAME)=http://$(MY_POD_IP):2380', u'--initial-cluster-state', u'new'], u'volumeMounts': [{u'readOnly': True, u'mountPath': u'/var/run/secrets/kubernetes.io/serviceaccount', u'name': u'default-token-pvhrj'}], u'terminationMessagePolicy': u'File', u'env': [{u'valueFrom': {u'fieldRef': {u'fieldPath': u'status.podIP', u'apiVersion': u'v1'}}, u'name': u'MY_POD_IP'}, {u'valueFrom': {u'fieldRef': {u'fieldPath': u'metadata.name', u'apiVersion': u'v1'}}, u'name': u'MY_POD_NAME'}], u'imagePullPolicy': u'IfNotPresent', u'readinessProbe': {u'successThreshold': 1, u'tcpSocket': {u'port': 4001}, u'failureThreshold': 3, u'timeoutSeconds': 1, u'periodSeconds': 10}, u'ports': [{u'protocol': u'TCP', u'containerPort': 2379}, {u'protocol': u'TCP', u'containerPort': 2380}, {u'protocol': u'TCP', u'containerPort': 4001}], u'resources': {}}], u'nodeName': u'hunter-worker2'}, u'apiVersion': u'v1', u'metadata': {u'name': u'etcd-c8fddbb95-66tdl', u'labels': {u'pod-template-hash': u'c8fddbb95', u'instance-type': u'etcd-pod'}, u'namespace': u'default', u'ownerReferences': [{u'kind': u'ReplicaSet', u'name': u'etcd-c8fddbb95', u'apiVersion': u'apps/v1', u'controller': True, u'blockOwnerDeletion': True, u'uid': u'13d2611c-cce3-11ea-b2c9-0242ac120008'}], u'resourceVersion': u'2370245', u'generateName': u'etcd-c8fddbb95-', u'creationTimestamp': u'2020-07-23T12:50:25Z', u'selfLink': u'/api/v1/namespaces/default/pods/etcd-c8fddbb95-66tdl', u'uid': u'13d6fef3-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'etcd-c8fddbb95-', 'generation': None, 'initializers': None, 'labels': {u'instance-type': 'etcd-pod', u'pod-template-hash': 'c8fddbb95'}, 'managed_fields': None, 'name': 'etcd-c8fddbb95-66tdl', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'etcd-c8fddbb95', 'uid': '13d2611c-cce3-11ea-b2c9-0242ac120008'}], 'resource_version': '2370245', 'self_link': '/api/v1/namespaces/default/pods/etcd-c8fddbb95-66tdl', 'uid': '13d6fef3-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': ['--name', '$(MY_POD_NAME)', '--advertise-client-urls', 'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', '--listen-client-urls', 'http://0.0.0.0:2379,http://0.0.0.0:4001', '--initial-advertise-peer-urls', 'http://$(MY_POD_IP):2380', '--listen-peer-urls', 'http://0.0.0.0:2380', '--initial-cluster', '$(MY_POD_NAME)=http://$(MY_POD_IP):2380', '--initial-cluster-state', 'new'], 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}, {'name': 'MY_POD_NAME', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'metadata.name'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': None, 'image': 'quay.io/coreos/etcd:v2.2.5', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 300, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 4001}, 'timeout_seconds': 1}, 'name': 'etcd', 'ports': [{'container_port': 2379, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 2380, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 4001, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 4001}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-pvhrj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': None, 'node_name': 'hunter-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-pvhrj', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-pvhrj'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 39, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 39, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://c8a79c47c78ab322c75eabbffd493489220eef6c43601e9edb107f4a648f3e29', 'image': 'quay.io/coreos/etcd:v2.2.5', 'image_id': 'sha256:66590e2dd05422771324d8ffe9ad35165ba35db0842ac5e0f1668c2d56733860', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'etcd', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 23, 12, 50, 33, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.2', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.84', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 23, 12, 50, 25, tzinfo=tzlocal())}}, u'type': u'ADDED'} 2020-07-23 12:55:27,642 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'initContainerStatuses': [{u'restartCount': 0, u'name': u'wait-on-ralf', u'image': u'docker.io/library/busybox:1.28', u'imageID': u'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', u'state': {u'terminated': {u'startedAt': u'2020-07-23T12:50:35Z', u'reason': u'Completed', u'finishedAt': u'2020-07-23T12:53:13Z', u'containerID': u'containerd://843667c00e9c7ab11a891c06f0cb4e48f8eb004fc19805476e788424745f3b77', u'exitCode': 0}}, u'ready': True, u'lastState': {}, u'containerID': u'containerd://843667c00e9c7ab11a891c06f0cb4e48f8eb004fc19805476e788424745f3b77'}, {u'restartCount': 0, u'name': u'wait-on-chronos', u'image': u'docker.io/library/busybox:1.28', u'imageID': u'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', u'state': {u'terminated': {u'startedAt': u'2020-07-23T12:53:15Z', u'reason': u'Completed', u'finishedAt': u'2020-07-23T12:53:15Z', u'containerID': u'containerd://04f40d023eb0ae0a08dffbec3a05afbe23b5bf6b6cfe87b5d64beca9860faeba', u'exitCode': 0}}, u'ready': True, u'lastState': {}, u'containerID': u'containerd://04f40d023eb0ae0a08dffbec3a05afbe23b5bf6b6cfe87b5d64beca9860faeba'}, {u'restartCount': 0, u'name': u'wait-on-homestead', u'image': u'docker.io/library/busybox:1.28', u'imageID': u'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', u'state': {u'terminated': {u'startedAt': u'2020-07-23T12:53:17Z', u'reason': u'Completed', u'finishedAt': u'2020-07-23T12:54:18Z', u'containerID': u'containerd://df7e5aad540234e440988b4b068e450c2b1e3d78998fa33b30873db15b5e8e0c', u'exitCode': 0}}, u'ready': True, u'lastState': {}, u'containerID': u'containerd://df7e5aad540234e440988b4b068e450c2b1e3d78998fa33b30873db15b5e8e0c'}], u'qosClass': u'BestEffort', u'containerStatuses': [{u'restartCount': 0, u'name': u'sprout', u'image': u'docker.io/ollivier/clearwater-sprout:latest', u'imageID': u'docker.io/ollivier/clearwater-sprout@sha256:5a833832419bcf25ea1044768038c885ed4bad73225d5d07fc54eebc2a56662b', u'state': {u'running': {u'startedAt': u'2020-07-23T12:54:32Z'}}, u'ready': True, u'lastState': {}, u'containerID': u'containerd://755ac2480627c2ab214ce2ce61a4368e7c7c14fb48889ad5804ec871c52ed92c'}, {u'restartCount': 0, u'name': u'tailer', u'image': u'docker.io/library/busybox:latest', u'imageID': u'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', u'state': {u'running': {u'startedAt': u'2020-07-23T12:54:36Z'}}, u'ready': True, u'lastState': {}, u'containerID': u'containerd://122f4d1d34885cb74cb0efd7fb7325a5f291bbb6acfa4b86c15a2faf777595c6'}], u'podIP': u'10.244.2.162', u'startTime': u'2020-07-23T12:50:26Z', u'hostIP': u'172.18.0.4', u'phase': u'Running', u'conditions': [{u'status': u'True', u'lastProbeTime': None, u'type': u'Initialized', u'lastTransitionTime': u'2020-07-23T12:54:23Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'Ready', u'lastTransitionTime': u'2020-07-23T12:54:43Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'ContainersReady', u'lastTransitionTime': u'2020-07-23T12:54:43Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'PodScheduled', u'lastTransitionTime': u'2020-07-23T12:50:26Z'}]}, u'kind': u'Pod', u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'serviceAccountName': u'default', u'schedulerName': u'default-scheduler', u'enableServiceLinks': True, u'serviceAccount': u'default', u'priority': 0, u'terminationGracePeriodSeconds': 30, u'restartPolicy': u'Always', u'volumes': [{u'emptyDir': {}, u'name': u'sproutlogs'}, {u'secret': {u'defaultMode': 420, u'secretName': u'default-token-pvhrj'}, u'name': u'default-token-pvhrj'}], u'tolerations': [{u'operator': u'Exists', u'tolerationSeconds': 300, u'effect': u'NoExecute', u'key': u'node.kubernetes.io/not-ready'}, {u'operator': u'Exists', u'tolerationSeconds': 300, u'effect': u'NoExecute', u'key': u'node.kubernetes.io/unreachable'}], u'initContainers': [{u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-ralf', u'image': u'busybox:1.28', u'volumeMounts': [{u'readOnly': True, u'mountPath': u'/var/run/secrets/kubernetes.io/serviceaccount', u'name': u'default-token-pvhrj'}], u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup ralf; do echo waiting for ralf to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}, {u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-chronos', u'image': u'busybox:1.28', u'volumeMounts': [{u'readOnly': True, u'mountPath': u'/var/run/secrets/kubernetes.io/serviceaccount', u'name': u'default-token-pvhrj'}], u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup chronos; do echo waiting for chronos to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}, {u'terminationMessagePath': u'/dev/termination-log', u'name': u'wait-on-homestead', u'image': u'busybox:1.28', u'volumeMounts': [{u'readOnly': True, u'mountPath': u'/var/run/secrets/kubernetes.io/serviceaccount', u'name': u'default-token-pvhrj'}], u'terminationMessagePolicy': u'File', u'command': [u'sh', u'-c', u'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], u'imagePullPolicy': u'IfNotPresent', u'resources': {}}], u'imagePullSecrets': [{}], u'containers': [{u'livenessProbe': {u'timeoutSeconds': 1, u'exec': {u'command': [u'/bin/bash', u'/usr/share/kubernetes/liveness.sh', u'5052 5054']}, u'initialDelaySeconds': 30, u'periodSeconds': 3, u'successThreshold': 1, u'failureThreshold': 3}, u'terminationMessagePath': u'/dev/termination-log', u'name': u'sprout', u'envFrom': [{u'configMapRef': {u'name': u'env-vars'}}], u'image': u'ollivier/clearwater-sprout:latest', u'volumeMounts': [{u'mountPath': u'/var/log/sprout', u'name': u'sproutlogs'}, {u'readOnly': True, u'mountPath': u'/var/run/secrets/kubernetes.io/serviceaccount', u'name': u'default-token-pvhrj'}], u'terminationMessagePolicy': u'File', u'env': [{u'valueFrom': {u'fieldRef': {u'fieldPath': u'status.podIP', u'apiVersion': u'v1'}}, u'name': u'MY_POD_IP'}], u'imagePullPolicy': u'Always', u'readinessProbe': {u'successThreshold': 1, u'periodSeconds': 10, u'failureThreshold': 3, u'timeoutSeconds': 1, u'exec': {u'command': [u'/bin/bash', u'/usr/share/kubernetes/liveness.sh', u'5052 5054']}}, u'ports': [{u'protocol': u'TCP', u'containerPort': 22}], u'resources': {}}, {u'terminationMessagePath': u'/dev/termination-log', u'name': u'tailer', u'image': u'busybox', u'volumeMounts': [{u'mountPath': u'/var/log/sprout', u'name': u'sproutlogs'}, {u'readOnly': True, u'mountPath': u'/var/run/secrets/kubernetes.io/serviceaccount', u'name': u'default-token-pvhrj'}], u'terminationMessagePolicy': u'File', u'command': [u'tail', u'-F', u'/var/log/sprout/sprout_current.txt'], u'imagePullPolicy': u'Always', u'resources': {}}], u'nodeName': u'hunter-worker'}, u'apiVersion': u'v1', u'metadata': {u'name': u'sprout-fb8745f94-cnns2', u'labels': {u'pod-template-hash': u'fb8745f94', u'snmp': u'enabled', u'service': u'sprout'}, u'namespace': u'default', u'ownerReferences': [{u'kind': u'ReplicaSet', u'name': u'sprout-fb8745f94', u'apiVersion': u'apps/v1', u'controller': True, u'blockOwnerDeletion': True, u'uid': u'143cb7bf-cce3-11ea-b2c9-0242ac120008'}], u'resourceVersion': u'2370826', u'generateName': u'sprout-fb8745f94-', u'creationTimestamp': u'2020-07-23T12:50:26Z', u'selfLink': u'/api/v1/namespaces/default/pods/sprout-fb8745f94-cnns2', u'uid': u'1473800b-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 50, 26, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'sprout-fb8745f94-', 'generation': None, 'initializers': None, 'labels': {u'pod-template-hash': 'fb8745f94', u'service': 'sprout', u'snmp': 'enabled'}, 'managed_fields': None, 'name': 'sprout-fb8745f94-cnns2', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'sprout-fb8745f94', 'uid': '143cb7bf-cce3-11ea-b2c9-0242ac120008'}], 'resource_version': '2370826', 'self_link': '/api/v1/namespaces/default/pods/sprout-fb8745f94-cnns2', 'uid': '1473800b-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-sprout:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 3, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'sprout', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-pvhrj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-pvhrj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup ralf; do echo waiting for ralf to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-ralf', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-pvhrj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until nslookup chronos; do echo waiting for chronos to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-chronos', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-pvhrj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-pvhrj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'hunter-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'sproutlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}, {'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-pvhrj', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-pvhrj'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 54, 23, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 54, 43, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 54, 43, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 50, 26, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://755ac2480627c2ab214ce2ce61a4368e7c7c14fb48889ad5804ec871c52ed92c', 'image': 'docker.io/ollivier/clearwater-sprout:latest', 'image_id': 'docker.io/ollivier/clearwater-sprout@sha256:5a833832419bcf25ea1044768038c885ed4bad73225d5d07fc54eebc2a56662b', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'sprout', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 23, 12, 54, 32, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}, {'container_id': 'containerd://122f4d1d34885cb74cb0efd7fb7325a5f291bbb6acfa4b86c15a2faf777595c6', 'image': 'docker.io/library/busybox:latest', 'image_id': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'tailer', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 23, 12, 54, 36, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.4', 'init_container_statuses': [{'container_id': 'containerd://843667c00e9c7ab11a891c06f0cb4e48f8eb004fc19805476e788424745f3b77', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-ralf', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://843667c00e9c7ab11a891c06f0cb4e48f8eb004fc19805476e788424745f3b77', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 23, 12, 53, 13, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 23, 12, 50, 35, tzinfo=tzlocal())}, 'waiting': None}}, {'container_id': 'containerd://04f40d023eb0ae0a08dffbec3a05afbe23b5bf6b6cfe87b5d64beca9860faeba', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-chronos', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://04f40d023eb0ae0a08dffbec3a05afbe23b5bf6b6cfe87b5d64beca9860faeba', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 23, 12, 53, 15, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 23, 12, 53, 15, tzinfo=tzlocal())}, 'waiting': None}}, {'container_id': 'containerd://df7e5aad540234e440988b4b068e450c2b1e3d78998fa33b30873db15b5e8e0c', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-homestead', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://df7e5aad540234e440988b4b068e450c2b1e3d78998fa33b30873db15b5e8e0c', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 23, 12, 54, 18, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 23, 12, 53, 17, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.162', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 23, 12, 50, 26, tzinfo=tzlocal())}}, u'type': u'ADDED'} 2020-07-23 12:55:27,727 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'phase': u'Pending', u'conditions': [{u'status': u'True', u'lastProbeTime': None, u'type': u'PodScheduled', u'lastTransitionTime': u'2020-07-23T12:55:26Z'}], u'qosClass': u'BestEffort'}, u'kind': u'Pod', u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'serviceAccountName': u'default', u'schedulerName': u'default-scheduler', u'enableServiceLinks': True, u'serviceAccount': u'default', u'priority': 0, u'terminationGracePeriodSeconds': 30, u'restartPolicy': u'Never', u'volumes': [{u'secret': {u'defaultMode': 420, u'secretName': u'default-token-pvhrj'}, u'name': u'default-token-pvhrj'}], u'tolerations': [{u'operator': u'Exists', u'tolerationSeconds': 300, u'effect': u'NoExecute', u'key': u'node.kubernetes.io/not-ready'}, {u'operator': u'Exists', u'tolerationSeconds': 300, u'effect': u'NoExecute', u'key': u'node.kubernetes.io/unreachable'}], u'containers': [{u'terminationMessagePath': u'/dev/termination-log', u'name': u'live-test', u'image': u'ollivier/clearwater-live-test:latest', u'volumeMounts': [{u'readOnly': True, u'mountPath': u'/var/run/secrets/kubernetes.io/serviceaccount', u'name': u'default-token-pvhrj'}], u'terminationMessagePolicy': u'File', u'imagePullPolicy': u'Always', u'resources': {}}], u'nodeName': u'hunter-worker'}, u'apiVersion': u'v1', u'metadata': {u'name': u'live-test', u'namespace': u'default', u'resourceVersion': u'2370938', u'creationTimestamp': u'2020-07-23T12:55:26Z', u'selfLink': u'/api/v1/namespaces/default/pods/live-test', u'uid': u'c7c44ba1-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 55, 26, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'live-test', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370938', 'self_link': '/api/v1/namespaces/default/pods/live-test', 'uid': 'c7c44ba1-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-pvhrj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'hunter-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Never', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-pvhrj', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-pvhrj'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 55, 26, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': None, 'host_ip': None, 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Pending', 'pod_ip': None, 'qos_class': 'BestEffort', 'reason': None, 'start_time': None}}, u'type': u'MODIFIED'} 2020-07-23 12:55:27,748 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'qosClass': u'BestEffort', u'containerStatuses': [{u'restartCount': 0, u'name': u'live-test', u'image': u'ollivier/clearwater-live-test:latest', u'imageID': u'', u'state': {u'waiting': {u'reason': u'ContainerCreating'}}, u'ready': False, u'lastState': {}}], u'startTime': u'2020-07-23T12:55:27Z', u'hostIP': u'172.18.0.4', u'phase': u'Pending', u'conditions': [{u'status': u'True', u'lastProbeTime': None, u'type': u'Initialized', u'lastTransitionTime': u'2020-07-23T12:55:27Z'}, {u'status': u'False', u'lastTransitionTime': u'2020-07-23T12:55:27Z', u'reason': u'ContainersNotReady', u'lastProbeTime': None, u'message': u'containers with unready status: [live-test]', u'type': u'Ready'}, {u'status': u'False', u'lastTransitionTime': u'2020-07-23T12:55:27Z', u'reason': u'ContainersNotReady', u'lastProbeTime': None, u'message': u'containers with unready status: [live-test]', u'type': u'ContainersReady'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'PodScheduled', u'lastTransitionTime': u'2020-07-23T12:55:26Z'}]}, u'kind': u'Pod', u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'serviceAccountName': u'default', u'schedulerName': u'default-scheduler', u'enableServiceLinks': True, u'serviceAccount': u'default', u'priority': 0, u'terminationGracePeriodSeconds': 30, u'restartPolicy': u'Never', u'volumes': [{u'secret': {u'defaultMode': 420, u'secretName': u'default-token-pvhrj'}, u'name': u'default-token-pvhrj'}], u'tolerations': [{u'operator': u'Exists', u'tolerationSeconds': 300, u'effect': u'NoExecute', u'key': u'node.kubernetes.io/not-ready'}, {u'operator': u'Exists', u'tolerationSeconds': 300, u'effect': u'NoExecute', u'key': u'node.kubernetes.io/unreachable'}], u'containers': [{u'terminationMessagePath': u'/dev/termination-log', u'name': u'live-test', u'image': u'ollivier/clearwater-live-test:latest', u'volumeMounts': [{u'readOnly': True, u'mountPath': u'/var/run/secrets/kubernetes.io/serviceaccount', u'name': u'default-token-pvhrj'}], u'terminationMessagePolicy': u'File', u'imagePullPolicy': u'Always', u'resources': {}}], u'nodeName': u'hunter-worker'}, u'apiVersion': u'v1', u'metadata': {u'name': u'live-test', u'namespace': u'default', u'resourceVersion': u'2370941', u'creationTimestamp': u'2020-07-23T12:55:26Z', u'selfLink': u'/api/v1/namespaces/default/pods/live-test', u'uid': u'c7c44ba1-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 55, 26, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'live-test', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370941', 'self_link': '/api/v1/namespaces/default/pods/live-test', 'uid': 'c7c44ba1-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-pvhrj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'hunter-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Never', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-pvhrj', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-pvhrj'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 55, 27, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 55, 27, tzinfo=tzlocal()), 'message': 'containers with unready status: [live-test]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 55, 27, tzinfo=tzlocal()), 'message': 'containers with unready status: [live-test]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 55, 26, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_id': '', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'live-test', 'ready': False, 'restart_count': 0, 'state': {'running': None, 'terminated': None, 'waiting': {'message': None, 'reason': 'ContainerCreating'}}}], 'host_ip': '172.18.0.4', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Pending', 'pod_ip': None, 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 23, 12, 55, 27, tzinfo=tzlocal())}}, u'type': u'MODIFIED'} 2020-07-23 12:55:31,074 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'qosClass': u'BestEffort', u'containerStatuses': [{u'restartCount': 0, u'name': u'live-test', u'image': u'docker.io/ollivier/clearwater-live-test:latest', u'imageID': u'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', u'state': {u'running': {u'startedAt': u'2020-07-23T12:55:30Z'}}, u'ready': True, u'lastState': {}, u'containerID': u'containerd://e48c3adb06f16ffbb40e3ce9660cd7f5a05135870ff085ec2c02c027bd37530c'}], u'podIP': u'10.244.2.163', u'startTime': u'2020-07-23T12:55:27Z', u'hostIP': u'172.18.0.4', u'phase': u'Running', u'conditions': [{u'status': u'True', u'lastProbeTime': None, u'type': u'Initialized', u'lastTransitionTime': u'2020-07-23T12:55:27Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'Ready', u'lastTransitionTime': u'2020-07-23T12:55:31Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'ContainersReady', u'lastTransitionTime': u'2020-07-23T12:55:31Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'PodScheduled', u'lastTransitionTime': u'2020-07-23T12:55:26Z'}]}, u'kind': u'Pod', u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'serviceAccountName': u'default', u'schedulerName': u'default-scheduler', u'enableServiceLinks': True, u'serviceAccount': u'default', u'priority': 0, u'terminationGracePeriodSeconds': 30, u'restartPolicy': u'Never', u'volumes': [{u'secret': {u'defaultMode': 420, u'secretName': u'default-token-pvhrj'}, u'name': u'default-token-pvhrj'}], u'tolerations': [{u'operator': u'Exists', u'tolerationSeconds': 300, u'effect': u'NoExecute', u'key': u'node.kubernetes.io/not-ready'}, {u'operator': u'Exists', u'tolerationSeconds': 300, u'effect': u'NoExecute', u'key': u'node.kubernetes.io/unreachable'}], u'containers': [{u'terminationMessagePath': u'/dev/termination-log', u'name': u'live-test', u'image': u'ollivier/clearwater-live-test:latest', u'volumeMounts': [{u'readOnly': True, u'mountPath': u'/var/run/secrets/kubernetes.io/serviceaccount', u'name': u'default-token-pvhrj'}], u'terminationMessagePolicy': u'File', u'imagePullPolicy': u'Always', u'resources': {}}], u'nodeName': u'hunter-worker'}, u'apiVersion': u'v1', u'metadata': {u'name': u'live-test', u'namespace': u'default', u'resourceVersion': u'2370953', u'creationTimestamp': u'2020-07-23T12:55:26Z', u'selfLink': u'/api/v1/namespaces/default/pods/live-test', u'uid': u'c7c44ba1-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 55, 26, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'live-test', 'namespace': 'default', 'owner_references': None, 'resource_version': '2370953', 'self_link': '/api/v1/namespaces/default/pods/live-test', 'uid': 'c7c44ba1-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-pvhrj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'hunter-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Never', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-pvhrj', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-pvhrj'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 55, 27, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 55, 31, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 55, 31, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 55, 26, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://e48c3adb06f16ffbb40e3ce9660cd7f5a05135870ff085ec2c02c027bd37530c', 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'image_id': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'live-test', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 23, 12, 55, 30, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.4', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.163', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 23, 12, 55, 27, tzinfo=tzlocal())}}, u'type': u'MODIFIED'} 2020-07-23 12:58:08,435 - functest_kubernetes.ims.ims - DEBUG - {'raw_object': {u'status': {u'qosClass': u'BestEffort', u'containerStatuses': [{u'restartCount': 0, u'name': u'live-test', u'image': u'docker.io/ollivier/clearwater-live-test:latest', u'imageID': u'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', u'state': {u'terminated': {u'startedAt': u'2020-07-23T12:55:30Z', u'reason': u'Completed', u'finishedAt': u'2020-07-23T12:58:07Z', u'containerID': u'containerd://e48c3adb06f16ffbb40e3ce9660cd7f5a05135870ff085ec2c02c027bd37530c', u'exitCode': 0}}, u'ready': False, u'lastState': {}, u'containerID': u'containerd://e48c3adb06f16ffbb40e3ce9660cd7f5a05135870ff085ec2c02c027bd37530c'}], u'podIP': u'10.244.2.163', u'startTime': u'2020-07-23T12:55:27Z', u'hostIP': u'172.18.0.4', u'phase': u'Succeeded', u'conditions': [{u'status': u'True', u'lastProbeTime': None, u'reason': u'PodCompleted', u'type': u'Initialized', u'lastTransitionTime': u'2020-07-23T12:55:27Z'}, {u'status': u'False', u'lastProbeTime': None, u'reason': u'PodCompleted', u'type': u'Ready', u'lastTransitionTime': u'2020-07-23T12:58:08Z'}, {u'status': u'False', u'lastProbeTime': None, u'reason': u'PodCompleted', u'type': u'ContainersReady', u'lastTransitionTime': u'2020-07-23T12:58:08Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'PodScheduled', u'lastTransitionTime': u'2020-07-23T12:55:26Z'}]}, u'kind': u'Pod', u'spec': {u'dnsPolicy': u'ClusterFirst', u'securityContext': {}, u'serviceAccountName': u'default', u'schedulerName': u'default-scheduler', u'enableServiceLinks': True, u'serviceAccount': u'default', u'priority': 0, u'terminationGracePeriodSeconds': 30, u'restartPolicy': u'Never', u'volumes': [{u'secret': {u'defaultMode': 420, u'secretName': u'default-token-pvhrj'}, u'name': u'default-token-pvhrj'}], u'tolerations': [{u'operator': u'Exists', u'tolerationSeconds': 300, u'effect': u'NoExecute', u'key': u'node.kubernetes.io/not-ready'}, {u'operator': u'Exists', u'tolerationSeconds': 300, u'effect': u'NoExecute', u'key': u'node.kubernetes.io/unreachable'}], u'containers': [{u'terminationMessagePath': u'/dev/termination-log', u'name': u'live-test', u'image': u'ollivier/clearwater-live-test:latest', u'volumeMounts': [{u'readOnly': True, u'mountPath': u'/var/run/secrets/kubernetes.io/serviceaccount', u'name': u'default-token-pvhrj'}], u'terminationMessagePolicy': u'File', u'imagePullPolicy': u'Always', u'resources': {}}], u'nodeName': u'hunter-worker'}, u'apiVersion': u'v1', u'metadata': {u'name': u'live-test', u'namespace': u'default', u'resourceVersion': u'2371252', u'creationTimestamp': u'2020-07-23T12:55:26Z', u'selfLink': u'/api/v1/namespaces/default/pods/live-test', u'uid': u'c7c44ba1-cce3-11ea-b2c9-0242ac120008'}}, u'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 23, 12, 55, 26, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'live-test', 'namespace': 'default', 'owner_references': None, 'resource_version': '2371252', 'self_link': '/api/v1/namespaces/default/pods/live-test', 'uid': 'c7c44ba1-cce3-11ea-b2c9-0242ac120008'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-pvhrj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'hunter-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Never', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-pvhrj', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-pvhrj'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 55, 27, tzinfo=tzlocal()), 'message': None, 'reason': 'PodCompleted', 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 58, 8, tzinfo=tzlocal()), 'message': None, 'reason': 'PodCompleted', 'status': 'False', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 58, 8, tzinfo=tzlocal()), 'message': None, 'reason': 'PodCompleted', 'status': 'False', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 23, 12, 55, 26, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://e48c3adb06f16ffbb40e3ce9660cd7f5a05135870ff085ec2c02c027bd37530c', 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'image_id': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'live-test', 'ready': False, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://e48c3adb06f16ffbb40e3ce9660cd7f5a05135870ff085ec2c02c027bd37530c', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 23, 12, 58, 7, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 23, 12, 55, 30, tzinfo=tzlocal())}, 'waiting': None}}], 'host_ip': '172.18.0.4', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Succeeded', 'pod_ip': '10.244.2.163', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 23, 12, 55, 27, tzinfo=tzlocal())}}, u'type': u'MODIFIED'} 2020-07-23 12:58:08,608 - functest_kubernetes.ims.ims - INFO - ** Invoke test (first_time) ** Execute test /usr/lib/ruby/gems/2.6.0/gems/httpi-2.4.0/lib/httpi/auth/ssl.rb:13: warning: constant OpenSSL::SSL::SSLContext::METHODS is deprecated # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' Basic Call - Mainline (TCP) - (6505550877, 6505550422) Passed Basic Call - SDP (TCP) - (6505550515, 6505550866) Passed Basic Call - Tel URIs (TCP) - (6505550670, 6505550565) Passed Basic Call - Unknown number (TCP) - (6505550156, 6505550178) Passed Basic Call - Rejected by remote endpoint (TCP) - (6505550975, 6505550877) Passed Basic Call - Messages - Pager model (TCP) - (6505550473, 6505550344) Passed Basic Call - Pracks (TCP) - (6505550238, 6505550575) Passed Basic Registration (TCP) - (6505550757) Passed Emergency Registration (TCP) - Skipped (Not running with emergency registrations) - Call with EMERGENCY_REG=Y to run test Multiple Identities (TCP) - (6505550184, 6505550869) Passed Call Barring - Outbound Rejection (TCP) - (6505550234, 6505550496) Passed Call Barring - Allow non-international call (TCP) - Skipped (No PSTN support) - Call with PSTN=true to run test Call Barring - Reject international call (TCP) - Skipped (No PSTN support) - Call with PSTN=true to run test Call Barring - Inbound Rejection (TCP) - (6505550736, 6505550103) Passed Call Diversion AS - Unconditional (TCP) - Skipped (No Call Diversion AS hostname provided) - Call with CDIV_AS= Call Diversion AS - Busy (TCP) - Skipped (No Call Diversion AS hostname provided) - Call with CDIV_AS= Call Diversion AS - No answer (TCP) - Skipped (No Call Diversion AS hostname provided) - Call with CDIV_AS= Call Diversion - Not registered (TCP) - (6505550822, 6505550565, 6505550802) Passed Call Diversion - Not reachable (not registered) (TCP) - (6505550998, 6505550905, 6505550884) Passed Call Diversion - Not reachable (408) (TCP) - (6505550756, 6505550085, 6505550574) Passed Call Diversion - Not reachable (503) (TCP) - (6505550552, 6505550943, 6505550499) Passed Call Diversion - Not reachable (500) (TCP) - (6505550191, 6505550272, 6505550175) Passed Call Diversion - Busy (TCP) - (6505550889, 6505550049, 6505550204) Passed Call Diversion - Unconditional (TCP) - (6505550369, 6505550837, 6505550416) Passed Call Diversion - No answer (TCP) - (6505550473, 6505550597, 6505550854) Passed Call Diversion - Bad target URI (TCP) - (6505550068, 6505550163) Passed Call Diversion - Audio-only call (TCP) - (6505550345, 6505550799, 6505550924, 6505550327) Passed Call Diversion - Audio-video call (TCP) - (6505550025, 6505550172, 6505550876, 6505550104) Passed Call Forking - Mainline (TCP) - (6505550385, 6505550384) Passed Call Forking - Endpoint offline (TCP) - (6505550053, 6505550965) Passed Call Forking - Endpoint offline while ringing (TCP) - (6505550888, 6505550149) Passed Call Waiting - Accepted (TCP) - (6505550300, 6505550180, 6505550689) Passed Call Waiting - Cancelled (TCP) - (6505550559, 6505550653, 6505550870) Passed CANCEL - Mainline (TCP) - (6505550260, 6505550010) Passed Filtering - Accept-Contact (TCP) - (6505550650, 6505550542) Passed Accept-Contact with response (SFR 511195) (TCP) - (6505550523, 6505550236) Passed Filtering - Accept-Contact no match (TCP) - (6505550343, 6505550857) Passed Filtering - Accept-Contact negated match (TCP) - (6505550161, 6505550810) Passed Filtering - RFC3841 example (TCP) - (6505550896, 6505550658) Passed Filtering - Reject-Contact no match (TCP) - (6505550443, 6505550869) Passed Filtering - Reject-Contact match (TCP) - (6505550188, 6505550430) Passed Gemini - INVITE - VoIP device answers (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Mobile device answers (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - VoIP device rejects (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Mobile device rejects (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Mobile device rejects with a 480 (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Both reject, choose mobile response (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Both reject, choose VoIP response (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Successful call with GR (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Failed call with GR (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Successful call with Accept-Contact (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Failed call with Accept-Contact (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - SUBSCRIBE - Mobile Notifies (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - SUBSCRIBE - Joint 408 (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= GRUU - REGISTER - two bindings with and without GRUU (TCP) - (6505550894) Passed GRUU - REGISTER - binding suggested GRUU (TCP) - (6505550374) Passed GRUU - REGISTER - instance ID requires escaping (TCP) - (6505550185) Passed GRUU - REGISTER - three bindings with GRUUs (TCP) - (6505550085) Passed GRUU - Call - first endpoint GRUU as target (TCP) - (6505550326, 6505550331) Passed GRUU - Call - second endpoint GRUU as target (TCP) - (6505550058, 6505550868) Passed GRUU - Call - only GRUU as target (TCP) - (6505550765, 6505550864) Passed GRUU - Call - AoR as target (TCP) - (6505550444, 6505550937) Passed GRUU - Call - unknown GRUU as target (TCP) - (6505550641, 6505550443) Passed GRUU - Call - unknown GRUU as target - no GRUUs assigned (TCP) - (6505550608, 6505550693) Passed GRUU - Call - Reject-Contact interop (TCP) - (6505550807, 6505550527) Passed GRUU - Call - Accept-Contact interop (TCP) - (6505550605, 6505550021) Passed GRUU - Call - AoR with other param as target (TCP) - (6505550320, 6505550869) Passed GRUU - Call - GRUU with other param as target (TCP) - (6505550653, 6505550972) Passed ISC Interface - Terminating (TCP) - Skipped (No hostname given) - Call with HOST_NAME= ISC Interface - Terminating (UDP AS) (TCP) - Skipped (No hostname given) - Call with HOST_NAME= ISC Interface - Terminating Failed (TCP) - Skipped (No hostname given) - Call with HOST_NAME= ISC Interface - Third-party Registration (TCP) - Skipped (No hostname given) - Call with HOST_NAME= ISC Interface - Third-party Registration - implicit registration (TCP) - Skipped (No hostname given) - Call with HOST_NAME= ISC Interface - Redirect (TCP) - Skipped (No hostname given) - Call with HOST_NAME= ISC Interface - B2BUA (TCP) - Skipped (No hostname given) - Call with HOST_NAME= Live Call - Dial out to a real number (TCP) - Skipped (No live number given) - Call with LIVENUMBER= Memento - Incorrect Password (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Wrong Call List (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Basic Call (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Unknown Number (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Rejected Call (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Cancelled Call (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Privacy Call (TCP) - Skipped (No memento hostnames provided) /usr/lib/ruby/gems/2.6.0/gems/nokogiri-1.6.6.2/lib/nokogiri/xml/document.rb:44: warning: constant ::Fixnum is deprecated # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Barred Call (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Busy Call Forwarding (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Nonce-Count - Mainline (TCP) - Skipped (No nonce-count support) - Call with NONCE_COUNT=Y to run test Nonce-Count - Reject Re-Use (TCP) - Skipped (No nonce-count support) - Call with NONCE_COUNT=Y to run test Off-net calls - tel: URI (TCP) - Skipped (No off-net number given) - Call with OFF_NET_TEL= Off-net calls - sip: URI (TCP) - Skipped (No off-net number given) - Call with OFF_NET_TEL= SUBSCRIBE - reg-event (TCP) - (6505550207) Passed SUBSCRIBE - reg-event with a GRUU (TCP) - (6505550825) Passed SUBSCRIBE - Subscription timeout (TCP) - (6505550812) Passed SUBSCRIBE - Registration timeout (TCP) - Skipped (Not running with short registrations) - Call with SHORT_REG=Y to run test Multiple SUBSCRIBErs to one UE's reg-event (TCP) - (6505550470, 6505550526) Passed Message - URN URIs (TCP) - Skipped (No hostname given) - Call with HOST_NAME= Message - URN URIs to AS (TCP) - Skipped (No hostname given) - Call with HOST_NAME= 0 failures out of 96 tests run 43 tests skipped 2020-07-23 12:58:08,611 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | k8s_vims | functest | 07:44 | PASS | +-------------------+------------------+------------------+----------------+ 2020-07-23 12:58:08,623 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_config_map: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'configmaps', 'name': 'env-vars', 'retry_after_seconds': None, 'uid': '139a2ee0-cce3-11ea-b2c9-0242ac120008'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-23 12:58:08,842 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_pod: {'api_version': 'v1', 'code': None, 'details': None, 'kind': 'Pod', 'message': None, 'metadata': {'_continue': None, 'resource_version': '2371254', 'self_link': '/api/v1/namespaces/default/pods/live-test'}, 'reason': None, 'status': "{u'qosClass': u'BestEffort', u'containerStatuses': [{u'restartCount': 0, u'name': u'live-test', u'image': u'docker.io/ollivier/clearwater-live-test:latest', u'imageID': u'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', u'state': {u'terminated': {u'startedAt': u'2020-07-23T12:55:30Z', u'reason': u'Completed', u'finishedAt': u'2020-07-23T12:58:07Z', u'containerID': u'containerd://e48c3adb06f16ffbb40e3ce9660cd7f5a05135870ff085ec2c02c027bd37530c', u'exitCode': 0}}, u'ready': False, u'lastState': {}, u'containerID': u'containerd://e48c3adb06f16ffbb40e3ce9660cd7f5a05135870ff085ec2c02c027bd37530c'}], u'podIP': u'10.244.2.163', u'startTime': u'2020-07-23T12:55:27Z', u'hostIP': u'172.18.0.4', u'phase': u'Succeeded', u'conditions': [{u'status': u'True', u'lastProbeTime': None, u'reason': u'PodCompleted', u'type': u'Initialized', u'lastTransitionTime': u'2020-07-23T12:55:27Z'}, {u'status': u'False', u'lastProbeTime': None, u'reason': u'PodCompleted', u'type': u'Ready', u'lastTransitionTime': u'2020-07-23T12:58:08Z'}, {u'status': u'False', u'lastProbeTime': None, u'reason': u'PodCompleted', u'type': u'ContainersReady', u'lastTransitionTime': u'2020-07-23T12:58:08Z'}, {u'status': u'True', u'lastProbeTime': None, u'type': u'PodScheduled', u'lastTransitionTime': u'2020-07-23T12:55:26Z'}]}"} 2020-07-23 12:58:08,980 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'astaire', 'retry_after_seconds': None, 'uid': '13a0e4fe-cce3-11ea-b2c9-0242ac120008'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-23 12:58:09,035 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'astaire', 'retry_after_seconds': None, 'uid': '13f58fc0-cce3-11ea-b2c9-0242ac120008'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-23 12:58:09,136 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'bono', 'retry_after_seconds': None, 'uid': '13aa120b-cce3-11ea-b2c9-0242ac120008'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-23 12:58:09,289 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'bono', 'retry_after_seconds': None, 'uid': '14002ee5-cce3-11ea-b2c9-0242ac120008'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-23 12:58:09,436 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'cassandra', 'retry_after_seconds': None, 'uid': '13b0e0f0-cce3-11ea-b2c9-0242ac120008'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-23 12:58:09,505 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'cassandra', 'retry_after_seconds': None, 'uid': '1405ec5e-cce3-11ea-b2c9-0242ac120008'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-23 12:58:09,566 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'chronos', 'retry_after_seconds': None, 'uid': '13b7acd6-cce3-11ea-b2c9-0242ac120008'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-23 12:58:09,644 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'chronos', 'retry_after_seconds': None, 'uid': '141f82db-cce3-11ea-b2c9-0242ac120008'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-23 12:58:09,712 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'ellis', 'retry_after_seconds': None, 'uid': '13c0761c-cce3-11ea-b2c9-0242ac120008'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-23 12:58:09,751 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'ellis', 'retry_after_seconds': None, 'uid': '147561cc-cce3-11ea-b2c9-0242ac120008'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-23 12:58:09,786 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'etcd', 'retry_after_seconds': None, 'uid': '13ca41c4-cce3-11ea-b2c9-0242ac120008'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-23 12:58:09,865 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'etcd', 'retry_after_seconds': None, 'uid': '1480fbea-cce3-11ea-b2c9-0242ac120008'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-23 12:58:09,901 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'homer', 'retry_after_seconds': None, 'uid': '13d524a5-cce3-11ea-b2c9-0242ac120008'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-23 12:58:09,930 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'homer', 'retry_after_seconds': None, 'uid': '1491d082-cce3-11ea-b2c9-0242ac120008'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-23 12:58:10,016 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'homestead', 'retry_after_seconds': None, 'uid': '13dc3f56-cce3-11ea-b2c9-0242ac120008'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-23 12:58:10,231 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'homestead', 'retry_after_seconds': None, 'uid': '149d3706-cce3-11ea-b2c9-0242ac120008'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-23 12:58:10,500 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'homestead-prov', 'retry_after_seconds': None, 'uid': '13e44c0c-cce3-11ea-b2c9-0242ac120008'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-23 12:58:10,694 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'homestead-prov', 'retry_after_seconds': None, 'uid': '14b1835c-cce3-11ea-b2c9-0242ac120008'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-23 12:58:11,170 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'ralf', 'retry_after_seconds': None, 'uid': '13eb1524-cce3-11ea-b2c9-0242ac120008'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-23 12:58:11,961 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'ralf', 'retry_after_seconds': None, 'uid': '14baecc5-cce3-11ea-b2c9-0242ac120008'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-23 12:58:12,049 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'sprout', 'retry_after_seconds': None, 'uid': '13f2cd09-cce3-11ea-b2c9-0242ac120008'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-23 12:58:13,562 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'sprout', 'retry_after_seconds': None, 'uid': '14bdf2ed-cce3-11ea-b2c9-0242ac120008'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-23 12:58:13,879 - xtesting.core.testcase - DEBUG - Publishing /var/lib/xtesting/results/functest-kubernetes.log ('text/plain', None)