2020-07-16 14:32:34,712 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | k8-nosdn-nofeature-noha | | INSTALLER_TYPE | unknown | | BUILD_TAG | 2XW2SRPAMUUD | | NODE_NAME | lf-virtual1-2 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/functest-kubernetes/2XW2SRPAMUUD/functest-kubernetes-opnfv-functest-kubernetes-cnf-iruya-k8s_vims-run-20 | | HTTP_DST_URL | http://artifacts.opnfv.org/functest-kubernetes/2XW2SRPAMUUD/functest-kubernetes-opnfv-functest-kubernetes-cnf-iruya-k8s_vims-run-20 | +-------------------------+---------------------------------------------------------------------------------------------------------------------------------------------+ 2020-07-16 14:32:34,716 - xtesting.ci.run_tests - DEBUG - No env file /var/lib/xtesting/conf/env_file found 2020-07-16 14:32:34,717 - xtesting.ci.run_tests - DEBUG - Test args: k8s_vims 2020-07-16 14:32:34,721 - xtesting.ci.run_tests - INFO - Loading test case 'k8s_vims'... 2020-07-16 14:32:34,989 - xtesting.ci.run_tests - INFO - Running test case 'k8s_vims'... 2020-07-16 14:32:35,037 - kubernetes.client.rest - DEBUG - response body: {"kind":"ConfigMap","apiVersion":"v1","metadata":{"name":"env-vars","namespace":"default","selfLink":"/api/v1/namespaces/default/configmaps/env-vars","uid":"dc34d644-c397-488f-a732-ec2f9e3fa065","resourceVersion":"1241254","creationTimestamp":"2020-07-16T14:32:35Z"},"data":{"ADDITIONAL_SHARED_CONFIG":"","ZONE":"default.svc.cluster.local"}} 2020-07-16 14:32:35,039 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_config_map: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241254', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'dc34d644-c397-488f-a732-ec2f9e3fa065'}} 2020-07-16 14:32:35,077 - kubernetes.client.rest - DEBUG - response body: {"kind":"Deployment","apiVersion":"apps/v1","metadata":{"name":"astaire","namespace":"default","selfLink":"/apis/apps/v1/namespaces/default/deployments/astaire","uid":"a719a6f5-a461-4be5-8214-898af088df3f","resourceVersion":"1241255","generation":1,"creationTimestamp":"2020-07-16T14:32:35Z"},"spec":{"replicas":1,"selector":{"matchLabels":{"service":"astaire"}},"template":{"metadata":{"creationTimestamp":null,"labels":{"service":"astaire"}},"spec":{"volumes":[{"name":"astairelogs","emptyDir":{}}],"initContainers":[{"name":"wait-on-cassandra","image":"busybox:1.28","command":["sh","-c","until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"containers":[{"name":"astaire","image":"ollivier/clearwater-astaire:latest","ports":[{"containerPort":22,"protocol":"TCP"},{"containerPort":11211,"protocol":"TCP"},{"containerPort":11311,"protocol":"TCP"}],"envFrom":[{"configMapRef":{"name":"env-vars"}}],"env":[{"name":"MY_POD_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}}],"resources":{},"volumeMounts":[{"name":"astairelogs","mountPath":"/var/log/astaire"}],"livenessProbe":{"tcpSocket":{"port":11311},"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":9},"readinessProbe":{"tcpSocket":{"port":11311},"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"lifecycle":{"preStop":{"exec":{"command":["/bin/bash","-c","/usr/bin/pre-stop"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"},{"name":"tailer","image":"busybox","command":["tail","-F","/var/log/astaire/astaire_current.txt"],"resources":{},"volumeMounts":[{"name":"astairelogs","mountPath":"/var/log/astaire"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"restartPolicy":"Always","terminationGracePeriodSeconds":120,"dnsPolicy":"ClusterFirst","securityContext":{},"imagePullSecrets":[{}],"schedulerName":"default-scheduler"}},"strategy":{"type":"RollingUpdate","rollingUpdate":{"maxUnavailable":"25%","maxSurge":"25%"}},"revisionHistoryLimit":10,"progressDeadlineSeconds":600},"status":{}} 2020-07-16 14:32:35,079 - functest_kubernetes.ims.ims - INFO - Deployment astaire created 2020-07-16 14:32:35,079 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241254', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'dc34d644-c397-488f-a732-ec2f9e3fa065'}} 2020-07-16 14:32:35,118 - kubernetes.client.rest - DEBUG - response body: {"kind":"Deployment","apiVersion":"apps/v1","metadata":{"name":"bono","namespace":"default","selfLink":"/apis/apps/v1/namespaces/default/deployments/bono","uid":"d1d5a413-946b-49c3-a5b6-1f554725ba3a","resourceVersion":"1241260","generation":1,"creationTimestamp":"2020-07-16T14:32:35Z"},"spec":{"replicas":1,"selector":{"matchLabels":{"service":"bono"}},"template":{"metadata":{"creationTimestamp":null,"labels":{"service":"bono","snmp":"enabled"}},"spec":{"volumes":[{"name":"bonologs","emptyDir":{}}],"initContainers":[{"name":"wait-on-sprout","image":"busybox:1.28","command":["sh","-c","until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"containers":[{"name":"bono","image":"ollivier/clearwater-bono:latest","ports":[{"containerPort":22,"protocol":"TCP"},{"containerPort":3478,"protocol":"TCP"},{"containerPort":5060,"protocol":"TCP"},{"containerPort":5062,"protocol":"TCP"},{"containerPort":5060,"protocol":"UDP"},{"containerPort":5062,"protocol":"UDP"}],"envFrom":[{"configMapRef":{"name":"env-vars"}}],"env":[{"name":"MY_POD_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}}],"resources":{},"volumeMounts":[{"name":"bonologs","mountPath":"/var/log/bono"}],"livenessProbe":{"exec":{"command":["/bin/bash","/usr/share/kubernetes/liveness.sh","3478 5060 5062"]},"initialDelaySeconds":30,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"exec":{"command":["/bin/bash","/usr/share/kubernetes/liveness.sh","3478 5060 5062"]},"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"},{"name":"tailer","image":"busybox","command":["tail","-F","/var/log/bono/bono_current.txt"],"resources":{},"volumeMounts":[{"name":"bonologs","mountPath":"/var/log/bono"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","securityContext":{},"imagePullSecrets":[{}],"schedulerName":"default-scheduler"}},"strategy":{"type":"RollingUpdate","rollingUpdate":{"maxUnavailable":"25%","maxSurge":"25%"}},"revisionHistoryLimit":10,"progressDeadlineSeconds":600},"status":{}} 2020-07-16 14:32:35,119 - functest_kubernetes.ims.ims - INFO - Deployment bono created 2020-07-16 14:32:35,120 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241254', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'dc34d644-c397-488f-a732-ec2f9e3fa065'}} 2020-07-16 14:32:35,182 - kubernetes.client.rest - DEBUG - response body: {"kind":"Deployment","apiVersion":"apps/v1","metadata":{"name":"cassandra","namespace":"default","selfLink":"/apis/apps/v1/namespaces/default/deployments/cassandra","uid":"38c0a876-12ce-40c0-b323-212af3468120","resourceVersion":"1241266","generation":1,"creationTimestamp":"2020-07-16T14:32:35Z"},"spec":{"replicas":1,"selector":{"matchLabels":{"service":"cassandra"}},"template":{"metadata":{"creationTimestamp":null,"labels":{"service":"cassandra"}},"spec":{"initContainers":[{"name":"wait-on-etcd","image":"busybox:1.28","command":["sh","-c","until nslookup etcd; do echo waiting for etcd to start ...; sleep 2; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"containers":[{"name":"cassandra","image":"ollivier/clearwater-cassandra:latest","ports":[{"containerPort":22,"protocol":"TCP"},{"containerPort":7001,"protocol":"TCP"},{"containerPort":9042,"protocol":"TCP"},{"containerPort":9160,"protocol":"TCP"}],"envFrom":[{"configMapRef":{"name":"env-vars"}}],"env":[{"name":"MY_POD_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}}],"resources":{},"livenessProbe":{"exec":{"command":["/bin/bash","/usr/share/kubernetes/liveness.sh","7000 9042 9160"]},"initialDelaySeconds":600,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"exec":{"command":["/bin/bash","/usr/share/kubernetes/liveness.sh","7000 9042 9160"]},"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","securityContext":{},"imagePullSecrets":[{}],"schedulerName":"default-scheduler"}},"strategy":{"type":"RollingUpdate","rollingUpdate":{"maxUnavailable":"25%","maxSurge":"25%"}},"revisionHistoryLimit":10,"progressDeadlineSeconds":600},"status":{}} 2020-07-16 14:32:35,185 - functest_kubernetes.ims.ims - INFO - Deployment cassandra created 2020-07-16 14:32:35,185 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241254', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'dc34d644-c397-488f-a732-ec2f9e3fa065'}} 2020-07-16 14:32:35,228 - kubernetes.client.rest - DEBUG - response body: {"kind":"Deployment","apiVersion":"apps/v1","metadata":{"name":"chronos","namespace":"default","selfLink":"/apis/apps/v1/namespaces/default/deployments/chronos","uid":"2139a1ec-34aa-4887-a963-0a75fe256d98","resourceVersion":"1241272","generation":1,"creationTimestamp":"2020-07-16T14:32:35Z","labels":{"service":"chronos"}},"spec":{"replicas":1,"selector":{"matchLabels":{"service":"chronos"}},"template":{"metadata":{"creationTimestamp":null,"labels":{"service":"chronos"}},"spec":{"volumes":[{"name":"chronoslogs","emptyDir":{}}],"initContainers":[{"name":"wait-on-cassandra","image":"busybox:1.28","command":["sh","-c","until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"containers":[{"name":"chronos","image":"ollivier/clearwater-chronos:latest","ports":[{"containerPort":22,"protocol":"TCP"},{"containerPort":7253,"protocol":"TCP"}],"envFrom":[{"configMapRef":{"name":"env-vars"}}],"env":[{"name":"MY_POD_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}}],"resources":{},"volumeMounts":[{"name":"chronoslogs","mountPath":"/var/log/chronos"}],"livenessProbe":{"tcpSocket":{"port":7253},"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":9},"readinessProbe":{"tcpSocket":{"port":7253},"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"lifecycle":{"preStop":{"exec":{"command":["/bin/bash","-c","/usr/bin/pre-stop"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"},{"name":"tailer","image":"busybox","command":["tail","-F","/var/log/chronos/chronos_current.txt"],"resources":{},"volumeMounts":[{"name":"chronoslogs","mountPath":"/var/log/chronos"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"restartPolicy":"Always","terminationGracePeriodSeconds":120,"dnsPolicy":"ClusterFirst","securityContext":{},"imagePullSecrets":[{}],"schedulerName":"default-scheduler"}},"strategy":{"type":"RollingUpdate","rollingUpdate":{"maxUnavailable":"25%","maxSurge":"25%"}},"revisionHistoryLimit":10,"progressDeadlineSeconds":600},"status":{}} 2020-07-16 14:32:35,231 - functest_kubernetes.ims.ims - INFO - Deployment chronos created 2020-07-16 14:32:35,231 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241254', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'dc34d644-c397-488f-a732-ec2f9e3fa065'}} 2020-07-16 14:32:35,283 - kubernetes.client.rest - DEBUG - response body: {"kind":"Deployment","apiVersion":"apps/v1","metadata":{"name":"ellis","namespace":"default","selfLink":"/apis/apps/v1/namespaces/default/deployments/ellis","uid":"d83c33af-71ff-49fc-b323-649742f54f07","resourceVersion":"1241280","generation":1,"creationTimestamp":"2020-07-16T14:32:35Z"},"spec":{"replicas":1,"selector":{"matchLabels":{"service":"ellis"}},"template":{"metadata":{"creationTimestamp":null,"labels":{"service":"ellis"}},"spec":{"initContainers":[{"name":"wait-on-homestead-prov","image":"busybox:1.28","command":["sh","-c","until nslookup homestead-prov; do echo waiting for homestead-prov to start ...; sleep 2; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"},{"name":"wait-on-sprout","image":"busybox:1.28","command":["sh","-c","until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"containers":[{"name":"ellis","image":"ollivier/clearwater-ellis:latest","ports":[{"containerPort":22,"protocol":"TCP"},{"containerPort":80,"protocol":"TCP"}],"envFrom":[{"configMapRef":{"name":"env-vars"}}],"env":[{"name":"MY_POD_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}}],"resources":{},"livenessProbe":{"tcpSocket":{"port":80},"initialDelaySeconds":30,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"tcpSocket":{"port":80},"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","securityContext":{},"imagePullSecrets":[{}],"schedulerName":"default-scheduler"}},"strategy":{"type":"RollingUpdate","rollingUpdate":{"maxUnavailable":"25%","maxSurge":"25%"}},"revisionHistoryLimit":10,"progressDeadlineSeconds":600},"status":{}} 2020-07-16 14:32:35,286 - functest_kubernetes.ims.ims - INFO - Deployment ellis created 2020-07-16 14:32:35,287 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241254', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'dc34d644-c397-488f-a732-ec2f9e3fa065'}} 2020-07-16 14:32:35,317 - kubernetes.client.rest - DEBUG - response body: {"kind":"Deployment","apiVersion":"apps/v1","metadata":{"name":"etcd","namespace":"default","selfLink":"/apis/apps/v1/namespaces/default/deployments/etcd","uid":"58ec500f-8a45-4870-a91a-ccafbbc23315","resourceVersion":"1241291","generation":1,"creationTimestamp":"2020-07-16T14:32:35Z"},"spec":{"replicas":1,"selector":{"matchLabels":{"instance-type":"etcd-pod"}},"template":{"metadata":{"creationTimestamp":null,"labels":{"instance-type":"etcd-pod"}},"spec":{"containers":[{"name":"etcd","image":"quay.io/coreos/etcd:v2.2.5","args":["--name","$(MY_POD_NAME)","--advertise-client-urls","http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001","--listen-client-urls","http://0.0.0.0:2379,http://0.0.0.0:4001","--initial-advertise-peer-urls","http://$(MY_POD_IP):2380","--listen-peer-urls","http://0.0.0.0:2380","--initial-cluster","$(MY_POD_NAME)=http://$(MY_POD_IP):2380","--initial-cluster-state","new"],"ports":[{"containerPort":2379,"protocol":"TCP"},{"containerPort":2380,"protocol":"TCP"},{"containerPort":4001,"protocol":"TCP"}],"env":[{"name":"MY_POD_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}},{"name":"MY_POD_NAME","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.name"}}}],"resources":{},"livenessProbe":{"tcpSocket":{"port":4001},"initialDelaySeconds":300,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"tcpSocket":{"port":4001},"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","securityContext":{},"imagePullSecrets":[{}],"schedulerName":"default-scheduler"}},"strategy":{"type":"RollingUpdate","rollingUpdate":{"maxUnavailable":"25%","maxSurge":"25%"}},"revisionHistoryLimit":10,"progressDeadlineSeconds":600},"status":{}} 2020-07-16 14:32:35,320 - functest_kubernetes.ims.ims - INFO - Deployment etcd created 2020-07-16 14:32:35,320 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241254', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'dc34d644-c397-488f-a732-ec2f9e3fa065'}} 2020-07-16 14:32:35,375 - kubernetes.client.rest - DEBUG - response body: {"kind":"Deployment","apiVersion":"apps/v1","metadata":{"name":"homer","namespace":"default","selfLink":"/apis/apps/v1/namespaces/default/deployments/homer","uid":"10c5b30b-97b5-4a4e-b334-ef77a1a652ad","resourceVersion":"1241302","generation":1,"creationTimestamp":"2020-07-16T14:32:35Z"},"spec":{"replicas":1,"selector":{"matchLabels":{"service":"homer"}},"template":{"metadata":{"creationTimestamp":null,"labels":{"service":"homer"}},"spec":{"initContainers":[{"name":"wait-on-cassandra","image":"busybox:1.28","command":["sh","-c","until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"containers":[{"name":"homer","image":"ollivier/clearwater-homer:latest","ports":[{"containerPort":22,"protocol":"TCP"},{"containerPort":7888,"protocol":"TCP"}],"envFrom":[{"configMapRef":{"name":"env-vars"}}],"env":[{"name":"MY_POD_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}}],"resources":{},"livenessProbe":{"tcpSocket":{"port":7888},"initialDelaySeconds":30,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"tcpSocket":{"port":7888},"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","securityContext":{},"imagePullSecrets":[{}],"schedulerName":"default-scheduler"}},"strategy":{"type":"RollingUpdate","rollingUpdate":{"maxUnavailable":"25%","maxSurge":"25%"}},"revisionHistoryLimit":10,"progressDeadlineSeconds":600},"status":{}} 2020-07-16 14:32:35,378 - functest_kubernetes.ims.ims - INFO - Deployment homer created 2020-07-16 14:32:35,378 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241254', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'dc34d644-c397-488f-a732-ec2f9e3fa065'}} 2020-07-16 14:32:35,434 - kubernetes.client.rest - DEBUG - response body: {"kind":"Deployment","apiVersion":"apps/v1","metadata":{"name":"homestead","namespace":"default","selfLink":"/apis/apps/v1/namespaces/default/deployments/homestead","uid":"e112f04c-bc51-4e58-a54d-8f1880bd09ab","resourceVersion":"1241313","generation":1,"creationTimestamp":"2020-07-16T14:32:35Z"},"spec":{"replicas":1,"selector":{"matchLabels":{"service":"homestead"}},"template":{"metadata":{"creationTimestamp":null,"labels":{"service":"homestead","snmp":"enabled"}},"spec":{"volumes":[{"name":"homesteadlogs","emptyDir":{}}],"initContainers":[{"name":"wait-on-cassandra","image":"busybox:1.28","command":["sh","-c","until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"},{"name":"wait-on-astaire","image":"busybox:1.28","command":["sh","-c","until nslookup astaire; do echo waiting for astaire to start ...; sleep 2; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"containers":[{"name":"homestead","image":"ollivier/clearwater-homestead:latest","ports":[{"containerPort":22,"protocol":"TCP"},{"containerPort":8888,"protocol":"TCP"}],"envFrom":[{"configMapRef":{"name":"env-vars"}}],"env":[{"name":"MY_POD_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}}],"resources":{},"volumeMounts":[{"name":"homesteadlogs","mountPath":"/var/log/homestead"}],"livenessProbe":{"exec":{"command":["/bin/bash","/usr/share/kubernetes/liveness.sh","8888"]},"initialDelaySeconds":60,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"exec":{"command":["/bin/bash","/usr/share/kubernetes/liveness.sh","8888"]},"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"},{"name":"tailer","image":"busybox","command":["tail","-F","/var/log/homestead/homestead_current.txt"],"resources":{},"volumeMounts":[{"name":"homesteadlogs","mountPath":"/var/log/homestead"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","securityContext":{},"imagePullSecrets":[{}],"schedulerName":"default-scheduler"}},"strategy":{"type":"RollingUpdate","rollingUpdate":{"maxUnavailable":"25%","maxSurge":"25%"}},"revisionHistoryLimit":10,"progressDeadlineSeconds":600},"status":{}} 2020-07-16 14:32:35,437 - functest_kubernetes.ims.ims - INFO - Deployment homestead created 2020-07-16 14:32:35,448 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241254', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'dc34d644-c397-488f-a732-ec2f9e3fa065'}} 2020-07-16 14:32:35,490 - kubernetes.client.rest - DEBUG - response body: {"kind":"Deployment","apiVersion":"apps/v1","metadata":{"name":"homestead-prov","namespace":"default","selfLink":"/apis/apps/v1/namespaces/default/deployments/homestead-prov","uid":"67040119-0611-4a1f-9d68-cf00bbff900e","resourceVersion":"1241331","generation":1,"creationTimestamp":"2020-07-16T14:32:35Z"},"spec":{"replicas":1,"selector":{"matchLabels":{"service":"homestead-prov"}},"template":{"metadata":{"creationTimestamp":null,"labels":{"service":"homestead-prov","snmp":"enabled"}},"spec":{"initContainers":[{"name":"wait-on-homestead","image":"busybox:1.28","command":["sh","-c","until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"containers":[{"name":"homestead-prov","image":"ollivier/clearwater-homestead-prov:latest","ports":[{"containerPort":22,"protocol":"TCP"},{"containerPort":8889,"protocol":"TCP"}],"envFrom":[{"configMapRef":{"name":"env-vars"}}],"env":[{"name":"MY_POD_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}}],"resources":{},"livenessProbe":{"exec":{"command":["/bin/bash","/usr/share/clearwater/bin/poll_homestead-prov.sh"]},"initialDelaySeconds":60,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"exec":{"command":["/bin/bash","/usr/share/clearwater/bin/poll_homestead-prov.sh"]},"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","securityContext":{},"imagePullSecrets":[{}],"schedulerName":"default-scheduler"}},"strategy":{"type":"RollingUpdate","rollingUpdate":{"maxUnavailable":"25%","maxSurge":"25%"}},"revisionHistoryLimit":10,"progressDeadlineSeconds":600},"status":{}} 2020-07-16 14:32:35,493 - functest_kubernetes.ims.ims - INFO - Deployment homestead-prov created 2020-07-16 14:32:35,493 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241254', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'dc34d644-c397-488f-a732-ec2f9e3fa065'}} 2020-07-16 14:32:35,526 - kubernetes.client.rest - DEBUG - response body: {"kind":"Deployment","apiVersion":"apps/v1","metadata":{"name":"ralf","namespace":"default","selfLink":"/apis/apps/v1/namespaces/default/deployments/ralf","uid":"4f24a10d-9c29-4114-b079-0f83735d4688","resourceVersion":"1241340","generation":1,"creationTimestamp":"2020-07-16T14:32:35Z"},"spec":{"replicas":1,"selector":{"matchLabels":{"service":"ralf"}},"template":{"metadata":{"creationTimestamp":null,"labels":{"service":"ralf","snmp":"enabled"}},"spec":{"volumes":[{"name":"ralflogs","emptyDir":{}}],"initContainers":[{"name":"wait-on-cassandra","image":"busybox:1.28","command":["sh","-c","until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"containers":[{"name":"ralf","image":"ollivier/clearwater-ralf:latest","ports":[{"containerPort":22,"protocol":"TCP"},{"containerPort":10888,"protocol":"TCP"}],"envFrom":[{"configMapRef":{"name":"env-vars"}}],"env":[{"name":"MY_POD_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}}],"resources":{},"volumeMounts":[{"name":"ralflogs","mountPath":"/var/log/ralf"}],"livenessProbe":{"tcpSocket":{"port":10888},"initialDelaySeconds":30,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"tcpSocket":{"port":10888},"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"},{"name":"tailer","image":"busybox","command":["tail","-F","/var/log/ralf/ralf_current.txt"],"resources":{},"volumeMounts":[{"name":"ralflogs","mountPath":"/var/log/ralf"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","securityContext":{},"imagePullSecrets":[{}],"schedulerName":"default-scheduler"}},"strategy":{"type":"RollingUpdate","rollingUpdate":{"maxUnavailable":"25%","maxSurge":"25%"}},"revisionHistoryLimit":10,"progressDeadlineSeconds":600},"status":{}} 2020-07-16 14:32:35,529 - functest_kubernetes.ims.ims - INFO - Deployment ralf created 2020-07-16 14:32:35,529 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241254', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'dc34d644-c397-488f-a732-ec2f9e3fa065'}} 2020-07-16 14:32:35,591 - kubernetes.client.rest - DEBUG - response body: {"kind":"Deployment","apiVersion":"apps/v1","metadata":{"name":"sprout","namespace":"default","selfLink":"/apis/apps/v1/namespaces/default/deployments/sprout","uid":"40a25977-918e-4559-a2b3-31b12ddf0799","resourceVersion":"1241344","generation":1,"creationTimestamp":"2020-07-16T14:32:35Z"},"spec":{"replicas":1,"selector":{"matchLabels":{"service":"sprout"}},"template":{"metadata":{"creationTimestamp":null,"labels":{"service":"sprout","snmp":"enabled"}},"spec":{"volumes":[{"name":"sproutlogs","emptyDir":{}}],"initContainers":[{"name":"wait-on-ralf","image":"busybox:1.28","command":["sh","-c","until nslookup ralf; do echo waiting for ralf to start ...; sleep 2; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"},{"name":"wait-on-chronos","image":"busybox:1.28","command":["sh","-c","until nslookup chronos; do echo waiting for chronos to start ...; sleep 2; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"},{"name":"wait-on-homestead","image":"busybox:1.28","command":["sh","-c","until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"containers":[{"name":"sprout","image":"ollivier/clearwater-sprout:latest","ports":[{"containerPort":22,"protocol":"TCP"}],"envFrom":[{"configMapRef":{"name":"env-vars"}}],"env":[{"name":"MY_POD_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}}],"resources":{},"volumeMounts":[{"name":"sproutlogs","mountPath":"/var/log/sprout"}],"livenessProbe":{"exec":{"command":["/bin/bash","/usr/share/kubernetes/liveness.sh","5052 5054"]},"initialDelaySeconds":30,"timeoutSeconds":1,"periodSeconds":3,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"exec":{"command":["/bin/bash","/usr/share/kubernetes/liveness.sh","5052 5054"]},"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"},{"name":"tailer","image":"busybox","command":["tail","-F","/var/log/sprout/sprout_current.txt"],"resources":{},"volumeMounts":[{"name":"sproutlogs","mountPath":"/var/log/sprout"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","securityContext":{},"imagePullSecrets":[{}],"schedulerName":"default-scheduler"}},"strategy":{"type":"RollingUpdate","rollingUpdate":{"maxUnavailable":"25%","maxSurge":"25%"}},"revisionHistoryLimit":10,"progressDeadlineSeconds":600},"status":{}} 2020-07-16 14:32:35,595 - functest_kubernetes.ims.ims - INFO - Deployment sprout created 2020-07-16 14:32:35,595 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241254', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'dc34d644-c397-488f-a732-ec2f9e3fa065'}} 2020-07-16 14:32:35,634 - kubernetes.client.rest - DEBUG - response body: {"kind":"Service","apiVersion":"v1","metadata":{"name":"astaire","namespace":"default","selfLink":"/api/v1/namespaces/default/services/astaire","uid":"0fed5bd2-03dd-45e1-81c6-428ba89778d2","resourceVersion":"1241347","creationTimestamp":"2020-07-16T14:32:35Z"},"spec":{"ports":[{"name":"11311","protocol":"TCP","port":11311,"targetPort":11311}],"selector":{"service":"astaire"},"clusterIP":"None","type":"ClusterIP","sessionAffinity":"None"},"status":{"loadBalancer":{}}} 2020-07-16 14:32:35,635 - functest_kubernetes.ims.ims - INFO - Service astaire created 2020-07-16 14:32:35,635 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241254', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'dc34d644-c397-488f-a732-ec2f9e3fa065'}} 2020-07-16 14:32:35,668 - kubernetes.client.rest - DEBUG - response body: {"kind":"Service","apiVersion":"v1","metadata":{"name":"bono","namespace":"default","selfLink":"/api/v1/namespaces/default/services/bono","uid":"499280b6-06ca-4e94-a504-9191fade277b","resourceVersion":"1241351","creationTimestamp":"2020-07-16T14:32:35Z"},"spec":{"ports":[{"name":"3478","protocol":"TCP","port":3478,"targetPort":3478},{"name":"5060","protocol":"TCP","port":5060,"targetPort":5060},{"name":"5062","protocol":"TCP","port":5062,"targetPort":5062}],"selector":{"service":"bono"},"clusterIP":"None","type":"ClusterIP","sessionAffinity":"None"},"status":{"loadBalancer":{}}} 2020-07-16 14:32:35,669 - functest_kubernetes.ims.ims - INFO - Service bono created 2020-07-16 14:32:35,669 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241254', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'dc34d644-c397-488f-a732-ec2f9e3fa065'}} 2020-07-16 14:32:35,719 - kubernetes.client.rest - DEBUG - response body: {"kind":"Service","apiVersion":"v1","metadata":{"name":"cassandra","namespace":"default","selfLink":"/api/v1/namespaces/default/services/cassandra","uid":"30654d3c-5cea-46ec-aeed-a04e50269cd9","resourceVersion":"1241356","creationTimestamp":"2020-07-16T14:32:35Z"},"spec":{"ports":[{"name":"7001","protocol":"TCP","port":7001,"targetPort":7001},{"name":"7000","protocol":"TCP","port":7000,"targetPort":7000},{"name":"9042","protocol":"TCP","port":9042,"targetPort":9042},{"name":"9160","protocol":"TCP","port":9160,"targetPort":9160}],"selector":{"service":"cassandra"},"clusterIP":"None","type":"ClusterIP","sessionAffinity":"None"},"status":{"loadBalancer":{}}} 2020-07-16 14:32:35,720 - functest_kubernetes.ims.ims - INFO - Service cassandra created 2020-07-16 14:32:35,721 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241254', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'dc34d644-c397-488f-a732-ec2f9e3fa065'}} 2020-07-16 14:32:35,758 - kubernetes.client.rest - DEBUG - response body: {"kind":"Service","apiVersion":"v1","metadata":{"name":"chronos","namespace":"default","selfLink":"/api/v1/namespaces/default/services/chronos","uid":"8caa0b31-47b9-4f54-93f3-927e77e0d303","resourceVersion":"1241363","creationTimestamp":"2020-07-16T14:32:35Z"},"spec":{"ports":[{"name":"7253","protocol":"TCP","port":7253,"targetPort":7253}],"selector":{"service":"chronos"},"clusterIP":"None","type":"ClusterIP","sessionAffinity":"None"},"status":{"loadBalancer":{}}} 2020-07-16 14:32:35,760 - functest_kubernetes.ims.ims - INFO - Service chronos created 2020-07-16 14:32:35,760 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241254', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'dc34d644-c397-488f-a732-ec2f9e3fa065'}} 2020-07-16 14:32:35,790 - kubernetes.client.rest - DEBUG - response body: {"kind":"Service","apiVersion":"v1","metadata":{"name":"ellis","namespace":"default","selfLink":"/api/v1/namespaces/default/services/ellis","uid":"bc95c1eb-66de-40d4-8222-52db97f9306d","resourceVersion":"1241367","creationTimestamp":"2020-07-16T14:32:35Z"},"spec":{"ports":[{"name":"http","protocol":"TCP","port":80,"targetPort":80}],"selector":{"service":"ellis"},"clusterIP":"None","type":"ClusterIP","sessionAffinity":"None"},"status":{"loadBalancer":{}}} 2020-07-16 14:32:35,791 - functest_kubernetes.ims.ims - INFO - Service ellis created 2020-07-16 14:32:35,791 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241254', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'dc34d644-c397-488f-a732-ec2f9e3fa065'}} 2020-07-16 14:32:35,814 - kubernetes.client.rest - DEBUG - response body: {"kind":"Service","apiVersion":"v1","metadata":{"name":"etcd","namespace":"default","selfLink":"/api/v1/namespaces/default/services/etcd","uid":"8fe83dc4-5312-4aa1-be90-06000f3c4026","resourceVersion":"1241372","creationTimestamp":"2020-07-16T14:32:35Z","labels":{"instance-type":"etcd-pod"}},"spec":{"ports":[{"name":"etcd-client","protocol":"TCP","port":2379,"targetPort":2379},{"name":"etcd-server","protocol":"TCP","port":2380,"targetPort":2380},{"name":"4001","protocol":"TCP","port":4001,"targetPort":4001}],"selector":{"instance-type":"etcd-pod"},"clusterIP":"None","type":"ClusterIP","sessionAffinity":"None"},"status":{"loadBalancer":{}}} 2020-07-16 14:32:35,816 - functest_kubernetes.ims.ims - INFO - Service etcd created 2020-07-16 14:32:35,816 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241254', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'dc34d644-c397-488f-a732-ec2f9e3fa065'}} 2020-07-16 14:32:35,868 - kubernetes.client.rest - DEBUG - response body: {"kind":"Service","apiVersion":"v1","metadata":{"name":"homer","namespace":"default","selfLink":"/api/v1/namespaces/default/services/homer","uid":"99c39f78-76b7-4ef0-acf6-19488f8147a9","resourceVersion":"1241375","creationTimestamp":"2020-07-16T14:32:35Z"},"spec":{"ports":[{"name":"7888","protocol":"TCP","port":7888,"targetPort":7888}],"selector":{"service":"homer"},"clusterIP":"None","type":"ClusterIP","sessionAffinity":"None"},"status":{"loadBalancer":{}}} 2020-07-16 14:32:35,869 - functest_kubernetes.ims.ims - INFO - Service homer created 2020-07-16 14:32:35,869 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241254', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'dc34d644-c397-488f-a732-ec2f9e3fa065'}} 2020-07-16 14:32:35,887 - kubernetes.client.rest - DEBUG - response body: {"kind":"Service","apiVersion":"v1","metadata":{"name":"homestead","namespace":"default","selfLink":"/api/v1/namespaces/default/services/homestead","uid":"e78ea8ec-de7d-4185-9d3f-bfddc59a39fc","resourceVersion":"1241379","creationTimestamp":"2020-07-16T14:32:35Z"},"spec":{"ports":[{"name":"8888","protocol":"TCP","port":8888,"targetPort":8888}],"selector":{"service":"homestead"},"clusterIP":"None","type":"ClusterIP","sessionAffinity":"None"},"status":{"loadBalancer":{}}} 2020-07-16 14:32:35,888 - functest_kubernetes.ims.ims - INFO - Service homestead created 2020-07-16 14:32:35,888 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241254', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'dc34d644-c397-488f-a732-ec2f9e3fa065'}} 2020-07-16 14:32:35,911 - kubernetes.client.rest - DEBUG - response body: {"kind":"Service","apiVersion":"v1","metadata":{"name":"homestead-prov","namespace":"default","selfLink":"/api/v1/namespaces/default/services/homestead-prov","uid":"be9c3fca-b210-4045-9295-716628694453","resourceVersion":"1241382","creationTimestamp":"2020-07-16T14:32:35Z"},"spec":{"ports":[{"name":"8889","protocol":"TCP","port":8889,"targetPort":8889}],"selector":{"service":"homestead-prov"},"clusterIP":"None","type":"ClusterIP","sessionAffinity":"None"},"status":{"loadBalancer":{}}} 2020-07-16 14:32:35,912 - functest_kubernetes.ims.ims - INFO - Service homestead-prov created 2020-07-16 14:32:35,912 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241254', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'dc34d644-c397-488f-a732-ec2f9e3fa065'}} 2020-07-16 14:32:35,925 - kubernetes.client.rest - DEBUG - response body: {"kind":"Service","apiVersion":"v1","metadata":{"name":"ralf","namespace":"default","selfLink":"/api/v1/namespaces/default/services/ralf","uid":"0bf8da88-dc62-4add-95f0-1a6b53951be0","resourceVersion":"1241384","creationTimestamp":"2020-07-16T14:32:35Z"},"spec":{"ports":[{"name":"10888","protocol":"TCP","port":10888,"targetPort":10888}],"selector":{"service":"ralf"},"clusterIP":"None","type":"ClusterIP","sessionAffinity":"None"},"status":{"loadBalancer":{}}} 2020-07-16 14:32:35,926 - functest_kubernetes.ims.ims - INFO - Service ralf created 2020-07-16 14:32:35,926 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241254', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'dc34d644-c397-488f-a732-ec2f9e3fa065'}} 2020-07-16 14:32:35,959 - kubernetes.client.rest - DEBUG - response body: {"kind":"Service","apiVersion":"v1","metadata":{"name":"sprout","namespace":"default","selfLink":"/api/v1/namespaces/default/services/sprout","uid":"b894708e-7fe4-4bc0-9ba1-fcd473880490","resourceVersion":"1241387","creationTimestamp":"2020-07-16T14:32:35Z"},"spec":{"ports":[{"name":"5052","protocol":"TCP","port":5052,"targetPort":5052},{"name":"5054","protocol":"TCP","port":5054,"targetPort":5054}],"selector":{"service":"sprout"},"clusterIP":"None","type":"ClusterIP","sessionAffinity":"None"},"status":{"loadBalancer":{}}} 2020-07-16 14:32:35,960 - functest_kubernetes.ims.ims - INFO - Service sprout created 2020-07-16 14:32:35,960 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'default.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241254', 'self_link': '/api/v1/namespaces/default/configmaps/env-vars', 'uid': 'dc34d644-c397-488f-a732-ec2f9e3fa065'}} 2020-07-16 14:32:35,967 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'service': 'chronos'}, 'managed_fields': None, 'name': 'chronos', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241320', 'self_link': '/apis/apps/v1/namespaces/default/deployments/chronos', 'uid': '2139a1ec-34aa-4887-a963-0a75fe256d98'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'chronos'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'chronos'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-chronos:latest', 'image_pull_policy': 'Always', 'lifecycle': {'post_start': None, 'pre_stop': {'_exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}, 'http_get': None, 'tcp_socket': None}}, 'liveness_probe': {'_exec': None, 'failure_threshold': 9, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7253}, 'timeout_seconds': 1}, 'name': 'chronos', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7253, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7253}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/chronos', 'mount_propagation': None, 'name': 'chronoslogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/chronos/chronos_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/chronos', 'mount_propagation': None, 'name': 'chronoslogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 120, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'chronoslogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': 'ReplicaSet "chronos-687b9884c5" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'chronos', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/chronos', 'uid': '2139a1ec-34aa-4887-a963-0a75fe256d98', 'resourceVersion': '1241320', 'generation': 1, 'creationTimestamp': '2020-07-16T14:32:35Z', 'labels': {'service': 'chronos'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'chronos'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'chronos'}}, 'spec': {'volumes': [{'name': 'chronoslogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'chronos', 'image': 'ollivier/clearwater-chronos:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7253, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'chronoslogs', 'mountPath': '/var/log/chronos'}], 'livenessProbe': {'tcpSocket': {'port': 7253}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 9}, 'readinessProbe': {'tcpSocket': {'port': 7253}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'lifecycle': {'preStop': {'exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}}}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/chronos/chronos_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'chronoslogs', 'mountPath': '/var/log/chronos'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 120, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-16T14:32:35Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:32:35Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "chronos-687b9884c5" is progressing.'}]}}} 2020-07-16 14:32:35,995 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 0, 4, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test3'}, 'managed_fields': None, 'name': 'live-test3', 'namespace': 'default', 'owner_references': None, 'resource_version': '1240084', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test3', 'uid': '93bd8802-4153-4590-aee1-cd3b8f208f06'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test3'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test3'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test3', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 11, 0, 4, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 11, 0, 17, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test3-6556bf7d77" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 27, 57, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 27, 57, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test3', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test3', 'uid': '93bd8802-4153-4590-aee1-cd3b8f208f06', 'resourceVersion': '1240084', 'generation': 1, 'creationTimestamp': '2020-07-10T11:00:04Z', 'labels': {'run': 'live-test3'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test3'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test3'}}, 'spec': {'containers': [{'name': 'live-test3', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T11:00:17Z', 'lastTransitionTime': '2020-07-10T11:00:04Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test3-6556bf7d77" has successfully progressed.'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-16T14:27:57Z', 'lastTransitionTime': '2020-07-16T14:27:57Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-16 14:32:36,014 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 6, 27, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test5'}, 'managed_fields': None, 'name': 'live-test5', 'namespace': 'default', 'owner_references': None, 'resource_version': '1240376', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test5', 'uid': '386005c8-1f07-46dc-adf0-77ceea373c63'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test5'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test5'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test5', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 11, 6, 27, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 11, 6, 40, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test5-b6fcb7757" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 29, 22, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 29, 22, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test5', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test5', 'uid': '386005c8-1f07-46dc-adf0-77ceea373c63', 'resourceVersion': '1240376', 'generation': 1, 'creationTimestamp': '2020-07-10T11:06:27Z', 'labels': {'run': 'live-test5'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test5'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test5'}}, 'spec': {'containers': [{'name': 'live-test5', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T11:06:40Z', 'lastTransitionTime': '2020-07-10T11:06:27Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test5-b6fcb7757" has successfully progressed.'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-16T14:29:22Z', 'lastTransitionTime': '2020-07-16T14:29:22Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-16 14:32:36,026 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 56, 6, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test8'}, 'managed_fields': None, 'name': 'live-test8', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241104', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test8', 'uid': '97897e35-290b-4b9f-b5bf-1be380092f43'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test8'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test8'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test8', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 11, 56, 6, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 11, 56, 16, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test8-55669b464c" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 31, 53, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 31, 53, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test8', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test8', 'uid': '97897e35-290b-4b9f-b5bf-1be380092f43', 'resourceVersion': '1241104', 'generation': 1, 'creationTimestamp': '2020-07-10T11:56:06Z', 'labels': {'run': 'live-test8'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test8'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test8'}}, 'spec': {'containers': [{'name': 'live-test8', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T11:56:16Z', 'lastTransitionTime': '2020-07-10T11:56:06Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test8-55669b464c" has successfully progressed.'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-16T14:31:53Z', 'lastTransitionTime': '2020-07-16T14:31:53Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-16 14:32:36,045 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'astaire', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241307', 'self_link': '/apis/apps/v1/namespaces/default/deployments/astaire', 'uid': 'a719a6f5-a461-4be5-8214-898af088df3f'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'astaire'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'astaire'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-astaire:latest', 'image_pull_policy': 'Always', 'lifecycle': {'post_start': None, 'pre_stop': {'_exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}, 'http_get': None, 'tcp_socket': None}}, 'liveness_probe': {'_exec': None, 'failure_threshold': 9, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 11311}, 'timeout_seconds': 1}, 'name': 'astaire', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 11211, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 11311, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 11311}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/astaire', 'mount_propagation': None, 'name': 'astairelogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/astaire/astaire_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/astaire', 'mount_propagation': None, 'name': 'astairelogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 120, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'astairelogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': 'ReplicaSet "astaire-5ddcdd6b7f" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'astaire', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/astaire', 'uid': 'a719a6f5-a461-4be5-8214-898af088df3f', 'resourceVersion': '1241307', 'generation': 1, 'creationTimestamp': '2020-07-16T14:32:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'astaire'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'astaire'}}, 'spec': {'volumes': [{'name': 'astairelogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'astaire', 'image': 'ollivier/clearwater-astaire:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 11211, 'protocol': 'TCP'}, {'containerPort': 11311, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'astairelogs', 'mountPath': '/var/log/astaire'}], 'livenessProbe': {'tcpSocket': {'port': 11311}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 9}, 'readinessProbe': {'tcpSocket': {'port': 11311}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'lifecycle': {'preStop': {'exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}}}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/astaire/astaire_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'astairelogs', 'mountPath': '/var/log/astaire'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 120, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-16T14:32:35Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:32:35Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "astaire-5ddcdd6b7f" is progressing.'}]}}} 2020-07-16 14:32:36,084 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'etcd', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241338', 'self_link': '/apis/apps/v1/namespaces/default/deployments/etcd', 'uid': '58ec500f-8a45-4870-a91a-ccafbbc23315'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'instance-type': 'etcd-pod'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'instance-type': 'etcd-pod'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': ['--name', '$(MY_POD_NAME)', '--advertise-client-urls', 'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', '--listen-client-urls', 'http://0.0.0.0:2379,http://0.0.0.0:4001', '--initial-advertise-peer-urls', 'http://$(MY_POD_IP):2380', '--listen-peer-urls', 'http://0.0.0.0:2380', '--initial-cluster', '$(MY_POD_NAME)=http://$(MY_POD_IP):2380', '--initial-cluster-state', 'new'], 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}, {'name': 'MY_POD_NAME', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'metadata.name'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': None, 'image': 'quay.io/coreos/etcd:v2.2.5', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 300, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 4001}, 'timeout_seconds': 1}, 'name': 'etcd', 'ports': [{'container_port': 2379, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 2380, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 4001, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 4001}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': 'Created new replica set ' '"etcd-5cbf55c8c"', 'reason': 'NewReplicaSetCreated', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': None, 'unavailable_replicas': 1, 'updated_replicas': None}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'etcd', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/etcd', 'uid': '58ec500f-8a45-4870-a91a-ccafbbc23315', 'resourceVersion': '1241338', 'generation': 1, 'creationTimestamp': '2020-07-16T14:32:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'instance-type': 'etcd-pod'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'instance-type': 'etcd-pod'}}, 'spec': {'containers': [{'name': 'etcd', 'image': 'quay.io/coreos/etcd:v2.2.5', 'args': ['--name', '$(MY_POD_NAME)', '--advertise-client-urls', 'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', '--listen-client-urls', 'http://0.0.0.0:2379,http://0.0.0.0:4001', '--initial-advertise-peer-urls', 'http://$(MY_POD_IP):2380', '--listen-peer-urls', 'http://0.0.0.0:2380', '--initial-cluster', '$(MY_POD_NAME)=http://$(MY_POD_IP):2380', '--initial-cluster-state', 'new'], 'ports': [{'containerPort': 2379, 'protocol': 'TCP'}, {'containerPort': 2380, 'protocol': 'TCP'}, {'containerPort': 4001, 'protocol': 'TCP'}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}, {'name': 'MY_POD_NAME', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'metadata.name'}}}], 'resources': {}, 'livenessProbe': {'tcpSocket': {'port': 4001}, 'initialDelaySeconds': 300, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 4001}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:32:35Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'NewReplicaSetCreated', 'message': 'Created new replica set "etcd-5cbf55c8c"'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-16T14:32:35Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-16 14:32:36,103 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homestead', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241328', 'self_link': '/apis/apps/v1/namespaces/default/deployments/homestead', 'uid': 'e112f04c-bc51-4e58-a54d-8f1880bd09ab'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'homestead'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'homestead', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/homestead', 'mount_propagation': None, 'name': 'homesteadlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/homestead/homestead_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/homestead', 'mount_propagation': None, 'name': 'homesteadlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'astaire; do ' 'echo waiting ' 'for astaire ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-astaire', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'homesteadlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': 'Created new replica set ' '"homestead-57586d6cdc"', 'reason': 'NewReplicaSetCreated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': None, 'ready_replicas': None, 'replicas': None, 'unavailable_replicas': None, 'updated_replicas': None}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homestead', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/homestead', 'uid': 'e112f04c-bc51-4e58-a54d-8f1880bd09ab', 'resourceVersion': '1241328', 'generation': 1, 'creationTimestamp': '2020-07-16T14:32:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homestead'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homestead', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'homesteadlogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-astaire', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup astaire; do echo waiting for astaire to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead', 'image': 'ollivier/clearwater-homestead:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'homesteadlogs', 'mountPath': '/var/log/homestead'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/homestead/homestead_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'homesteadlogs', 'mountPath': '/var/log/homestead'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:32:35Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'NewReplicaSetCreated', 'message': 'Created new replica set "homestead-57586d6cdc"'}]}}} 2020-07-16 14:32:36,129 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 2, 2, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test4'}, 'managed_fields': None, 'name': 'live-test4', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241121', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test4', 'uid': 'b0d44bb2-0c16-4b80-813a-381e5cb8c2f1'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test4'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test4'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test4', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 11, 2, 2, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 11, 2, 13, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test4-74f5c7c95f" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 31, 58, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 31, 58, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test4', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test4', 'uid': 'b0d44bb2-0c16-4b80-813a-381e5cb8c2f1', 'resourceVersion': '1241121', 'generation': 1, 'creationTimestamp': '2020-07-10T11:02:02Z', 'labels': {'run': 'live-test4'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test4'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test4'}}, 'spec': {'containers': [{'name': 'live-test4', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T11:02:13Z', 'lastTransitionTime': '2020-07-10T11:02:02Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test4-74f5c7c95f" has successfully progressed.'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-16T14:31:58Z', 'lastTransitionTime': '2020-07-16T14:31:58Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-16 14:32:36,140 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'ellis', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241355', 'self_link': '/apis/apps/v1/namespaces/default/deployments/ellis', 'uid': 'd83c33af-71ff-49fc-b323-649742f54f07'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'ellis'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'ellis'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-ellis:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 80}, 'timeout_seconds': 1}, 'name': 'ellis', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 80, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 80}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'homestead-prov; ' 'do echo ' 'waiting for ' 'homestead-prov ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead-prov', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'sprout; do ' 'echo waiting ' 'for sprout ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': 'ReplicaSet "ellis-57b84b6dd7" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'ellis', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/ellis', 'uid': 'd83c33af-71ff-49fc-b323-649742f54f07', 'resourceVersion': '1241355', 'generation': 1, 'creationTimestamp': '2020-07-16T14:32:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'ellis'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'ellis'}}, 'spec': {'initContainers': [{'name': 'wait-on-homestead-prov', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead-prov; do echo waiting for homestead-prov to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'ellis', 'image': 'ollivier/clearwater-ellis:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 80, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'tcpSocket': {'port': 80}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 80}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-16T14:32:35Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:32:35Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "ellis-57b84b6dd7" is progressing.'}]}}} 2020-07-16 14:32:36,160 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homer', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241326', 'self_link': '/apis/apps/v1/namespaces/default/deployments/homer', 'uid': '10c5b30b-97b5-4a4e-b334-ef77a1a652ad'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'homer'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'homer'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homer:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'name': 'homer', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': 'Created new replica set ' '"homer-74dd4556d9"', 'reason': 'NewReplicaSetCreated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': None, 'ready_replicas': None, 'replicas': None, 'unavailable_replicas': None, 'updated_replicas': None}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homer', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/homer', 'uid': '10c5b30b-97b5-4a4e-b334-ef77a1a652ad', 'resourceVersion': '1241326', 'generation': 1, 'creationTimestamp': '2020-07-16T14:32:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homer'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homer'}}, 'spec': {'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homer', 'image': 'ollivier/clearwater-homer:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'tcpSocket': {'port': 7888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 7888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:32:35Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'NewReplicaSetCreated', 'message': 'Created new replica set "homer-74dd4556d9"'}]}}} 2020-07-16 14:32:36,187 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homestead-prov', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241380', 'self_link': '/apis/apps/v1/namespaces/default/deployments/homestead-prov', 'uid': '67040119-0611-4a1f-9d68-cf00bbff900e'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'homestead-prov'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'homestead-prov', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead-prov:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead-prov', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8889, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'homestead; ' 'do echo ' 'waiting for ' 'homestead to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': 'Created new replica set ' '"homestead-prov-756c8bff5d"', 'reason': 'NewReplicaSetCreated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': None, 'ready_replicas': None, 'replicas': None, 'unavailable_replicas': None, 'updated_replicas': None}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homestead-prov', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/homestead-prov', 'uid': '67040119-0611-4a1f-9d68-cf00bbff900e', 'resourceVersion': '1241380', 'generation': 1, 'creationTimestamp': '2020-07-16T14:32:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homestead-prov'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homestead-prov', 'snmp': 'enabled'}}, 'spec': {'initContainers': [{'name': 'wait-on-homestead', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead-prov', 'image': 'ollivier/clearwater-homestead-prov:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8889, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:32:35Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'NewReplicaSetCreated', 'message': 'Created new replica set "homestead-prov-756c8bff5d"'}]}}} 2020-07-16 14:32:36,207 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'ralf', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241340', 'self_link': '/apis/apps/v1/namespaces/default/deployments/ralf', 'uid': '4f24a10d-9c29-4114-b079-0f83735d4688'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'ralf'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'ralf', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-ralf:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'name': 'ralf', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 10888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'ralflogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': None, 'observed_generation': None, 'ready_replicas': None, 'replicas': None, 'unavailable_replicas': None, 'updated_replicas': None}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'ralf', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/ralf', 'uid': '4f24a10d-9c29-4114-b079-0f83735d4688', 'resourceVersion': '1241340', 'generation': 1, 'creationTimestamp': '2020-07-16T14:32:35Z'}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'ralf'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'ralf', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'ralflogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'ralf', 'image': 'ollivier/clearwater-ralf:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 10888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}], 'livenessProbe': {'tcpSocket': {'port': 10888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 10888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {}}} 2020-07-16 14:32:36,230 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 10, 49, 36, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test1'}, 'managed_fields': None, 'name': 'live-test1', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241162', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test1', 'uid': '0fe55582-d17d-4d84-bef8-ad96e8e08b3a'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test1'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test1'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test1', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 10, 49, 37, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 10, 50, 2, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test1-677ffc8869" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 5, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 5, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test1', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test1', 'uid': '0fe55582-d17d-4d84-bef8-ad96e8e08b3a', 'resourceVersion': '1241162', 'generation': 1, 'creationTimestamp': '2020-07-10T10:49:36Z', 'labels': {'run': 'live-test1'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test1'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test1'}}, 'spec': {'containers': [{'name': 'live-test1', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T10:50:02Z', 'lastTransitionTime': '2020-07-10T10:49:37Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test1-677ffc8869" has successfully progressed.'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-16T14:32:05Z', 'lastTransitionTime': '2020-07-16T14:32:05Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-16 14:32:36,249 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 10, 58, 1, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test2'}, 'managed_fields': None, 'name': 'live-test2', 'namespace': 'default', 'owner_references': None, 'resource_version': '1240104', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test2', 'uid': 'c6c9caaa-5133-4416-b435-70577cb956d5'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test2'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test2'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test2', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 10, 58, 2, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 10, 58, 12, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test2-54d9dcd87" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 28, 3, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 28, 3, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test2', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test2', 'uid': 'c6c9caaa-5133-4416-b435-70577cb956d5', 'resourceVersion': '1240104', 'generation': 1, 'creationTimestamp': '2020-07-10T10:58:01Z', 'labels': {'run': 'live-test2'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test2'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test2'}}, 'spec': {'containers': [{'name': 'live-test2', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T10:58:12Z', 'lastTransitionTime': '2020-07-10T10:58:02Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test2-54d9dcd87" has successfully progressed.'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-16T14:28:03Z', 'lastTransitionTime': '2020-07-16T14:28:03Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-16 14:32:36,260 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'bono', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241301', 'self_link': '/apis/apps/v1/namespaces/default/deployments/bono', 'uid': 'd1d5a413-946b-49c3-a5b6-1f554725ba3a'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'bono'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'bono', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-bono:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 ' '5060 ' '5062']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'bono', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 3478, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5060, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5062, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5060, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'UDP'}, {'container_port': 5062, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'UDP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 ' '5060 ' '5062']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/bono', 'mount_propagation': None, 'name': 'bonologs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/bono/bono_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/bono', 'mount_propagation': None, 'name': 'bonologs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'sprout; do ' 'echo waiting ' 'for sprout ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'bonologs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': 'ReplicaSet "bono-5cdb7bfcdd" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'bono', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/bono', 'uid': 'd1d5a413-946b-49c3-a5b6-1f554725ba3a', 'resourceVersion': '1241301', 'generation': 1, 'creationTimestamp': '2020-07-16T14:32:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'bono'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'bono', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'bonologs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'bono', 'image': 'ollivier/clearwater-bono:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 3478, 'protocol': 'TCP'}, {'containerPort': 5060, 'protocol': 'TCP'}, {'containerPort': 5062, 'protocol': 'TCP'}, {'containerPort': 5060, 'protocol': 'UDP'}, {'containerPort': 5062, 'protocol': 'UDP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'bonologs', 'mountPath': '/var/log/bono'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 5062']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 5062']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/bono/bono_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'bonologs', 'mountPath': '/var/log/bono'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-16T14:32:35Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:32:35Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "bono-5cdb7bfcdd" is progressing.'}]}}} 2020-07-16 14:32:36,286 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'cassandra', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241361', 'self_link': '/apis/apps/v1/namespaces/default/deployments/cassandra', 'uid': '38c0a876-12ce-40c0-b323-212af3468120'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'cassandra'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'cassandra'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-cassandra:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 ' '9042 ' '9160']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 600, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'cassandra', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7001, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 9042, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 9160, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 ' '9042 ' '9160']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'etcd; do ' 'echo waiting ' 'for etcd to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-etcd', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': 'ReplicaSet "cassandra-76f5c4d86c" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'cassandra', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/cassandra', 'uid': '38c0a876-12ce-40c0-b323-212af3468120', 'resourceVersion': '1241361', 'generation': 1, 'creationTimestamp': '2020-07-16T14:32:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'cassandra'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'cassandra'}}, 'spec': {'initContainers': [{'name': 'wait-on-etcd', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup etcd; do echo waiting for etcd to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'cassandra', 'image': 'ollivier/clearwater-cassandra:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7001, 'protocol': 'TCP'}, {'containerPort': 9042, 'protocol': 'TCP'}, {'containerPort': 9160, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 9160']}, 'initialDelaySeconds': 600, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 9160']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-16T14:32:35Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:32:35Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "cassandra-76f5c4d86c" is progressing.'}]}}} 2020-07-16 14:32:36,318 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'sprout', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241344', 'self_link': '/apis/apps/v1/namespaces/default/deployments/sprout', 'uid': '40a25977-918e-4559-a2b3-31b12ddf0799'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'sprout'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'sprout', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-sprout:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 3, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'sprout', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'ralf; do ' 'echo waiting ' 'for ralf to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-ralf', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'chronos; do ' 'echo waiting ' 'for chronos ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-chronos', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'homestead; ' 'do echo ' 'waiting for ' 'homestead to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'sproutlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': None, 'observed_generation': None, 'ready_replicas': None, 'replicas': None, 'unavailable_replicas': None, 'updated_replicas': None}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'sprout', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/sprout', 'uid': '40a25977-918e-4559-a2b3-31b12ddf0799', 'resourceVersion': '1241344', 'generation': 1, 'creationTimestamp': '2020-07-16T14:32:35Z'}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'sprout'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'sprout', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'sproutlogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-ralf', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup ralf; do echo waiting for ralf to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-chronos', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup chronos; do echo waiting for chronos to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-homestead', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'sprout', 'image': 'ollivier/clearwater-sprout:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 3, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {}}} 2020-07-16 14:32:36,354 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 22, 41, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test6'}, 'managed_fields': None, 'name': 'live-test6', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241244', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test6', 'uid': '2c504f10-f046-4779-8b04-c6cb52c7bf86'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test6'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test6'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test6', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 11, 22, 41, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 11, 22, 50, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test6-988dbb567" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 31, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 31, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test6', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test6', 'uid': '2c504f10-f046-4779-8b04-c6cb52c7bf86', 'resourceVersion': '1241244', 'generation': 1, 'creationTimestamp': '2020-07-10T11:22:41Z', 'labels': {'run': 'live-test6'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test6'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test6'}}, 'spec': {'containers': [{'name': 'live-test6', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T11:22:50Z', 'lastTransitionTime': '2020-07-10T11:22:41Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test6-988dbb567" has successfully progressed.'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-16T14:32:31Z', 'lastTransitionTime': '2020-07-16T14:32:31Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-16 14:32:36,372 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 54, 47, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test7'}, 'managed_fields': None, 'name': 'live-test7', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241128', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test7', 'uid': '7bb42069-0e58-44eb-97bf-37be24b29e9c'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test7'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test7'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test7', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 11, 54, 47, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 11, 54, 54, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test7-5dd99f9b45" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 31, 59, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 31, 59, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test7', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test7', 'uid': '7bb42069-0e58-44eb-97bf-37be24b29e9c', 'resourceVersion': '1241128', 'generation': 1, 'creationTimestamp': '2020-07-10T11:54:47Z', 'labels': {'run': 'live-test7'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test7'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test7'}}, 'spec': {'containers': [{'name': 'live-test7', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T11:54:54Z', 'lastTransitionTime': '2020-07-10T11:54:47Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test7-5dd99f9b45" has successfully progressed.'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-16T14:31:59Z', 'lastTransitionTime': '2020-07-16T14:31:59Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-16 14:32:36,384 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homer', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241389', 'self_link': '/apis/apps/v1/namespaces/default/deployments/homer', 'uid': '10c5b30b-97b5-4a4e-b334-ef77a1a652ad'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'homer'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'homer'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homer:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'name': 'homer', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': 'Created new replica set ' '"homer-74dd4556d9"', 'reason': 'NewReplicaSetCreated', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': None, 'unavailable_replicas': 1, 'updated_replicas': None}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homer', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/homer', 'uid': '10c5b30b-97b5-4a4e-b334-ef77a1a652ad', 'resourceVersion': '1241389', 'generation': 1, 'creationTimestamp': '2020-07-16T14:32:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homer'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homer'}}, 'spec': {'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homer', 'image': 'ollivier/clearwater-homer:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'tcpSocket': {'port': 7888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 7888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:32:35Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'NewReplicaSetCreated', 'message': 'Created new replica set "homer-74dd4556d9"'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-16T14:32:35Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-16 14:32:36,410 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homestead', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241394', 'self_link': '/apis/apps/v1/namespaces/default/deployments/homestead', 'uid': 'e112f04c-bc51-4e58-a54d-8f1880bd09ab'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'homestead'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'homestead', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/homestead', 'mount_propagation': None, 'name': 'homesteadlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/homestead/homestead_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/homestead', 'mount_propagation': None, 'name': 'homesteadlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'astaire; do ' 'echo waiting ' 'for astaire ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-astaire', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'homesteadlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': 'Created new replica set ' '"homestead-57586d6cdc"', 'reason': 'NewReplicaSetCreated', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': None, 'unavailable_replicas': 1, 'updated_replicas': None}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homestead', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/homestead', 'uid': 'e112f04c-bc51-4e58-a54d-8f1880bd09ab', 'resourceVersion': '1241394', 'generation': 1, 'creationTimestamp': '2020-07-16T14:32:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homestead'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homestead', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'homesteadlogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-astaire', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup astaire; do echo waiting for astaire to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead', 'image': 'ollivier/clearwater-homestead:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'homesteadlogs', 'mountPath': '/var/log/homestead'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/homestead/homestead_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'homesteadlogs', 'mountPath': '/var/log/homestead'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:32:35Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'NewReplicaSetCreated', 'message': 'Created new replica set "homestead-57586d6cdc"'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-16T14:32:35Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-16 14:32:36,438 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'ralf', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241395', 'self_link': '/apis/apps/v1/namespaces/default/deployments/ralf', 'uid': '4f24a10d-9c29-4114-b079-0f83735d4688'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'ralf'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'ralf', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-ralf:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'name': 'ralf', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 10888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'ralflogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': 'Created new replica set ' '"ralf-57c4654cb8"', 'reason': 'NewReplicaSetCreated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': None, 'ready_replicas': None, 'replicas': None, 'unavailable_replicas': None, 'updated_replicas': None}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'ralf', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/ralf', 'uid': '4f24a10d-9c29-4114-b079-0f83735d4688', 'resourceVersion': '1241395', 'generation': 1, 'creationTimestamp': '2020-07-16T14:32:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'ralf'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'ralf', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'ralflogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'ralf', 'image': 'ollivier/clearwater-ralf:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 10888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}], 'livenessProbe': {'tcpSocket': {'port': 10888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 10888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:32:35Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'NewReplicaSetCreated', 'message': 'Created new replica set "ralf-57c4654cb8"'}]}}} 2020-07-16 14:32:36,476 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'sprout', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241398', 'self_link': '/apis/apps/v1/namespaces/default/deployments/sprout', 'uid': '40a25977-918e-4559-a2b3-31b12ddf0799'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'sprout'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'sprout', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-sprout:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 3, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'sprout', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'ralf; do ' 'echo waiting ' 'for ralf to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-ralf', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'chronos; do ' 'echo waiting ' 'for chronos ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-chronos', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'homestead; ' 'do echo ' 'waiting for ' 'homestead to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'sproutlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': 'Created new replica set ' '"sprout-686cc64cfb"', 'reason': 'NewReplicaSetCreated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': None, 'ready_replicas': None, 'replicas': None, 'unavailable_replicas': None, 'updated_replicas': None}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'sprout', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/sprout', 'uid': '40a25977-918e-4559-a2b3-31b12ddf0799', 'resourceVersion': '1241398', 'generation': 1, 'creationTimestamp': '2020-07-16T14:32:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'sprout'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'sprout', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'sproutlogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-ralf', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup ralf; do echo waiting for ralf to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-chronos', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup chronos; do echo waiting for chronos to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-homestead', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'sprout', 'image': 'ollivier/clearwater-sprout:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 3, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:32:35Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'NewReplicaSetCreated', 'message': 'Created new replica set "sprout-686cc64cfb"'}]}}} 2020-07-16 14:32:36,506 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'etcd', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241404', 'self_link': '/apis/apps/v1/namespaces/default/deployments/etcd', 'uid': '58ec500f-8a45-4870-a91a-ccafbbc23315'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'instance-type': 'etcd-pod'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'instance-type': 'etcd-pod'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': ['--name', '$(MY_POD_NAME)', '--advertise-client-urls', 'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', '--listen-client-urls', 'http://0.0.0.0:2379,http://0.0.0.0:4001', '--initial-advertise-peer-urls', 'http://$(MY_POD_IP):2380', '--listen-peer-urls', 'http://0.0.0.0:2380', '--initial-cluster', '$(MY_POD_NAME)=http://$(MY_POD_IP):2380', '--initial-cluster-state', 'new'], 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}, {'name': 'MY_POD_NAME', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'metadata.name'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': None, 'image': 'quay.io/coreos/etcd:v2.2.5', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 300, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 4001}, 'timeout_seconds': 1}, 'name': 'etcd', 'ports': [{'container_port': 2379, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 2380, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 4001, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 4001}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': 'ReplicaSet "etcd-5cbf55c8c" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'etcd', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/etcd', 'uid': '58ec500f-8a45-4870-a91a-ccafbbc23315', 'resourceVersion': '1241404', 'generation': 1, 'creationTimestamp': '2020-07-16T14:32:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'instance-type': 'etcd-pod'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'instance-type': 'etcd-pod'}}, 'spec': {'containers': [{'name': 'etcd', 'image': 'quay.io/coreos/etcd:v2.2.5', 'args': ['--name', '$(MY_POD_NAME)', '--advertise-client-urls', 'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', '--listen-client-urls', 'http://0.0.0.0:2379,http://0.0.0.0:4001', '--initial-advertise-peer-urls', 'http://$(MY_POD_IP):2380', '--listen-peer-urls', 'http://0.0.0.0:2380', '--initial-cluster', '$(MY_POD_NAME)=http://$(MY_POD_IP):2380', '--initial-cluster-state', 'new'], 'ports': [{'containerPort': 2379, 'protocol': 'TCP'}, {'containerPort': 2380, 'protocol': 'TCP'}, {'containerPort': 4001, 'protocol': 'TCP'}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}, {'name': 'MY_POD_NAME', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'metadata.name'}}}], 'resources': {}, 'livenessProbe': {'tcpSocket': {'port': 4001}, 'initialDelaySeconds': 300, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 4001}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-16T14:32:35Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:32:35Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "etcd-5cbf55c8c" is progressing.'}]}}} 2020-07-16 14:32:36,523 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homer', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241406', 'self_link': '/apis/apps/v1/namespaces/default/deployments/homer', 'uid': '10c5b30b-97b5-4a4e-b334-ef77a1a652ad'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'homer'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'homer'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homer:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'name': 'homer', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 36, tzinfo=tzlocal()), 'message': 'ReplicaSet "homer-74dd4556d9" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homer', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/homer', 'uid': '10c5b30b-97b5-4a4e-b334-ef77a1a652ad', 'resourceVersion': '1241406', 'generation': 1, 'creationTimestamp': '2020-07-16T14:32:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homer'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homer'}}, 'spec': {'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homer', 'image': 'ollivier/clearwater-homer:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'tcpSocket': {'port': 7888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 7888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-16T14:32:35Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:32:36Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "homer-74dd4556d9" is progressing.'}]}}} 2020-07-16 14:32:36,546 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homestead', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241409', 'self_link': '/apis/apps/v1/namespaces/default/deployments/homestead', 'uid': 'e112f04c-bc51-4e58-a54d-8f1880bd09ab'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'homestead'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'homestead', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/homestead', 'mount_propagation': None, 'name': 'homesteadlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/homestead/homestead_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/homestead', 'mount_propagation': None, 'name': 'homesteadlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'astaire; do ' 'echo waiting ' 'for astaire ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-astaire', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'homesteadlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 36, tzinfo=tzlocal()), 'message': 'ReplicaSet "homestead-57586d6cdc" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homestead', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/homestead', 'uid': 'e112f04c-bc51-4e58-a54d-8f1880bd09ab', 'resourceVersion': '1241409', 'generation': 1, 'creationTimestamp': '2020-07-16T14:32:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homestead'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homestead', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'homesteadlogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-astaire', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup astaire; do echo waiting for astaire to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead', 'image': 'ollivier/clearwater-homestead:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'homesteadlogs', 'mountPath': '/var/log/homestead'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/homestead/homestead_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'homesteadlogs', 'mountPath': '/var/log/homestead'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-16T14:32:35Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:32:36Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "homestead-57586d6cdc" is progressing.'}]}}} 2020-07-16 14:32:36,596 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homestead-prov', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241412', 'self_link': '/apis/apps/v1/namespaces/default/deployments/homestead-prov', 'uid': '67040119-0611-4a1f-9d68-cf00bbff900e'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'homestead-prov'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'homestead-prov', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead-prov:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead-prov', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8889, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'homestead; ' 'do echo ' 'waiting for ' 'homestead to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': 'Created new replica set ' '"homestead-prov-756c8bff5d"', 'reason': 'NewReplicaSetCreated', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 36, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 36, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': None, 'unavailable_replicas': 1, 'updated_replicas': None}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homestead-prov', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/homestead-prov', 'uid': '67040119-0611-4a1f-9d68-cf00bbff900e', 'resourceVersion': '1241412', 'generation': 1, 'creationTimestamp': '2020-07-16T14:32:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homestead-prov'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homestead-prov', 'snmp': 'enabled'}}, 'spec': {'initContainers': [{'name': 'wait-on-homestead', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead-prov', 'image': 'ollivier/clearwater-homestead-prov:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8889, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:32:35Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'NewReplicaSetCreated', 'message': 'Created new replica set "homestead-prov-756c8bff5d"'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-16T14:32:36Z', 'lastTransitionTime': '2020-07-16T14:32:36Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-16 14:32:36,640 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'ralf', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241415', 'self_link': '/apis/apps/v1/namespaces/default/deployments/ralf', 'uid': '4f24a10d-9c29-4114-b079-0f83735d4688'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'ralf'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'ralf', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-ralf:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'name': 'ralf', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 10888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'ralflogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': 'Created new replica set ' '"ralf-57c4654cb8"', 'reason': 'NewReplicaSetCreated', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 36, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 36, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': None, 'unavailable_replicas': 1, 'updated_replicas': None}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'ralf', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/ralf', 'uid': '4f24a10d-9c29-4114-b079-0f83735d4688', 'resourceVersion': '1241415', 'generation': 1, 'creationTimestamp': '2020-07-16T14:32:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'ralf'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'ralf', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'ralflogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'ralf', 'image': 'ollivier/clearwater-ralf:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 10888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}], 'livenessProbe': {'tcpSocket': {'port': 10888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 10888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:32:35Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'NewReplicaSetCreated', 'message': 'Created new replica set "ralf-57c4654cb8"'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-16T14:32:36Z', 'lastTransitionTime': '2020-07-16T14:32:36Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-16 14:32:36,773 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'sprout', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241417', 'self_link': '/apis/apps/v1/namespaces/default/deployments/sprout', 'uid': '40a25977-918e-4559-a2b3-31b12ddf0799'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'sprout'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'sprout', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-sprout:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 3, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'sprout', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'ralf; do ' 'echo waiting ' 'for ralf to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-ralf', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'chronos; do ' 'echo waiting ' 'for chronos ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-chronos', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'homestead; ' 'do echo ' 'waiting for ' 'homestead to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'sproutlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': 'Created new replica set ' '"sprout-686cc64cfb"', 'reason': 'NewReplicaSetCreated', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 36, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 36, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': None, 'unavailable_replicas': 1, 'updated_replicas': None}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'sprout', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/sprout', 'uid': '40a25977-918e-4559-a2b3-31b12ddf0799', 'resourceVersion': '1241417', 'generation': 1, 'creationTimestamp': '2020-07-16T14:32:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'sprout'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'sprout', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'sproutlogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-ralf', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup ralf; do echo waiting for ralf to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-chronos', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup chronos; do echo waiting for chronos to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-homestead', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'sprout', 'image': 'ollivier/clearwater-sprout:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 3, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:32:35Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'NewReplicaSetCreated', 'message': 'Created new replica set "sprout-686cc64cfb"'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-16T14:32:36Z', 'lastTransitionTime': '2020-07-16T14:32:36Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-16 14:32:36,803 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homestead-prov', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241419', 'self_link': '/apis/apps/v1/namespaces/default/deployments/homestead-prov', 'uid': '67040119-0611-4a1f-9d68-cf00bbff900e'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'homestead-prov'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'homestead-prov', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead-prov:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead-prov', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8889, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'homestead; ' 'do echo ' 'waiting for ' 'homestead to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 36, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 36, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 36, tzinfo=tzlocal()), 'message': 'ReplicaSet "homestead-prov-756c8bff5d" ' 'is progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homestead-prov', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/homestead-prov', 'uid': '67040119-0611-4a1f-9d68-cf00bbff900e', 'resourceVersion': '1241419', 'generation': 1, 'creationTimestamp': '2020-07-16T14:32:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homestead-prov'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homestead-prov', 'snmp': 'enabled'}}, 'spec': {'initContainers': [{'name': 'wait-on-homestead', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead-prov', 'image': 'ollivier/clearwater-homestead-prov:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8889, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-16T14:32:36Z', 'lastTransitionTime': '2020-07-16T14:32:36Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:32:36Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "homestead-prov-756c8bff5d" is progressing.'}]}}} 2020-07-16 14:32:36,822 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'ralf', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241420', 'self_link': '/apis/apps/v1/namespaces/default/deployments/ralf', 'uid': '4f24a10d-9c29-4114-b079-0f83735d4688'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'ralf'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'ralf', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-ralf:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'name': 'ralf', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 10888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'ralflogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 36, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 36, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 36, tzinfo=tzlocal()), 'message': 'ReplicaSet "ralf-57c4654cb8" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'ralf', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/ralf', 'uid': '4f24a10d-9c29-4114-b079-0f83735d4688', 'resourceVersion': '1241420', 'generation': 1, 'creationTimestamp': '2020-07-16T14:32:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'ralf'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'ralf', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'ralflogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'ralf', 'image': 'ollivier/clearwater-ralf:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 10888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}], 'livenessProbe': {'tcpSocket': {'port': 10888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 10888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-16T14:32:36Z', 'lastTransitionTime': '2020-07-16T14:32:36Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:32:36Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "ralf-57c4654cb8" is progressing.'}]}}} 2020-07-16 14:32:36,848 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'sprout', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241421', 'self_link': '/apis/apps/v1/namespaces/default/deployments/sprout', 'uid': '40a25977-918e-4559-a2b3-31b12ddf0799'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'sprout'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'sprout', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-sprout:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 3, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'sprout', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'ralf; do ' 'echo waiting ' 'for ralf to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-ralf', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'chronos; do ' 'echo waiting ' 'for chronos ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-chronos', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'homestead; ' 'do echo ' 'waiting for ' 'homestead to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'sproutlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 36, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 36, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 36, tzinfo=tzlocal()), 'message': 'ReplicaSet "sprout-686cc64cfb" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'sprout', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/sprout', 'uid': '40a25977-918e-4559-a2b3-31b12ddf0799', 'resourceVersion': '1241421', 'generation': 1, 'creationTimestamp': '2020-07-16T14:32:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'sprout'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'sprout', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'sproutlogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-ralf', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup ralf; do echo waiting for ralf to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-chronos', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup chronos; do echo waiting for chronos to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-homestead', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'sprout', 'image': 'ollivier/clearwater-sprout:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 3, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-16T14:32:36Z', 'lastTransitionTime': '2020-07-16T14:32:36Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:32:36Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "sprout-686cc64cfb" is progressing.'}]}}} 2020-07-16 14:32:55,852 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'etcd', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241517', 'self_link': '/apis/apps/v1/namespaces/default/deployments/etcd', 'uid': '58ec500f-8a45-4870-a91a-ccafbbc23315'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'instance-type': 'etcd-pod'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'instance-type': 'etcd-pod'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': ['--name', '$(MY_POD_NAME)', '--advertise-client-urls', 'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', '--listen-client-urls', 'http://0.0.0.0:2379,http://0.0.0.0:4001', '--initial-advertise-peer-urls', 'http://$(MY_POD_IP):2380', '--listen-peer-urls', 'http://0.0.0.0:2380', '--initial-cluster', '$(MY_POD_NAME)=http://$(MY_POD_IP):2380', '--initial-cluster-state', 'new'], 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}, {'name': 'MY_POD_NAME', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'metadata.name'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': None, 'image': 'quay.io/coreos/etcd:v2.2.5', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 300, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 4001}, 'timeout_seconds': 1}, 'name': 'etcd', 'ports': [{'container_port': 2379, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 2380, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 4001, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 4001}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 55, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 55, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 32, 55, tzinfo=tzlocal()), 'message': 'ReplicaSet "etcd-5cbf55c8c" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'etcd', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/etcd', 'uid': '58ec500f-8a45-4870-a91a-ccafbbc23315', 'resourceVersion': '1241517', 'generation': 1, 'creationTimestamp': '2020-07-16T14:32:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'instance-type': 'etcd-pod'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'instance-type': 'etcd-pod'}}, 'spec': {'containers': [{'name': 'etcd', 'image': 'quay.io/coreos/etcd:v2.2.5', 'args': ['--name', '$(MY_POD_NAME)', '--advertise-client-urls', 'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', '--listen-client-urls', 'http://0.0.0.0:2379,http://0.0.0.0:4001', '--initial-advertise-peer-urls', 'http://$(MY_POD_IP):2380', '--listen-peer-urls', 'http://0.0.0.0:2380', '--initial-cluster', '$(MY_POD_NAME)=http://$(MY_POD_IP):2380', '--initial-cluster-state', 'new'], 'ports': [{'containerPort': 2379, 'protocol': 'TCP'}, {'containerPort': 2380, 'protocol': 'TCP'}, {'containerPort': 4001, 'protocol': 'TCP'}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}, {'name': 'MY_POD_NAME', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'metadata.name'}}}], 'resources': {}, 'livenessProbe': {'tcpSocket': {'port': 4001}, 'initialDelaySeconds': 300, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 4001}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:32:55Z', 'lastTransitionTime': '2020-07-16T14:32:55Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:32:55Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "etcd-5cbf55c8c" has successfully progressed.'}]}}} 2020-07-16 14:32:55,871 - functest_kubernetes.ims.ims - INFO - etcd started in 20.88 sec 2020-07-16 14:33:04,101 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 0, 4, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test3'}, 'managed_fields': None, 'name': 'live-test3', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241535', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test3', 'uid': '93bd8802-4153-4590-aee1-cd3b8f208f06'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test3'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test3'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test3', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 11, 0, 4, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 11, 0, 17, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test3-6556bf7d77" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 33, 4, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 33, 4, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test3', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test3', 'uid': '93bd8802-4153-4590-aee1-cd3b8f208f06', 'resourceVersion': '1241535', 'generation': 1, 'creationTimestamp': '2020-07-10T11:00:04Z', 'labels': {'run': 'live-test3'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test3'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test3'}}, 'spec': {'containers': [{'name': 'live-test3', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T11:00:17Z', 'lastTransitionTime': '2020-07-10T11:00:04Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test3-6556bf7d77" has successfully progressed.'}, {'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:33:04Z', 'lastTransitionTime': '2020-07-16T14:33:04Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}]}}} 2020-07-16 14:33:05,191 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 0, 4, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test3'}, 'managed_fields': None, 'name': 'live-test3', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241542', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test3', 'uid': '93bd8802-4153-4590-aee1-cd3b8f208f06'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test3'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test3'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test3', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 11, 0, 4, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 11, 0, 17, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test3-6556bf7d77" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 33, 5, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 33, 5, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test3', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test3', 'uid': '93bd8802-4153-4590-aee1-cd3b8f208f06', 'resourceVersion': '1241542', 'generation': 1, 'creationTimestamp': '2020-07-10T11:00:04Z', 'labels': {'run': 'live-test3'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test3'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test3'}}, 'spec': {'containers': [{'name': 'live-test3', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T11:00:17Z', 'lastTransitionTime': '2020-07-10T11:00:04Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test3-6556bf7d77" has successfully progressed.'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-16T14:33:05Z', 'lastTransitionTime': '2020-07-16T14:33:05Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-16 14:33:08,159 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 10, 58, 1, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test2'}, 'managed_fields': None, 'name': 'live-test2', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241552', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test2', 'uid': 'c6c9caaa-5133-4416-b435-70577cb956d5'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test2'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test2'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test2', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 10, 58, 2, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 10, 58, 12, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test2-54d9dcd87" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 33, 8, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 33, 8, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test2', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test2', 'uid': 'c6c9caaa-5133-4416-b435-70577cb956d5', 'resourceVersion': '1241552', 'generation': 1, 'creationTimestamp': '2020-07-10T10:58:01Z', 'labels': {'run': 'live-test2'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test2'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test2'}}, 'spec': {'containers': [{'name': 'live-test2', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T10:58:12Z', 'lastTransitionTime': '2020-07-10T10:58:02Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test2-54d9dcd87" has successfully progressed.'}, {'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:33:08Z', 'lastTransitionTime': '2020-07-16T14:33:08Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}]}}} 2020-07-16 14:33:09,145 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 10, 58, 1, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test2'}, 'managed_fields': None, 'name': 'live-test2', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241557', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test2', 'uid': 'c6c9caaa-5133-4416-b435-70577cb956d5'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test2'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test2'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test2', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 10, 58, 2, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 10, 58, 12, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test2-54d9dcd87" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 33, 9, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 33, 9, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test2', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test2', 'uid': 'c6c9caaa-5133-4416-b435-70577cb956d5', 'resourceVersion': '1241557', 'generation': 1, 'creationTimestamp': '2020-07-10T10:58:01Z', 'labels': {'run': 'live-test2'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test2'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test2'}}, 'spec': {'containers': [{'name': 'live-test2', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T10:58:12Z', 'lastTransitionTime': '2020-07-10T10:58:02Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test2-54d9dcd87" has successfully progressed.'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-16T14:33:09Z', 'lastTransitionTime': '2020-07-16T14:33:09Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-16 14:34:29,004 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'cassandra', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241730', 'self_link': '/apis/apps/v1/namespaces/default/deployments/cassandra', 'uid': '38c0a876-12ce-40c0-b323-212af3468120'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'cassandra'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'cassandra'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-cassandra:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 ' '9042 ' '9160']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 600, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'cassandra', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7001, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 9042, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 9160, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 ' '9042 ' '9160']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'etcd; do ' 'echo waiting ' 'for etcd to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-etcd', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 16, 14, 34, 28, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 34, 28, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 34, 28, tzinfo=tzlocal()), 'message': 'ReplicaSet "cassandra-76f5c4d86c" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'cassandra', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/cassandra', 'uid': '38c0a876-12ce-40c0-b323-212af3468120', 'resourceVersion': '1241730', 'generation': 1, 'creationTimestamp': '2020-07-16T14:32:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'cassandra'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'cassandra'}}, 'spec': {'initContainers': [{'name': 'wait-on-etcd', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup etcd; do echo waiting for etcd to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'cassandra', 'image': 'ollivier/clearwater-cassandra:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7001, 'protocol': 'TCP'}, {'containerPort': 9042, 'protocol': 'TCP'}, {'containerPort': 9160, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 9160']}, 'initialDelaySeconds': 600, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 9160']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:34:28Z', 'lastTransitionTime': '2020-07-16T14:34:28Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:34:28Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "cassandra-76f5c4d86c" has successfully progressed.'}]}}} 2020-07-16 14:34:29,023 - functest_kubernetes.ims.ims - INFO - cassandra started in 114.03 sec 2020-07-16 14:34:31,326 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 6, 27, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test5'}, 'managed_fields': None, 'name': 'live-test5', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241736', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test5', 'uid': '386005c8-1f07-46dc-adf0-77ceea373c63'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test5'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test5'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test5', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 11, 6, 27, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 11, 6, 40, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test5-b6fcb7757" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 34, 31, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 34, 31, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test5', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test5', 'uid': '386005c8-1f07-46dc-adf0-77ceea373c63', 'resourceVersion': '1241736', 'generation': 1, 'creationTimestamp': '2020-07-10T11:06:27Z', 'labels': {'run': 'live-test5'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test5'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test5'}}, 'spec': {'containers': [{'name': 'live-test5', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T11:06:40Z', 'lastTransitionTime': '2020-07-10T11:06:27Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test5-b6fcb7757" has successfully progressed.'}, {'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:34:31Z', 'lastTransitionTime': '2020-07-16T14:34:31Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}]}}} 2020-07-16 14:34:33,325 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 6, 27, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test5'}, 'managed_fields': None, 'name': 'live-test5', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241743', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test5', 'uid': '386005c8-1f07-46dc-adf0-77ceea373c63'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test5'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test5'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test5', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 11, 6, 27, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 11, 6, 40, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test5-b6fcb7757" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 34, 33, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 34, 33, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test5', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test5', 'uid': '386005c8-1f07-46dc-adf0-77ceea373c63', 'resourceVersion': '1241743', 'generation': 1, 'creationTimestamp': '2020-07-10T11:06:27Z', 'labels': {'run': 'live-test5'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test5'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test5'}}, 'spec': {'containers': [{'name': 'live-test5', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T11:06:40Z', 'lastTransitionTime': '2020-07-10T11:06:27Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test5-b6fcb7757" has successfully progressed.'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-16T14:34:33Z', 'lastTransitionTime': '2020-07-16T14:34:33Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-16 14:35:07,001 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homer', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241860', 'self_link': '/apis/apps/v1/namespaces/default/deployments/homer', 'uid': '10c5b30b-97b5-4a4e-b334-ef77a1a652ad'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'homer'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'homer'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homer:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'name': 'homer', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 16, 14, 35, 6, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 35, 6, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 35, 6, tzinfo=tzlocal()), 'message': 'ReplicaSet "homer-74dd4556d9" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homer', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/homer', 'uid': '10c5b30b-97b5-4a4e-b334-ef77a1a652ad', 'resourceVersion': '1241860', 'generation': 1, 'creationTimestamp': '2020-07-16T14:32:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homer'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homer'}}, 'spec': {'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homer', 'image': 'ollivier/clearwater-homer:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'tcpSocket': {'port': 7888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 7888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:35:06Z', 'lastTransitionTime': '2020-07-16T14:35:06Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:35:06Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "homer-74dd4556d9" has successfully progressed.'}]}}} 2020-07-16 14:35:07,020 - functest_kubernetes.ims.ims - INFO - homer started in 152.03 sec 2020-07-16 14:35:09,187 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'ralf', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241868', 'self_link': '/apis/apps/v1/namespaces/default/deployments/ralf', 'uid': '4f24a10d-9c29-4114-b079-0f83735d4688'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'ralf'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'ralf', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-ralf:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'name': 'ralf', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 10888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'ralflogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 16, 14, 35, 9, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 35, 9, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 35, 9, tzinfo=tzlocal()), 'message': 'ReplicaSet "ralf-57c4654cb8" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'ralf', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/ralf', 'uid': '4f24a10d-9c29-4114-b079-0f83735d4688', 'resourceVersion': '1241868', 'generation': 1, 'creationTimestamp': '2020-07-16T14:32:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'ralf'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'ralf', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'ralflogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'ralf', 'image': 'ollivier/clearwater-ralf:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 10888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}], 'livenessProbe': {'tcpSocket': {'port': 10888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 10888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:35:09Z', 'lastTransitionTime': '2020-07-16T14:35:09Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:35:09Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "ralf-57c4654cb8" has successfully progressed.'}]}}} 2020-07-16 14:35:09,214 - functest_kubernetes.ims.ims - INFO - ralf started in 154.23 sec 2020-07-16 14:35:13,527 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'service': 'chronos'}, 'managed_fields': None, 'name': 'chronos', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241880', 'self_link': '/apis/apps/v1/namespaces/default/deployments/chronos', 'uid': '2139a1ec-34aa-4887-a963-0a75fe256d98'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'chronos'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'chronos'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-chronos:latest', 'image_pull_policy': 'Always', 'lifecycle': {'post_start': None, 'pre_stop': {'_exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}, 'http_get': None, 'tcp_socket': None}}, 'liveness_probe': {'_exec': None, 'failure_threshold': 9, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7253}, 'timeout_seconds': 1}, 'name': 'chronos', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7253, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7253}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/chronos', 'mount_propagation': None, 'name': 'chronoslogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/chronos/chronos_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/chronos', 'mount_propagation': None, 'name': 'chronoslogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 120, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'chronoslogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 16, 14, 35, 13, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 35, 13, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 35, 13, tzinfo=tzlocal()), 'message': 'ReplicaSet "chronos-687b9884c5" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'chronos', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/chronos', 'uid': '2139a1ec-34aa-4887-a963-0a75fe256d98', 'resourceVersion': '1241880', 'generation': 1, 'creationTimestamp': '2020-07-16T14:32:35Z', 'labels': {'service': 'chronos'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'chronos'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'chronos'}}, 'spec': {'volumes': [{'name': 'chronoslogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'chronos', 'image': 'ollivier/clearwater-chronos:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7253, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'chronoslogs', 'mountPath': '/var/log/chronos'}], 'livenessProbe': {'tcpSocket': {'port': 7253}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 9}, 'readinessProbe': {'tcpSocket': {'port': 7253}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'lifecycle': {'preStop': {'exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}}}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/chronos/chronos_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'chronoslogs', 'mountPath': '/var/log/chronos'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 120, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:35:13Z', 'lastTransitionTime': '2020-07-16T14:35:13Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:35:13Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "chronos-687b9884c5" has successfully progressed.'}]}}} 2020-07-16 14:35:13,554 - functest_kubernetes.ims.ims - INFO - chronos started in 158.57 sec 2020-07-16 14:35:43,841 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'astaire', 'namespace': 'default', 'owner_references': None, 'resource_version': '1241959', 'self_link': '/apis/apps/v1/namespaces/default/deployments/astaire', 'uid': 'a719a6f5-a461-4be5-8214-898af088df3f'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'astaire'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'astaire'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-astaire:latest', 'image_pull_policy': 'Always', 'lifecycle': {'post_start': None, 'pre_stop': {'_exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}, 'http_get': None, 'tcp_socket': None}}, 'liveness_probe': {'_exec': None, 'failure_threshold': 9, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 11311}, 'timeout_seconds': 1}, 'name': 'astaire', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 11211, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 11311, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 11311}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/astaire', 'mount_propagation': None, 'name': 'astairelogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/astaire/astaire_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/astaire', 'mount_propagation': None, 'name': 'astairelogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 120, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'astairelogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 16, 14, 35, 43, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 35, 43, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 35, 43, tzinfo=tzlocal()), 'message': 'ReplicaSet "astaire-5ddcdd6b7f" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'astaire', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/astaire', 'uid': 'a719a6f5-a461-4be5-8214-898af088df3f', 'resourceVersion': '1241959', 'generation': 1, 'creationTimestamp': '2020-07-16T14:32:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'astaire'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'astaire'}}, 'spec': {'volumes': [{'name': 'astairelogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'astaire', 'image': 'ollivier/clearwater-astaire:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 11211, 'protocol': 'TCP'}, {'containerPort': 11311, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'astairelogs', 'mountPath': '/var/log/astaire'}], 'livenessProbe': {'tcpSocket': {'port': 11311}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 9}, 'readinessProbe': {'tcpSocket': {'port': 11311}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'lifecycle': {'preStop': {'exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}}}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/astaire/astaire_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'astairelogs', 'mountPath': '/var/log/astaire'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 120, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:35:43Z', 'lastTransitionTime': '2020-07-16T14:35:43Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:35:43Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "astaire-5ddcdd6b7f" has successfully progressed.'}]}}} 2020-07-16 14:35:43,870 - functest_kubernetes.ims.ims - INFO - astaire started in 188.88 sec 2020-07-16 14:36:08,445 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homestead', 'namespace': 'default', 'owner_references': None, 'resource_version': '1242021', 'self_link': '/apis/apps/v1/namespaces/default/deployments/homestead', 'uid': 'e112f04c-bc51-4e58-a54d-8f1880bd09ab'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'homestead'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'homestead', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/homestead', 'mount_propagation': None, 'name': 'homesteadlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/homestead/homestead_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/homestead', 'mount_propagation': None, 'name': 'homesteadlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'astaire; do ' 'echo waiting ' 'for astaire ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-astaire', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'homesteadlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 16, 14, 36, 8, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 36, 8, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 36, 8, tzinfo=tzlocal()), 'message': 'ReplicaSet "homestead-57586d6cdc" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homestead', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/homestead', 'uid': 'e112f04c-bc51-4e58-a54d-8f1880bd09ab', 'resourceVersion': '1242021', 'generation': 1, 'creationTimestamp': '2020-07-16T14:32:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homestead'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homestead', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'homesteadlogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-astaire', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup astaire; do echo waiting for astaire to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead', 'image': 'ollivier/clearwater-homestead:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'homesteadlogs', 'mountPath': '/var/log/homestead'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/homestead/homestead_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'homesteadlogs', 'mountPath': '/var/log/homestead'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:36:08Z', 'lastTransitionTime': '2020-07-16T14:36:08Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:36:08Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "homestead-57586d6cdc" has successfully progressed.'}]}}} 2020-07-16 14:36:08,473 - functest_kubernetes.ims.ims - INFO - homestead started in 213.48 sec 2020-07-16 14:36:49,797 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homestead-prov', 'namespace': 'default', 'owner_references': None, 'resource_version': '1242125', 'self_link': '/apis/apps/v1/namespaces/default/deployments/homestead-prov', 'uid': '67040119-0611-4a1f-9d68-cf00bbff900e'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'homestead-prov'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'homestead-prov', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead-prov:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead-prov', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8889, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'homestead; ' 'do echo ' 'waiting for ' 'homestead to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 16, 14, 36, 49, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 36, 49, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 36, 49, tzinfo=tzlocal()), 'message': 'ReplicaSet "homestead-prov-756c8bff5d" ' 'has successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homestead-prov', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/homestead-prov', 'uid': '67040119-0611-4a1f-9d68-cf00bbff900e', 'resourceVersion': '1242125', 'generation': 1, 'creationTimestamp': '2020-07-16T14:32:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homestead-prov'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homestead-prov', 'snmp': 'enabled'}}, 'spec': {'initContainers': [{'name': 'wait-on-homestead', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead-prov', 'image': 'ollivier/clearwater-homestead-prov:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8889, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:36:49Z', 'lastTransitionTime': '2020-07-16T14:36:49Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:36:49Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "homestead-prov-756c8bff5d" has successfully progressed.'}]}}} 2020-07-16 14:36:49,817 - functest_kubernetes.ims.ims - INFO - homestead-prov started in 254.83 sec 2020-07-16 14:36:52,842 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'sprout', 'namespace': 'default', 'owner_references': None, 'resource_version': '1242134', 'self_link': '/apis/apps/v1/namespaces/default/deployments/sprout', 'uid': '40a25977-918e-4559-a2b3-31b12ddf0799'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'sprout'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'sprout', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-sprout:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 3, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'sprout', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'ralf; do ' 'echo waiting ' 'for ralf to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-ralf', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'chronos; do ' 'echo waiting ' 'for chronos ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-chronos', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'homestead; ' 'do echo ' 'waiting for ' 'homestead to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'sproutlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 16, 14, 36, 52, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 36, 52, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 36, 52, tzinfo=tzlocal()), 'message': 'ReplicaSet "sprout-686cc64cfb" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'sprout', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/sprout', 'uid': '40a25977-918e-4559-a2b3-31b12ddf0799', 'resourceVersion': '1242134', 'generation': 1, 'creationTimestamp': '2020-07-16T14:32:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'sprout'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'sprout', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'sproutlogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-ralf', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup ralf; do echo waiting for ralf to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-chronos', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup chronos; do echo waiting for chronos to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-homestead', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'sprout', 'image': 'ollivier/clearwater-sprout:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 3, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:36:52Z', 'lastTransitionTime': '2020-07-16T14:36:52Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:36:52Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "sprout-686cc64cfb" has successfully progressed.'}]}}} 2020-07-16 14:36:52,875 - functest_kubernetes.ims.ims - INFO - sprout started in 257.89 sec 2020-07-16 14:37:08,977 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 56, 6, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test8'}, 'managed_fields': None, 'name': 'live-test8', 'namespace': 'default', 'owner_references': None, 'resource_version': '1242174', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test8', 'uid': '97897e35-290b-4b9f-b5bf-1be380092f43'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test8'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test8'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test8', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 11, 56, 6, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 11, 56, 16, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test8-55669b464c" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 37, 8, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 37, 8, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test8', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test8', 'uid': '97897e35-290b-4b9f-b5bf-1be380092f43', 'resourceVersion': '1242174', 'generation': 1, 'creationTimestamp': '2020-07-10T11:56:06Z', 'labels': {'run': 'live-test8'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test8'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test8'}}, 'spec': {'containers': [{'name': 'live-test8', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T11:56:16Z', 'lastTransitionTime': '2020-07-10T11:56:06Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test8-55669b464c" has successfully progressed.'}, {'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:37:08Z', 'lastTransitionTime': '2020-07-16T14:37:08Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}]}}} 2020-07-16 14:37:10,834 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 56, 6, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test8'}, 'managed_fields': None, 'name': 'live-test8', 'namespace': 'default', 'owner_references': None, 'resource_version': '1242181', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test8', 'uid': '97897e35-290b-4b9f-b5bf-1be380092f43'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test8'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test8'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test8', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 11, 56, 6, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 11, 56, 16, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test8-55669b464c" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 37, 10, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 37, 10, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test8', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test8', 'uid': '97897e35-290b-4b9f-b5bf-1be380092f43', 'resourceVersion': '1242181', 'generation': 1, 'creationTimestamp': '2020-07-10T11:56:06Z', 'labels': {'run': 'live-test8'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test8'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test8'}}, 'spec': {'containers': [{'name': 'live-test8', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T11:56:16Z', 'lastTransitionTime': '2020-07-10T11:56:06Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test8-55669b464c" has successfully progressed.'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-16T14:37:10Z', 'lastTransitionTime': '2020-07-16T14:37:10Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-16 14:37:13,740 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 10, 49, 36, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test1'}, 'managed_fields': None, 'name': 'live-test1', 'namespace': 'default', 'owner_references': None, 'resource_version': '1242196', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test1', 'uid': '0fe55582-d17d-4d84-bef8-ad96e8e08b3a'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test1'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test1'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test1', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 10, 49, 37, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 10, 50, 2, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test1-677ffc8869" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 37, 13, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 37, 13, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test1', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test1', 'uid': '0fe55582-d17d-4d84-bef8-ad96e8e08b3a', 'resourceVersion': '1242196', 'generation': 1, 'creationTimestamp': '2020-07-10T10:49:36Z', 'labels': {'run': 'live-test1'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test1'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test1'}}, 'spec': {'containers': [{'name': 'live-test1', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T10:50:02Z', 'lastTransitionTime': '2020-07-10T10:49:37Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test1-677ffc8869" has successfully progressed.'}, {'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:37:13Z', 'lastTransitionTime': '2020-07-16T14:37:13Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}]}}} 2020-07-16 14:37:14,764 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 54, 47, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test7'}, 'managed_fields': None, 'name': 'live-test7', 'namespace': 'default', 'owner_references': None, 'resource_version': '1242199', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test7', 'uid': '7bb42069-0e58-44eb-97bf-37be24b29e9c'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test7'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test7'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test7', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 11, 54, 47, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 11, 54, 54, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test7-5dd99f9b45" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 37, 14, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 37, 14, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test7', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test7', 'uid': '7bb42069-0e58-44eb-97bf-37be24b29e9c', 'resourceVersion': '1242199', 'generation': 1, 'creationTimestamp': '2020-07-10T11:54:47Z', 'labels': {'run': 'live-test7'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test7'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test7'}}, 'spec': {'containers': [{'name': 'live-test7', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T11:54:54Z', 'lastTransitionTime': '2020-07-10T11:54:47Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test7-5dd99f9b45" has successfully progressed.'}, {'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:37:14Z', 'lastTransitionTime': '2020-07-16T14:37:14Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}]}}} 2020-07-16 14:37:15,962 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 10, 49, 36, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test1'}, 'managed_fields': None, 'name': 'live-test1', 'namespace': 'default', 'owner_references': None, 'resource_version': '1242207', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test1', 'uid': '0fe55582-d17d-4d84-bef8-ad96e8e08b3a'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test1'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test1'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test1', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 10, 49, 37, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 10, 50, 2, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test1-677ffc8869" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 37, 15, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 37, 15, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test1', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test1', 'uid': '0fe55582-d17d-4d84-bef8-ad96e8e08b3a', 'resourceVersion': '1242207', 'generation': 1, 'creationTimestamp': '2020-07-10T10:49:36Z', 'labels': {'run': 'live-test1'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test1'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test1'}}, 'spec': {'containers': [{'name': 'live-test1', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T10:50:02Z', 'lastTransitionTime': '2020-07-10T10:49:37Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test1-677ffc8869" has successfully progressed.'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-16T14:37:15Z', 'lastTransitionTime': '2020-07-16T14:37:15Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-16 14:37:15,974 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 54, 47, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test7'}, 'managed_fields': None, 'name': 'live-test7', 'namespace': 'default', 'owner_references': None, 'resource_version': '1242208', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test7', 'uid': '7bb42069-0e58-44eb-97bf-37be24b29e9c'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test7'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test7'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test7', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 11, 54, 47, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 11, 54, 54, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test7-5dd99f9b45" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 37, 15, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 37, 15, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test7', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test7', 'uid': '7bb42069-0e58-44eb-97bf-37be24b29e9c', 'resourceVersion': '1242208', 'generation': 1, 'creationTimestamp': '2020-07-10T11:54:47Z', 'labels': {'run': 'live-test7'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test7'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test7'}}, 'spec': {'containers': [{'name': 'live-test7', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T11:54:54Z', 'lastTransitionTime': '2020-07-10T11:54:47Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test7-5dd99f9b45" has successfully progressed.'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-16T14:37:15Z', 'lastTransitionTime': '2020-07-16T14:37:15Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-16 14:37:17,082 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 2, 2, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test4'}, 'managed_fields': None, 'name': 'live-test4', 'namespace': 'default', 'owner_references': None, 'resource_version': '1242214', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test4', 'uid': 'b0d44bb2-0c16-4b80-813a-381e5cb8c2f1'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test4'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test4'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test4', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 11, 2, 2, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 11, 2, 13, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test4-74f5c7c95f" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 37, 17, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 37, 17, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test4', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test4', 'uid': 'b0d44bb2-0c16-4b80-813a-381e5cb8c2f1', 'resourceVersion': '1242214', 'generation': 1, 'creationTimestamp': '2020-07-10T11:02:02Z', 'labels': {'run': 'live-test4'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test4'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test4'}}, 'spec': {'containers': [{'name': 'live-test4', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T11:02:13Z', 'lastTransitionTime': '2020-07-10T11:02:02Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test4-74f5c7c95f" has successfully progressed.'}, {'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:37:17Z', 'lastTransitionTime': '2020-07-16T14:37:17Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}]}}} 2020-07-16 14:37:17,848 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 2, 2, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'run': 'live-test4'}, 'managed_fields': None, 'name': 'live-test4', 'namespace': 'default', 'owner_references': None, 'resource_version': '1242223', 'self_link': '/apis/apps/v1/namespaces/default/deployments/live-test4', 'uid': 'b0d44bb2-0c16-4b80-813a-381e5cb8c2f1'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'run': 'live-test4'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'run': 'live-test4'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test4', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 10, 11, 2, 2, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 10, 11, 2, 13, tzinfo=tzlocal()), 'message': 'ReplicaSet "live-test4-74f5c7c95f" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 37, 17, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 37, 17, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'live-test4', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/live-test4', 'uid': 'b0d44bb2-0c16-4b80-813a-381e5cb8c2f1', 'resourceVersion': '1242223', 'generation': 1, 'creationTimestamp': '2020-07-10T11:02:02Z', 'labels': {'run': 'live-test4'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'run': 'live-test4'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'run': 'live-test4'}}, 'spec': {'containers': [{'name': 'live-test4', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-10T11:02:13Z', 'lastTransitionTime': '2020-07-10T11:02:02Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "live-test4-74f5c7c95f" has successfully progressed.'}, {'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-07-16T14:37:17Z', 'lastTransitionTime': '2020-07-16T14:37:17Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}]}}} 2020-07-16 14:37:23,729 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'bono', 'namespace': 'default', 'owner_references': None, 'resource_version': '1242242', 'self_link': '/apis/apps/v1/namespaces/default/deployments/bono', 'uid': 'd1d5a413-946b-49c3-a5b6-1f554725ba3a'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'bono'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'bono', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-bono:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 ' '5060 ' '5062']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'bono', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 3478, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5060, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5062, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5060, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'UDP'}, {'container_port': 5062, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'UDP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 ' '5060 ' '5062']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/bono', 'mount_propagation': None, 'name': 'bonologs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/bono/bono_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/bono', 'mount_propagation': None, 'name': 'bonologs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'sprout; do ' 'echo waiting ' 'for sprout ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'bonologs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 16, 14, 37, 23, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 37, 23, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 37, 23, tzinfo=tzlocal()), 'message': 'ReplicaSet "bono-5cdb7bfcdd" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'bono', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/bono', 'uid': 'd1d5a413-946b-49c3-a5b6-1f554725ba3a', 'resourceVersion': '1242242', 'generation': 1, 'creationTimestamp': '2020-07-16T14:32:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'bono'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'bono', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'bonologs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'bono', 'image': 'ollivier/clearwater-bono:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 3478, 'protocol': 'TCP'}, {'containerPort': 5060, 'protocol': 'TCP'}, {'containerPort': 5062, 'protocol': 'TCP'}, {'containerPort': 5060, 'protocol': 'UDP'}, {'containerPort': 5062, 'protocol': 'UDP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'bonologs', 'mountPath': '/var/log/bono'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 5062']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 5062']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/bono/bono_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'bonologs', 'mountPath': '/var/log/bono'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:37:23Z', 'lastTransitionTime': '2020-07-16T14:37:23Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:37:23Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "bono-5cdb7bfcdd" has successfully progressed.'}]}}} 2020-07-16 14:37:23,761 - functest_kubernetes.ims.ims - INFO - bono started in 288.77 sec 2020-07-16 14:37:38,598 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'ellis', 'namespace': 'default', 'owner_references': None, 'resource_version': '1242283', 'self_link': '/apis/apps/v1/namespaces/default/deployments/ellis', 'uid': 'd83c33af-71ff-49fc-b323-649742f54f07'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'ellis'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'ellis'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-ellis:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 80}, 'timeout_seconds': 1}, 'name': 'ellis', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 80, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 80}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'homestead-prov; ' 'do echo ' 'waiting for ' 'homestead-prov ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead-prov', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'sprout; do ' 'echo waiting ' 'for sprout ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 7, 16, 14, 37, 38, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 37, 38, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 7, 16, 14, 37, 38, tzinfo=tzlocal()), 'message': 'ReplicaSet "ellis-57b84b6dd7" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'ellis', 'namespace': 'default', 'selfLink': '/apis/apps/v1/namespaces/default/deployments/ellis', 'uid': 'd83c33af-71ff-49fc-b323-649742f54f07', 'resourceVersion': '1242283', 'generation': 1, 'creationTimestamp': '2020-07-16T14:32:35Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'ellis'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'ellis'}}, 'spec': {'initContainers': [{'name': 'wait-on-homestead-prov', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead-prov; do echo waiting for homestead-prov to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'ellis', 'image': 'ollivier/clearwater-ellis:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 80, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'tcpSocket': {'port': 80}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 80}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:37:38Z', 'lastTransitionTime': '2020-07-16T14:37:38Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-07-16T14:37:38Z', 'lastTransitionTime': '2020-07-16T14:32:35Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "ellis-57b84b6dd7" has successfully progressed.'}]}}} 2020-07-16 14:37:38,619 - functest_kubernetes.ims.ims - INFO - ellis started in 303.63 sec 2020-07-16 14:37:38,632 - kubernetes.client.rest - DEBUG - response body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"live-test","namespace":"default","selfLink":"/api/v1/namespaces/default/pods/live-test","uid":"e6ca5fd5-4d48-491c-a9b5-6235cd4ece9c","resourceVersion":"1242284","creationTimestamp":"2020-07-16T14:37:38Z"},"spec":{"volumes":[{"name":"default-token-nksct","secret":{"secretName":"default-token-nksct","defaultMode":420}}],"containers":[{"name":"live-test","image":"ollivier/clearwater-live-test:latest","resources":{},"volumeMounts":[{"name":"default-token-nksct","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"restartPolicy":"Never","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Pending","qosClass":"BestEffort"}} 2020-07-16 14:37:38,641 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'cassandra-76f5c4d86c-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '76f5c4d86c', 'service': 'cassandra'}, 'managed_fields': None, 'name': 'cassandra-76f5c4d86c-qntrx', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'cassandra-76f5c4d86c', 'uid': '3f3fea7e-e24d-41d9-8565-0aa018218a71'}], 'resource_version': '1241727', 'self_link': '/api/v1/namespaces/default/pods/cassandra-76f5c4d86c-qntrx', 'uid': 'fb18fc02-8c65-4974-8499-2039bc84d311'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-cassandra:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 ' '9160']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 600, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'cassandra', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7001, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 9042, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 9160, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 ' '9160']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup etcd; do echo ' 'waiting for etcd to start ...; ' 'sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-etcd', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'iruya-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 33, 21, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 34, 28, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 34, 28, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://097bf7790ebccb207af55db6a2838eeabc7a26d1e057e1af633c7602bc0c0ce5', 'image': 'docker.io/ollivier/clearwater-cassandra:latest', 'image_id': 'docker.io/ollivier/clearwater-cassandra@sha256:24f49e5e936930e808cd79cac72fd4f2dc87e97b33a9dedecf60d0eb1f655015', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'cassandra', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 16, 14, 33, 25, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.9', 'init_container_statuses': [{'container_id': 'containerd://8fafb54ce73f3db808bb4344c230159f2e7c9b9326ec088e02e0a756aa25f814', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-etcd', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://8fafb54ce73f3db808bb4344c230159f2e7c9b9326ec088e02e0a756aa25f814', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 16, 14, 33, 20, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 16, 14, 32, 48, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.154', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'cassandra-76f5c4d86c-qntrx', 'generateName': 'cassandra-76f5c4d86c-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/cassandra-76f5c4d86c-qntrx', 'uid': 'fb18fc02-8c65-4974-8499-2039bc84d311', 'resourceVersion': '1241727', 'creationTimestamp': '2020-07-16T14:32:35Z', 'labels': {'pod-template-hash': '76f5c4d86c', 'service': 'cassandra'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'cassandra-76f5c4d86c', 'uid': '3f3fea7e-e24d-41d9-8565-0aa018218a71', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-etcd', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup etcd; do echo waiting for etcd to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'cassandra', 'image': 'ollivier/clearwater-cassandra:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7001, 'protocol': 'TCP'}, {'containerPort': 9042, 'protocol': 'TCP'}, {'containerPort': 9160, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 9160']}, 'initialDelaySeconds': 600, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 9160']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:33:21Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:34:28Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:34:28Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:32:35Z'}], 'hostIP': '172.18.0.9', 'podIP': '10.244.2.154', 'startTime': '2020-07-16T14:32:35Z', 'initContainerStatuses': [{'name': 'wait-on-etcd', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-16T14:32:48Z', 'finishedAt': '2020-07-16T14:33:20Z', 'containerID': 'containerd://8fafb54ce73f3db808bb4344c230159f2e7c9b9326ec088e02e0a756aa25f814'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://8fafb54ce73f3db808bb4344c230159f2e7c9b9326ec088e02e0a756aa25f814'}], 'containerStatuses': [{'name': 'cassandra', 'state': {'running': {'startedAt': '2020-07-16T14:33:25Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-cassandra:latest', 'imageID': 'docker.io/ollivier/clearwater-cassandra@sha256:24f49e5e936930e808cd79cac72fd4f2dc87e97b33a9dedecf60d0eb1f655015', 'containerID': 'containerd://097bf7790ebccb207af55db6a2838eeabc7a26d1e057e1af633c7602bc0c0ce5'}], 'qosClass': 'BestEffort'}}} 2020-07-16 14:37:38,667 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': {'kubectl.kubernetes.io/last-applied-configuration': '{"apiVersion":"v1","kind":"Pod","metadata":{"annotations":{},"name":"dnsutils","namespace":"default"},"spec":{"containers":[{"command":["sleep","3600"],"image":"gcr.io/kubernetes-e2e-test-images/dnsutils:1.3","imagePullPolicy":"IfNotPresent","name":"dnsutils"}],"restartPolicy":"Always"}}\n'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 15, 11, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'dnsutils', 'namespace': 'default', 'owner_references': None, 'resource_version': '1238794', 'self_link': '/api/v1/namespaces/default/pods/dnsutils', 'uid': '5f3dcdb1-f6e7-4927-af74-aea6ae677366'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': ['sleep', '3600'], 'env': None, 'env_from': None, 'image': 'gcr.io/kubernetes-e2e-test-images/dnsutils:1.3', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'dnsutils', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 15, 11, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 22, 14, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 22, 14, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 15, 11, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://0770ea0e632d7649626241aab268bb7a3e3d4d5007d0a36df17c8d104bea7c93', 'image': 'gcr.io/kubernetes-e2e-test-images/dnsutils:1.3', 'image_id': 'gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:b31bcf7ef4420ce7108e7fc10b6c00343b21257c945eec94c21598e72a8f2de0', 'last_state': {'running': None, 'terminated': {'container_id': 'containerd://a181562045080516499d079d98050ac9a2e967e3a0797aa841a0c4e20c1a4c88', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 16, 14, 22, 11, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 16, 13, 22, 11, tzinfo=tzlocal())}, 'waiting': None}, 'name': 'dnsutils', 'ready': True, 'restart_count': 147, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 16, 14, 22, 14, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.9', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.10', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 10, 11, 15, 11, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'dnsutils', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/dnsutils', 'uid': '5f3dcdb1-f6e7-4927-af74-aea6ae677366', 'resourceVersion': '1238794', 'creationTimestamp': '2020-07-10T11:15:11Z', 'annotations': {'kubectl.kubernetes.io/last-applied-configuration': '{"apiVersion":"v1","kind":"Pod","metadata":{"annotations":{},"name":"dnsutils","namespace":"default"},"spec":{"containers":[{"command":["sleep","3600"],"image":"gcr.io/kubernetes-e2e-test-images/dnsutils:1.3","imagePullPolicy":"IfNotPresent","name":"dnsutils"}],"restartPolicy":"Always"}}\n'}}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'containers': [{'name': 'dnsutils', 'image': 'gcr.io/kubernetes-e2e-test-images/dnsutils:1.3', 'command': ['sleep', '3600'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:15:11Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:22:14Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:22:14Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:15:11Z'}], 'hostIP': '172.18.0.9', 'podIP': '10.244.2.10', 'startTime': '2020-07-10T11:15:11Z', 'containerStatuses': [{'name': 'dnsutils', 'state': {'running': {'startedAt': '2020-07-16T14:22:14Z'}}, 'lastState': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-16T13:22:11Z', 'finishedAt': '2020-07-16T14:22:11Z', 'containerID': 'containerd://a181562045080516499d079d98050ac9a2e967e3a0797aa841a0c4e20c1a4c88'}}, 'ready': True, 'restartCount': 147, 'image': 'gcr.io/kubernetes-e2e-test-images/dnsutils:1.3', 'imageID': 'gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:b31bcf7ef4420ce7108e7fc10b6c00343b21257c945eec94c21598e72a8f2de0', 'containerID': 'containerd://0770ea0e632d7649626241aab268bb7a3e3d4d5007d0a36df17c8d104bea7c93'}], 'qosClass': 'BestEffort'}}} 2020-07-16 14:37:38,682 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'ralf-57c4654cb8-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '57c4654cb8', 'service': 'ralf', 'snmp': 'enabled'}, 'managed_fields': None, 'name': 'ralf-57c4654cb8-x2lt9', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'ralf-57c4654cb8', 'uid': '3689f186-483c-4a8a-bd99-a174cb0b8061'}], 'resource_version': '1241865', 'self_link': '/api/v1/namespaces/default/pods/ralf-57c4654cb8-x2lt9', 'uid': 'dd72c571-a9a1-4c8f-b865-32efbb4f3e4d'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-ralf:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'name': 'ralf', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 10888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup cassandra; do echo ' 'waiting for cassandra to start ' '...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'ralflogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}, {'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 34, 45, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 35, 9, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 35, 9, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://cc909ef4a2559f814e28176f6b5b3edb613328da0257ad4aa12864d61863934e', 'image': 'docker.io/ollivier/clearwater-ralf:latest', 'image_id': 'docker.io/ollivier/clearwater-ralf@sha256:becf37bf5c8d9f81189d9d727c3c3ab7e032b7de3a710f7bbb264d35d442a344', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'ralf', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 16, 14, 34, 54, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}, {'container_id': 'containerd://bb6cea5a6ea6e2a21a16582ee551438dcfe8d627afe626e9630299d33382ff7b', 'image': 'docker.io/library/busybox:latest', 'image_id': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'tailer', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 16, 14, 35, 2, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.5', 'init_container_statuses': [{'container_id': 'containerd://7ef1e7af48bb46864d733520eaf220a411dd2e94ff058e48370741a246a9683f', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-cassandra', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://7ef1e7af48bb46864d733520eaf220a411dd2e94ff058e48370741a246a9683f', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 16, 14, 34, 44, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 16, 14, 32, 48, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.246', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 16, 14, 32, 36, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'ralf-57c4654cb8-x2lt9', 'generateName': 'ralf-57c4654cb8-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/ralf-57c4654cb8-x2lt9', 'uid': 'dd72c571-a9a1-4c8f-b865-32efbb4f3e4d', 'resourceVersion': '1241865', 'creationTimestamp': '2020-07-16T14:32:35Z', 'labels': {'pod-template-hash': '57c4654cb8', 'service': 'ralf', 'snmp': 'enabled'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'ralf-57c4654cb8', 'uid': '3689f186-483c-4a8a-bd99-a174cb0b8061', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'ralflogs', 'emptyDir': {}}, {'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'ralf', 'image': 'ollivier/clearwater-ralf:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 10888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}, {'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'tcpSocket': {'port': 10888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 10888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}, {'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:34:45Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:35:09Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:35:09Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:32:35Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.246', 'startTime': '2020-07-16T14:32:36Z', 'initContainerStatuses': [{'name': 'wait-on-cassandra', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-16T14:32:48Z', 'finishedAt': '2020-07-16T14:34:44Z', 'containerID': 'containerd://7ef1e7af48bb46864d733520eaf220a411dd2e94ff058e48370741a246a9683f'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://7ef1e7af48bb46864d733520eaf220a411dd2e94ff058e48370741a246a9683f'}], 'containerStatuses': [{'name': 'ralf', 'state': {'running': {'startedAt': '2020-07-16T14:34:54Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-ralf:latest', 'imageID': 'docker.io/ollivier/clearwater-ralf@sha256:becf37bf5c8d9f81189d9d727c3c3ab7e032b7de3a710f7bbb264d35d442a344', 'containerID': 'containerd://cc909ef4a2559f814e28176f6b5b3edb613328da0257ad4aa12864d61863934e'}, {'name': 'tailer', 'state': {'running': {'startedAt': '2020-07-16T14:35:02Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:latest', 'imageID': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'containerID': 'containerd://bb6cea5a6ea6e2a21a16582ee551438dcfe8d627afe626e9630299d33382ff7b'}], 'qosClass': 'BestEffort'}}} 2020-07-16 14:37:38,710 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 37, 38, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'live-test', 'namespace': 'default', 'owner_references': None, 'resource_version': '1242285', 'self_link': '/api/v1/namespaces/default/pods/live-test', 'uid': 'e6ca5fd5-4d48-491c-a9b5-6235cd4ece9c'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Never', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 37, 38, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': None, 'host_ip': None, 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Pending', 'pod_ip': None, 'qos_class': 'BestEffort', 'reason': None, 'start_time': None}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test', 'uid': 'e6ca5fd5-4d48-491c-a9b5-6235cd4ece9c', 'resourceVersion': '1242285', 'creationTimestamp': '2020-07-16T14:37:38Z'}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'containers': [{'name': 'live-test', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Never', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Pending', 'conditions': [{'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:37:38Z'}], 'qosClass': 'BestEffort'}}} 2020-07-16 14:37:38,720 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 56, 7, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'live-test8-55669b464c-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '55669b464c', 'run': 'live-test8'}, 'managed_fields': None, 'name': 'live-test8-55669b464c-bfdv5', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'live-test8-55669b464c', 'uid': 'ad220e2e-5b9d-4afe-a31a-f4f88934319e'}], 'resource_version': '1242247', 'self_link': '/api/v1/namespaces/default/pods/live-test8-55669b464c-bfdv5', 'uid': '1342c639-efa4-418e-a3fa-40ead49ad29f'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test8', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 56, 7, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 37, 10, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test8]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 37, 10, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test8]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 56, 7, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://63b4579d73997535c65e68e5bc92f775ff77724b7263371e9febfe899ebd5d19', 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'image_id': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'last_state': {'running': None, 'terminated': {'container_id': 'containerd://63b4579d73997535c65e68e5bc92f775ff77724b7263371e9febfe899ebd5d19', 'exit_code': 1, 'finished_at': datetime.datetime(2020, 7, 16, 14, 37, 9, tzinfo=tzlocal()), 'message': None, 'reason': 'Error', 'signal': None, 'started_at': datetime.datetime(2020, 7, 16, 14, 37, 8, tzinfo=tzlocal())}, 'waiting': None}, 'name': 'live-test8', 'ready': False, 'restart_count': 1696, 'state': {'running': None, 'terminated': None, 'waiting': {'message': 'Back-off ' '5m0s ' 'restarting ' 'failed ' 'container=live-test8 ' 'pod=live-test8-55669b464c-bfdv5_default(1342c639-efa4-418e-a3fa-40ead49ad29f)', 'reason': 'CrashLoopBackOff'}}}], 'host_ip': '172.18.0.5', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.12', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 10, 11, 56, 7, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test8-55669b464c-bfdv5', 'generateName': 'live-test8-55669b464c-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test8-55669b464c-bfdv5', 'uid': '1342c639-efa4-418e-a3fa-40ead49ad29f', 'resourceVersion': '1242247', 'creationTimestamp': '2020-07-10T11:56:07Z', 'labels': {'pod-template-hash': '55669b464c', 'run': 'live-test8'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'live-test8-55669b464c', 'uid': 'ad220e2e-5b9d-4afe-a31a-f4f88934319e', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'containers': [{'name': 'live-test8', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:56:07Z'}, {'type': 'Ready', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:37:10Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test8]'}, {'type': 'ContainersReady', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:37:10Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test8]'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:56:07Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.12', 'startTime': '2020-07-10T11:56:07Z', 'containerStatuses': [{'name': 'live-test8', 'state': {'waiting': {'reason': 'CrashLoopBackOff', 'message': 'Back-off 5m0s restarting failed container=live-test8 pod=live-test8-55669b464c-bfdv5_default(1342c639-efa4-418e-a3fa-40ead49ad29f)'}}, 'lastState': {'terminated': {'exitCode': 1, 'reason': 'Error', 'startedAt': '2020-07-16T14:37:08Z', 'finishedAt': '2020-07-16T14:37:09Z', 'containerID': 'containerd://63b4579d73997535c65e68e5bc92f775ff77724b7263371e9febfe899ebd5d19'}}, 'ready': False, 'restartCount': 1696, 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'imageID': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'containerID': 'containerd://63b4579d73997535c65e68e5bc92f775ff77724b7263371e9febfe899ebd5d19'}], 'qosClass': 'BestEffort'}}} 2020-07-16 14:37:38,735 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 2, 2, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'live-test4-74f5c7c95f-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '74f5c7c95f', 'run': 'live-test4'}, 'managed_fields': None, 'name': 'live-test4-74f5c7c95f-l2676', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'live-test4-74f5c7c95f', 'uid': '861a4ee1-16fa-4c8d-86da-15bb8159067e'}], 'resource_version': '1242265', 'self_link': '/api/v1/namespaces/default/pods/live-test4-74f5c7c95f-l2676', 'uid': '301c5bc5-7f5e-4120-9234-6495475466bb'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test4', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 2, 3, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 37, 17, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test4]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 37, 17, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test4]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 2, 2, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://bbac1b77e885dd9b796ba0683f2deb788a6cc5c3562f37044b3e4feb0d4d356c', 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'image_id': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'last_state': {'running': None, 'terminated': {'container_id': 'containerd://bbac1b77e885dd9b796ba0683f2deb788a6cc5c3562f37044b3e4feb0d4d356c', 'exit_code': 1, 'finished_at': datetime.datetime(2020, 7, 16, 14, 37, 16, tzinfo=tzlocal()), 'message': None, 'reason': 'Error', 'signal': None, 'started_at': datetime.datetime(2020, 7, 16, 14, 37, 15, tzinfo=tzlocal())}, 'waiting': None}, 'name': 'live-test4', 'ready': False, 'restart_count': 1709, 'state': {'running': None, 'terminated': None, 'waiting': {'message': 'Back-off ' '5m0s ' 'restarting ' 'failed ' 'container=live-test4 ' 'pod=live-test4-74f5c7c95f-l2676_default(301c5bc5-7f5e-4120-9234-6495475466bb)', 'reason': 'CrashLoopBackOff'}}}], 'host_ip': '172.18.0.9', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.9', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 10, 11, 2, 3, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test4-74f5c7c95f-l2676', 'generateName': 'live-test4-74f5c7c95f-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test4-74f5c7c95f-l2676', 'uid': '301c5bc5-7f5e-4120-9234-6495475466bb', 'resourceVersion': '1242265', 'creationTimestamp': '2020-07-10T11:02:02Z', 'labels': {'pod-template-hash': '74f5c7c95f', 'run': 'live-test4'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'live-test4-74f5c7c95f', 'uid': '861a4ee1-16fa-4c8d-86da-15bb8159067e', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'containers': [{'name': 'live-test4', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:02:03Z'}, {'type': 'Ready', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:37:17Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test4]'}, {'type': 'ContainersReady', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:37:17Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test4]'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:02:02Z'}], 'hostIP': '172.18.0.9', 'podIP': '10.244.2.9', 'startTime': '2020-07-10T11:02:03Z', 'containerStatuses': [{'name': 'live-test4', 'state': {'waiting': {'reason': 'CrashLoopBackOff', 'message': 'Back-off 5m0s restarting failed container=live-test4 pod=live-test4-74f5c7c95f-l2676_default(301c5bc5-7f5e-4120-9234-6495475466bb)'}}, 'lastState': {'terminated': {'exitCode': 1, 'reason': 'Error', 'startedAt': '2020-07-16T14:37:15Z', 'finishedAt': '2020-07-16T14:37:16Z', 'containerID': 'containerd://bbac1b77e885dd9b796ba0683f2deb788a6cc5c3562f37044b3e4feb0d4d356c'}}, 'ready': False, 'restartCount': 1709, 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'imageID': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'containerID': 'containerd://bbac1b77e885dd9b796ba0683f2deb788a6cc5c3562f37044b3e4feb0d4d356c'}], 'qosClass': 'BestEffort'}}} 2020-07-16 14:37:38,749 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 22, 41, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'live-test6-988dbb567-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '988dbb567', 'run': 'live-test6'}, 'managed_fields': None, 'name': 'live-test6-988dbb567-rqc7x', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'live-test6-988dbb567', 'uid': '2aefcc7f-ce12-4f7f-a4a9-a58b67a26778'}], 'resource_version': '1241466', 'self_link': '/api/v1/namespaces/default/pods/live-test6-988dbb567-rqc7x', 'uid': 'd3a4086d-f6c3-49ab-8e6d-e47e0c9accc6'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test6', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 22, 41, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 31, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test6]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 31, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test6]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 22, 41, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://ea1c69c3562e4ebbf5d32c5e03b1dedb886d208da87b11dc2130ac8fd3a4f755', 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'image_id': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'last_state': {'running': None, 'terminated': {'container_id': 'containerd://ea1c69c3562e4ebbf5d32c5e03b1dedb886d208da87b11dc2130ac8fd3a4f755', 'exit_code': 1, 'finished_at': datetime.datetime(2020, 7, 16, 14, 32, 29, tzinfo=tzlocal()), 'message': None, 'reason': 'Error', 'signal': None, 'started_at': datetime.datetime(2020, 7, 16, 14, 32, 28, tzinfo=tzlocal())}, 'waiting': None}, 'name': 'live-test6', 'ready': False, 'restart_count': 1706, 'state': {'running': None, 'terminated': None, 'waiting': {'message': 'Back-off ' '5m0s ' 'restarting ' 'failed ' 'container=live-test6 ' 'pod=live-test6-988dbb567-rqc7x_default(d3a4086d-f6c3-49ab-8e6d-e47e0c9accc6)', 'reason': 'CrashLoopBackOff'}}}], 'host_ip': '172.18.0.5', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.11', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 10, 11, 22, 41, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test6-988dbb567-rqc7x', 'generateName': 'live-test6-988dbb567-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test6-988dbb567-rqc7x', 'uid': 'd3a4086d-f6c3-49ab-8e6d-e47e0c9accc6', 'resourceVersion': '1241466', 'creationTimestamp': '2020-07-10T11:22:41Z', 'labels': {'pod-template-hash': '988dbb567', 'run': 'live-test6'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'live-test6-988dbb567', 'uid': '2aefcc7f-ce12-4f7f-a4a9-a58b67a26778', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'containers': [{'name': 'live-test6', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:22:41Z'}, {'type': 'Ready', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:32:31Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test6]'}, {'type': 'ContainersReady', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:32:31Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test6]'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:22:41Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.11', 'startTime': '2020-07-10T11:22:41Z', 'containerStatuses': [{'name': 'live-test6', 'state': {'waiting': {'reason': 'CrashLoopBackOff', 'message': 'Back-off 5m0s restarting failed container=live-test6 pod=live-test6-988dbb567-rqc7x_default(d3a4086d-f6c3-49ab-8e6d-e47e0c9accc6)'}}, 'lastState': {'terminated': {'exitCode': 1, 'reason': 'Error', 'startedAt': '2020-07-16T14:32:28Z', 'finishedAt': '2020-07-16T14:32:29Z', 'containerID': 'containerd://ea1c69c3562e4ebbf5d32c5e03b1dedb886d208da87b11dc2130ac8fd3a4f755'}}, 'ready': False, 'restartCount': 1706, 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'imageID': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'containerID': 'containerd://ea1c69c3562e4ebbf5d32c5e03b1dedb886d208da87b11dc2130ac8fd3a4f755'}], 'qosClass': 'BestEffort'}}} 2020-07-16 14:37:38,764 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 10, 49, 37, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'live-test1-677ffc8869-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '677ffc8869', 'run': 'live-test1'}, 'managed_fields': None, 'name': 'live-test1-677ffc8869-nvdk5', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'live-test1-677ffc8869', 'uid': '8c0ead0e-0e53-4e6d-a864-b65ad37c5c18'}], 'resource_version': '1242258', 'self_link': '/api/v1/namespaces/default/pods/live-test1-677ffc8869-nvdk5', 'uid': '1bb35f10-321a-4dd0-b5dd-59488a1537c5'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test1', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 10, 49, 37, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 37, 15, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test1]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 37, 15, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test1]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 10, 49, 37, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://ed497a89af5dc03d5ca6eab27d12083588d5c14607d68a708605b1fa3bb61341', 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'image_id': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'last_state': {'running': None, 'terminated': {'container_id': 'containerd://ed497a89af5dc03d5ca6eab27d12083588d5c14607d68a708605b1fa3bb61341', 'exit_code': 1, 'finished_at': datetime.datetime(2020, 7, 16, 14, 37, 14, tzinfo=tzlocal()), 'message': None, 'reason': 'Error', 'signal': None, 'started_at': datetime.datetime(2020, 7, 16, 14, 37, 13, tzinfo=tzlocal())}, 'waiting': None}, 'name': 'live-test1', 'ready': False, 'restart_count': 1710, 'state': {'running': None, 'terminated': None, 'waiting': {'message': 'Back-off ' '5m0s ' 'restarting ' 'failed ' 'container=live-test1 ' 'pod=live-test1-677ffc8869-nvdk5_default(1bb35f10-321a-4dd0-b5dd-59488a1537c5)', 'reason': 'CrashLoopBackOff'}}}], 'host_ip': '172.18.0.5', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.7', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 10, 10, 49, 37, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test1-677ffc8869-nvdk5', 'generateName': 'live-test1-677ffc8869-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test1-677ffc8869-nvdk5', 'uid': '1bb35f10-321a-4dd0-b5dd-59488a1537c5', 'resourceVersion': '1242258', 'creationTimestamp': '2020-07-10T10:49:37Z', 'labels': {'pod-template-hash': '677ffc8869', 'run': 'live-test1'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'live-test1-677ffc8869', 'uid': '8c0ead0e-0e53-4e6d-a864-b65ad37c5c18', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'containers': [{'name': 'live-test1', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T10:49:37Z'}, {'type': 'Ready', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:37:15Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test1]'}, {'type': 'ContainersReady', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:37:15Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test1]'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T10:49:37Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.7', 'startTime': '2020-07-10T10:49:37Z', 'containerStatuses': [{'name': 'live-test1', 'state': {'waiting': {'reason': 'CrashLoopBackOff', 'message': 'Back-off 5m0s restarting failed container=live-test1 pod=live-test1-677ffc8869-nvdk5_default(1bb35f10-321a-4dd0-b5dd-59488a1537c5)'}}, 'lastState': {'terminated': {'exitCode': 1, 'reason': 'Error', 'startedAt': '2020-07-16T14:37:13Z', 'finishedAt': '2020-07-16T14:37:14Z', 'containerID': 'containerd://ed497a89af5dc03d5ca6eab27d12083588d5c14607d68a708605b1fa3bb61341'}}, 'ready': False, 'restartCount': 1710, 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'imageID': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'containerID': 'containerd://ed497a89af5dc03d5ca6eab27d12083588d5c14607d68a708605b1fa3bb61341'}], 'qosClass': 'BestEffort'}}} 2020-07-16 14:37:38,801 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 10, 58, 2, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'live-test2-54d9dcd87-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '54d9dcd87', 'run': 'live-test2'}, 'managed_fields': None, 'name': 'live-test2-54d9dcd87-bsdvc', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'live-test2-54d9dcd87', 'uid': 'd5763685-12a1-4103-8892-dc97fbdfd081'}], 'resource_version': '1241586', 'self_link': '/api/v1/namespaces/default/pods/live-test2-54d9dcd87-bsdvc', 'uid': '4207ade2-9821-446c-ba06-f7a392fee6fd'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test2', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 10, 58, 2, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 33, 9, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test2]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 33, 9, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test2]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 10, 58, 2, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://361ef5806f82f60323fa6924c4146814f56b3111ee12b8a4e0f4cd759bc03e51', 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'image_id': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'last_state': {'running': None, 'terminated': {'container_id': 'containerd://361ef5806f82f60323fa6924c4146814f56b3111ee12b8a4e0f4cd759bc03e51', 'exit_code': 1, 'finished_at': datetime.datetime(2020, 7, 16, 14, 33, 8, tzinfo=tzlocal()), 'message': None, 'reason': 'Error', 'signal': None, 'started_at': datetime.datetime(2020, 7, 16, 14, 33, 7, tzinfo=tzlocal())}, 'waiting': None}, 'name': 'live-test2', 'ready': False, 'restart_count': 1710, 'state': {'running': None, 'terminated': None, 'waiting': {'message': 'Back-off ' '5m0s ' 'restarting ' 'failed ' 'container=live-test2 ' 'pod=live-test2-54d9dcd87-bsdvc_default(4207ade2-9821-446c-ba06-f7a392fee6fd)', 'reason': 'CrashLoopBackOff'}}}], 'host_ip': '172.18.0.5', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.8', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 10, 10, 58, 2, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test2-54d9dcd87-bsdvc', 'generateName': 'live-test2-54d9dcd87-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test2-54d9dcd87-bsdvc', 'uid': '4207ade2-9821-446c-ba06-f7a392fee6fd', 'resourceVersion': '1241586', 'creationTimestamp': '2020-07-10T10:58:02Z', 'labels': {'pod-template-hash': '54d9dcd87', 'run': 'live-test2'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'live-test2-54d9dcd87', 'uid': 'd5763685-12a1-4103-8892-dc97fbdfd081', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'containers': [{'name': 'live-test2', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T10:58:02Z'}, {'type': 'Ready', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:33:09Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test2]'}, {'type': 'ContainersReady', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:33:09Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test2]'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T10:58:02Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.8', 'startTime': '2020-07-10T10:58:02Z', 'containerStatuses': [{'name': 'live-test2', 'state': {'waiting': {'reason': 'CrashLoopBackOff', 'message': 'Back-off 5m0s restarting failed container=live-test2 pod=live-test2-54d9dcd87-bsdvc_default(4207ade2-9821-446c-ba06-f7a392fee6fd)'}}, 'lastState': {'terminated': {'exitCode': 1, 'reason': 'Error', 'startedAt': '2020-07-16T14:33:07Z', 'finishedAt': '2020-07-16T14:33:08Z', 'containerID': 'containerd://361ef5806f82f60323fa6924c4146814f56b3111ee12b8a4e0f4cd759bc03e51'}}, 'ready': False, 'restartCount': 1710, 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'imageID': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'containerID': 'containerd://361ef5806f82f60323fa6924c4146814f56b3111ee12b8a4e0f4cd759bc03e51'}], 'qosClass': 'BestEffort'}}} 2020-07-16 14:37:38,819 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 6, 28, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'live-test5-b6fcb7757-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': 'b6fcb7757', 'run': 'live-test5'}, 'managed_fields': None, 'name': 'live-test5-b6fcb7757-w869x', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'live-test5-b6fcb7757', 'uid': '36f2bc87-4a91-4618-ab50-e994944be46b'}], 'resource_version': '1241782', 'self_link': '/api/v1/namespaces/default/pods/live-test5-b6fcb7757-w869x', 'uid': '019da30b-30ef-440c-a083-30e5b4ddc74a'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test5', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 6, 28, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 34, 33, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test5]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 34, 33, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test5]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 6, 28, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://f007890998757245dc3df2a0347eb1ac6805efb14d42ab8d9992160791cfc65f', 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'image_id': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'last_state': {'running': None, 'terminated': {'container_id': 'containerd://f007890998757245dc3df2a0347eb1ac6805efb14d42ab8d9992160791cfc65f', 'exit_code': 1, 'finished_at': datetime.datetime(2020, 7, 16, 14, 34, 32, tzinfo=tzlocal()), 'message': None, 'reason': 'Error', 'signal': None, 'started_at': datetime.datetime(2020, 7, 16, 14, 34, 31, tzinfo=tzlocal())}, 'waiting': None}, 'name': 'live-test5', 'ready': False, 'restart_count': 1706, 'state': {'running': None, 'terminated': None, 'waiting': {'message': 'Back-off ' '5m0s ' 'restarting ' 'failed ' 'container=live-test5 ' 'pod=live-test5-b6fcb7757-w869x_default(019da30b-30ef-440c-a083-30e5b4ddc74a)', 'reason': 'CrashLoopBackOff'}}}], 'host_ip': '172.18.0.5', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.10', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 10, 11, 6, 28, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test5-b6fcb7757-w869x', 'generateName': 'live-test5-b6fcb7757-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test5-b6fcb7757-w869x', 'uid': '019da30b-30ef-440c-a083-30e5b4ddc74a', 'resourceVersion': '1241782', 'creationTimestamp': '2020-07-10T11:06:28Z', 'labels': {'pod-template-hash': 'b6fcb7757', 'run': 'live-test5'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'live-test5-b6fcb7757', 'uid': '36f2bc87-4a91-4618-ab50-e994944be46b', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'containers': [{'name': 'live-test5', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:06:28Z'}, {'type': 'Ready', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:34:33Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test5]'}, {'type': 'ContainersReady', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:34:33Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test5]'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:06:28Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.10', 'startTime': '2020-07-10T11:06:28Z', 'containerStatuses': [{'name': 'live-test5', 'state': {'waiting': {'reason': 'CrashLoopBackOff', 'message': 'Back-off 5m0s restarting failed container=live-test5 pod=live-test5-b6fcb7757-w869x_default(019da30b-30ef-440c-a083-30e5b4ddc74a)'}}, 'lastState': {'terminated': {'exitCode': 1, 'reason': 'Error', 'startedAt': '2020-07-16T14:34:31Z', 'finishedAt': '2020-07-16T14:34:32Z', 'containerID': 'containerd://f007890998757245dc3df2a0347eb1ac6805efb14d42ab8d9992160791cfc65f'}}, 'ready': False, 'restartCount': 1706, 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'imageID': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'containerID': 'containerd://f007890998757245dc3df2a0347eb1ac6805efb14d42ab8d9992160791cfc65f'}], 'qosClass': 'BestEffort'}}} 2020-07-16 14:37:38,835 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'bono-5cdb7bfcdd-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '5cdb7bfcdd', 'service': 'bono', 'snmp': 'enabled'}, 'managed_fields': None, 'name': 'bono-5cdb7bfcdd-gplnb', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'bono-5cdb7bfcdd', 'uid': '3ca38339-e27f-4562-a7b5-4eae992b283b'}], 'resource_version': '1242239', 'self_link': '/api/v1/namespaces/default/pods/bono-5cdb7bfcdd-gplnb', 'uid': 'ce34bdac-a12e-4bdd-8682-bf53bb6420d5'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-bono:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 ' '5062']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'bono', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 3478, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5060, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5062, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5060, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'UDP'}, {'container_port': 5062, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'UDP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 ' '5062']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/bono', 'mount_propagation': None, 'name': 'bonologs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/bono/bono_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/bono', 'mount_propagation': None, 'name': 'bonologs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup sprout; do echo ' 'waiting for sprout to start ...; ' 'sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'iruya-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'bonologs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}, {'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 36, 55, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 37, 23, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 37, 23, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://5f9181f43d26c5ba88035b74a836ddbd2ececcdc63722d8c90337d372fab09df', 'image': 'docker.io/ollivier/clearwater-bono:latest', 'image_id': 'docker.io/ollivier/clearwater-bono@sha256:25b1c4759aa4dd92b752451e64f9df5f4a6336d74a15dd5914fbb83ab81ab9f4', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'bono', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 16, 14, 37, 10, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}, {'container_id': 'containerd://45fb4aa5aa9155aa67cdd94037e1b7aa2b3a25eb3189c6a49b5be4642429e035', 'image': 'docker.io/library/busybox:latest', 'image_id': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'tailer', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 16, 14, 37, 17, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.9', 'init_container_statuses': [{'container_id': 'containerd://8c08a8553a18d9d91621cac3b030a2e0fa6a56e75bb741a99475114dfef5f7f8', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-sprout', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://8c08a8553a18d9d91621cac3b030a2e0fa6a56e75bb741a99475114dfef5f7f8', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 16, 14, 36, 54, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 16, 14, 32, 43, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.153', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'bono-5cdb7bfcdd-gplnb', 'generateName': 'bono-5cdb7bfcdd-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/bono-5cdb7bfcdd-gplnb', 'uid': 'ce34bdac-a12e-4bdd-8682-bf53bb6420d5', 'resourceVersion': '1242239', 'creationTimestamp': '2020-07-16T14:32:35Z', 'labels': {'pod-template-hash': '5cdb7bfcdd', 'service': 'bono', 'snmp': 'enabled'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'bono-5cdb7bfcdd', 'uid': '3ca38339-e27f-4562-a7b5-4eae992b283b', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'bonologs', 'emptyDir': {}}, {'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'bono', 'image': 'ollivier/clearwater-bono:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 3478, 'protocol': 'TCP'}, {'containerPort': 5060, 'protocol': 'TCP'}, {'containerPort': 5062, 'protocol': 'TCP'}, {'containerPort': 5060, 'protocol': 'UDP'}, {'containerPort': 5062, 'protocol': 'UDP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'bonologs', 'mountPath': '/var/log/bono'}, {'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 5062']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 5062']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/bono/bono_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'bonologs', 'mountPath': '/var/log/bono'}, {'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:36:55Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:37:23Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:37:23Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:32:35Z'}], 'hostIP': '172.18.0.9', 'podIP': '10.244.2.153', 'startTime': '2020-07-16T14:32:35Z', 'initContainerStatuses': [{'name': 'wait-on-sprout', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-16T14:32:43Z', 'finishedAt': '2020-07-16T14:36:54Z', 'containerID': 'containerd://8c08a8553a18d9d91621cac3b030a2e0fa6a56e75bb741a99475114dfef5f7f8'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://8c08a8553a18d9d91621cac3b030a2e0fa6a56e75bb741a99475114dfef5f7f8'}], 'containerStatuses': [{'name': 'bono', 'state': {'running': {'startedAt': '2020-07-16T14:37:10Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-bono:latest', 'imageID': 'docker.io/ollivier/clearwater-bono@sha256:25b1c4759aa4dd92b752451e64f9df5f4a6336d74a15dd5914fbb83ab81ab9f4', 'containerID': 'containerd://5f9181f43d26c5ba88035b74a836ddbd2ececcdc63722d8c90337d372fab09df'}, {'name': 'tailer', 'state': {'running': {'startedAt': '2020-07-16T14:37:17Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:latest', 'imageID': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'containerID': 'containerd://45fb4aa5aa9155aa67cdd94037e1b7aa2b3a25eb3189c6a49b5be4642429e035'}], 'qosClass': 'BestEffort'}}} 2020-07-16 14:37:38,865 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 0, 4, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'live-test3-6556bf7d77-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '6556bf7d77', 'run': 'live-test3'}, 'managed_fields': None, 'name': 'live-test3-6556bf7d77-2k9dg', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'live-test3-6556bf7d77', 'uid': 'ae0f16c1-4489-44cd-a9fe-d94031eb8eca'}], 'resource_version': '1241573', 'self_link': '/api/v1/namespaces/default/pods/live-test3-6556bf7d77-2k9dg', 'uid': 'b882c1fd-7708-4a01-8d12-ebbdd4f09b7e'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test3', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 0, 5, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 33, 5, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test3]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 33, 5, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test3]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 0, 4, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://7eaf193ecb1d41f492e10df9e66ba169a7bbac909e8d3a156c32cebf192f648e', 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'image_id': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'last_state': {'running': None, 'terminated': {'container_id': 'containerd://7eaf193ecb1d41f492e10df9e66ba169a7bbac909e8d3a156c32cebf192f648e', 'exit_code': 1, 'finished_at': datetime.datetime(2020, 7, 16, 14, 33, 4, tzinfo=tzlocal()), 'message': None, 'reason': 'Error', 'signal': None, 'started_at': datetime.datetime(2020, 7, 16, 14, 33, 3, tzinfo=tzlocal())}, 'waiting': None}, 'name': 'live-test3', 'ready': False, 'restart_count': 1706, 'state': {'running': None, 'terminated': None, 'waiting': {'message': 'Back-off ' '5m0s ' 'restarting ' 'failed ' 'container=live-test3 ' 'pod=live-test3-6556bf7d77-2k9dg_default(b882c1fd-7708-4a01-8d12-ebbdd4f09b7e)', 'reason': 'CrashLoopBackOff'}}}], 'host_ip': '172.18.0.5', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.9', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 10, 11, 0, 5, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test3-6556bf7d77-2k9dg', 'generateName': 'live-test3-6556bf7d77-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test3-6556bf7d77-2k9dg', 'uid': 'b882c1fd-7708-4a01-8d12-ebbdd4f09b7e', 'resourceVersion': '1241573', 'creationTimestamp': '2020-07-10T11:00:04Z', 'labels': {'pod-template-hash': '6556bf7d77', 'run': 'live-test3'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'live-test3-6556bf7d77', 'uid': 'ae0f16c1-4489-44cd-a9fe-d94031eb8eca', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'containers': [{'name': 'live-test3', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:00:05Z'}, {'type': 'Ready', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:33:05Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test3]'}, {'type': 'ContainersReady', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:33:05Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test3]'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:00:04Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.9', 'startTime': '2020-07-10T11:00:05Z', 'containerStatuses': [{'name': 'live-test3', 'state': {'waiting': {'reason': 'CrashLoopBackOff', 'message': 'Back-off 5m0s restarting failed container=live-test3 pod=live-test3-6556bf7d77-2k9dg_default(b882c1fd-7708-4a01-8d12-ebbdd4f09b7e)'}}, 'lastState': {'terminated': {'exitCode': 1, 'reason': 'Error', 'startedAt': '2020-07-16T14:33:03Z', 'finishedAt': '2020-07-16T14:33:04Z', 'containerID': 'containerd://7eaf193ecb1d41f492e10df9e66ba169a7bbac909e8d3a156c32cebf192f648e'}}, 'ready': False, 'restartCount': 1706, 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'imageID': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'containerID': 'containerd://7eaf193ecb1d41f492e10df9e66ba169a7bbac909e8d3a156c32cebf192f648e'}], 'qosClass': 'BestEffort'}}} 2020-07-16 14:37:38,880 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'etcd-5cbf55c8c-', 'generation': None, 'initializers': None, 'labels': {'instance-type': 'etcd-pod', 'pod-template-hash': '5cbf55c8c'}, 'managed_fields': None, 'name': 'etcd-5cbf55c8c-8cdjn', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'etcd-5cbf55c8c', 'uid': '259f2ac3-8862-478e-b247-36faab08dd02'}], 'resource_version': '1241514', 'self_link': '/api/v1/namespaces/default/pods/etcd-5cbf55c8c-8cdjn', 'uid': 'b08d4492-2380-4af6-8a77-4d2a64dd9550'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': ['--name', '$(MY_POD_NAME)', '--advertise-client-urls', 'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', '--listen-client-urls', 'http://0.0.0.0:2379,http://0.0.0.0:4001', '--initial-advertise-peer-urls', 'http://$(MY_POD_IP):2380', '--listen-peer-urls', 'http://0.0.0.0:2380', '--initial-cluster', '$(MY_POD_NAME)=http://$(MY_POD_IP):2380', '--initial-cluster-state', 'new'], 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}, {'name': 'MY_POD_NAME', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'metadata.name'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': None, 'image': 'quay.io/coreos/etcd:v2.2.5', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 300, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 4001}, 'timeout_seconds': 1}, 'name': 'etcd', 'ports': [{'container_port': 2379, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 2380, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 4001, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 4001}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': None, 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 55, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 55, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://1336e652953a5db5ef978784148a04d32cbd6aa476278bdf770307e075c61372', 'image': 'quay.io/coreos/etcd:v2.2.5', 'image_id': 'sha256:66590e2dd05422771324d8ffe9ad35165ba35db0842ac5e0f1668c2d56733860', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'etcd', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 16, 14, 32, 45, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.5', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.244', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'etcd-5cbf55c8c-8cdjn', 'generateName': 'etcd-5cbf55c8c-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/etcd-5cbf55c8c-8cdjn', 'uid': 'b08d4492-2380-4af6-8a77-4d2a64dd9550', 'resourceVersion': '1241514', 'creationTimestamp': '2020-07-16T14:32:35Z', 'labels': {'instance-type': 'etcd-pod', 'pod-template-hash': '5cbf55c8c'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'etcd-5cbf55c8c', 'uid': '259f2ac3-8862-478e-b247-36faab08dd02', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'containers': [{'name': 'etcd', 'image': 'quay.io/coreos/etcd:v2.2.5', 'args': ['--name', '$(MY_POD_NAME)', '--advertise-client-urls', 'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', '--listen-client-urls', 'http://0.0.0.0:2379,http://0.0.0.0:4001', '--initial-advertise-peer-urls', 'http://$(MY_POD_IP):2380', '--listen-peer-urls', 'http://0.0.0.0:2380', '--initial-cluster', '$(MY_POD_NAME)=http://$(MY_POD_IP):2380', '--initial-cluster-state', 'new'], 'ports': [{'containerPort': 2379, 'protocol': 'TCP'}, {'containerPort': 2380, 'protocol': 'TCP'}, {'containerPort': 4001, 'protocol': 'TCP'}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}, {'name': 'MY_POD_NAME', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'metadata.name'}}}], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'tcpSocket': {'port': 4001}, 'initialDelaySeconds': 300, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 4001}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:32:35Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:32:55Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:32:55Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:32:35Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.244', 'startTime': '2020-07-16T14:32:35Z', 'containerStatuses': [{'name': 'etcd', 'state': {'running': {'startedAt': '2020-07-16T14:32:45Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'quay.io/coreos/etcd:v2.2.5', 'imageID': 'sha256:66590e2dd05422771324d8ffe9ad35165ba35db0842ac5e0f1668c2d56733860', 'containerID': 'containerd://1336e652953a5db5ef978784148a04d32cbd6aa476278bdf770307e075c61372'}], 'qosClass': 'BestEffort'}}} 2020-07-16 14:37:38,901 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 36, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'sprout-686cc64cfb-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '686cc64cfb', 'service': 'sprout', 'snmp': 'enabled'}, 'managed_fields': None, 'name': 'sprout-686cc64cfb-xg4kw', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'sprout-686cc64cfb', 'uid': '4edbb62a-10c4-4708-b2a1-b62ea4824768'}], 'resource_version': '1242131', 'self_link': '/api/v1/namespaces/default/pods/sprout-686cc64cfb-xg4kw', 'uid': '53cbd20a-348e-409d-a502-dabc2ed1c6fc'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-sprout:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 3, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'sprout', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup ralf; do echo ' 'waiting for ralf to start ...; ' 'sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-ralf', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until nslookup chronos; do echo ' 'waiting for chronos to start ...; ' 'sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-chronos', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until nslookup homestead; do echo ' 'waiting for homestead to start ' '...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'iruya-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'sproutlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}, {'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 36, 29, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 36, 52, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 36, 52, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 36, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://51e0b739f4f1e30f0e68b9ce816d76246ce3d99244f0d861d2ac2131dcbdec53', 'image': 'docker.io/ollivier/clearwater-sprout:latest', 'image_id': 'docker.io/ollivier/clearwater-sprout@sha256:5a833832419bcf25ea1044768038c885ed4bad73225d5d07fc54eebc2a56662b', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'sprout', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 16, 14, 36, 37, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}, {'container_id': 'containerd://93331001228f335437200d632d41e6c04a1bcfb870a297f8755ab85d1604aeee', 'image': 'docker.io/library/busybox:latest', 'image_id': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'tailer', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 16, 14, 36, 40, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.9', 'init_container_statuses': [{'container_id': 'containerd://fec5c7127e62f8d50947faf87c4c180f9b230f3e0b1636bf81af0f8647ebb108', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-ralf', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://fec5c7127e62f8d50947faf87c4c180f9b230f3e0b1636bf81af0f8647ebb108', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 16, 14, 35, 19, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 16, 14, 32, 48, tzinfo=tzlocal())}, 'waiting': None}}, {'container_id': 'containerd://f70d5091b919d1e0899d1f7051d7ee8b9e439272ef678cda9664b142603a48fe', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-chronos', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://f70d5091b919d1e0899d1f7051d7ee8b9e439272ef678cda9664b142603a48fe', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 16, 14, 35, 22, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 16, 14, 35, 22, tzinfo=tzlocal())}, 'waiting': None}}, {'container_id': 'containerd://ccd18f06d867990e6f4b0244b8f2e35a12265ec9af93c3fda23c2bc505b4a6da', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-homestead', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://ccd18f06d867990e6f4b0244b8f2e35a12265ec9af93c3fda23c2bc505b4a6da', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 16, 14, 36, 27, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 16, 14, 35, 25, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.158', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 16, 14, 32, 36, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'sprout-686cc64cfb-xg4kw', 'generateName': 'sprout-686cc64cfb-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/sprout-686cc64cfb-xg4kw', 'uid': '53cbd20a-348e-409d-a502-dabc2ed1c6fc', 'resourceVersion': '1242131', 'creationTimestamp': '2020-07-16T14:32:36Z', 'labels': {'pod-template-hash': '686cc64cfb', 'service': 'sprout', 'snmp': 'enabled'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'sprout-686cc64cfb', 'uid': '4edbb62a-10c4-4708-b2a1-b62ea4824768', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'sproutlogs', 'emptyDir': {}}, {'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-ralf', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup ralf; do echo waiting for ralf to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-chronos', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup chronos; do echo waiting for chronos to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-homestead', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'sprout', 'image': 'ollivier/clearwater-sprout:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}, {'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 3, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}, {'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:36:29Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:36:52Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:36:52Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:32:36Z'}], 'hostIP': '172.18.0.9', 'podIP': '10.244.2.158', 'startTime': '2020-07-16T14:32:36Z', 'initContainerStatuses': [{'name': 'wait-on-ralf', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-16T14:32:48Z', 'finishedAt': '2020-07-16T14:35:19Z', 'containerID': 'containerd://fec5c7127e62f8d50947faf87c4c180f9b230f3e0b1636bf81af0f8647ebb108'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://fec5c7127e62f8d50947faf87c4c180f9b230f3e0b1636bf81af0f8647ebb108'}, {'name': 'wait-on-chronos', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-16T14:35:22Z', 'finishedAt': '2020-07-16T14:35:22Z', 'containerID': 'containerd://f70d5091b919d1e0899d1f7051d7ee8b9e439272ef678cda9664b142603a48fe'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://f70d5091b919d1e0899d1f7051d7ee8b9e439272ef678cda9664b142603a48fe'}, {'name': 'wait-on-homestead', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-16T14:35:25Z', 'finishedAt': '2020-07-16T14:36:27Z', 'containerID': 'containerd://ccd18f06d867990e6f4b0244b8f2e35a12265ec9af93c3fda23c2bc505b4a6da'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://ccd18f06d867990e6f4b0244b8f2e35a12265ec9af93c3fda23c2bc505b4a6da'}], 'containerStatuses': [{'name': 'sprout', 'state': {'running': {'startedAt': '2020-07-16T14:36:37Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-sprout:latest', 'imageID': 'docker.io/ollivier/clearwater-sprout@sha256:5a833832419bcf25ea1044768038c885ed4bad73225d5d07fc54eebc2a56662b', 'containerID': 'containerd://51e0b739f4f1e30f0e68b9ce816d76246ce3d99244f0d861d2ac2131dcbdec53'}, {'name': 'tailer', 'state': {'running': {'startedAt': '2020-07-16T14:36:40Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:latest', 'imageID': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'containerID': 'containerd://93331001228f335437200d632d41e6c04a1bcfb870a297f8755ab85d1604aeee'}], 'qosClass': 'BestEffort'}}} 2020-07-16 14:37:38,936 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 54, 47, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'live-test7-5dd99f9b45-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '5dd99f9b45', 'run': 'live-test7'}, 'managed_fields': None, 'name': 'live-test7-5dd99f9b45-jtpmp', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'live-test7-5dd99f9b45', 'uid': '8ed5db99-a572-42f0-9075-cb5fccdb5994'}], 'resource_version': '1242254', 'self_link': '/api/v1/namespaces/default/pods/live-test7-5dd99f9b45-jtpmp', 'uid': '14e71b26-1d97-42ed-afa2-17bea97954b0'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test7', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 54, 47, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 37, 15, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test7]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 37, 15, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test7]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 54, 47, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://01733f22bf0c6e648c00f359813e7a3ff57925ca2be4ded46975f0b00ddd5490', 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'image_id': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'last_state': {'running': None, 'terminated': {'container_id': 'containerd://01733f22bf0c6e648c00f359813e7a3ff57925ca2be4ded46975f0b00ddd5490', 'exit_code': 1, 'finished_at': datetime.datetime(2020, 7, 16, 14, 37, 14, tzinfo=tzlocal()), 'message': None, 'reason': 'Error', 'signal': None, 'started_at': datetime.datetime(2020, 7, 16, 14, 37, 13, tzinfo=tzlocal())}, 'waiting': None}, 'name': 'live-test7', 'ready': False, 'restart_count': 1693, 'state': {'running': None, 'terminated': None, 'waiting': {'message': 'Back-off ' '5m0s ' 'restarting ' 'failed ' 'container=live-test7 ' 'pod=live-test7-5dd99f9b45-jtpmp_default(14e71b26-1d97-42ed-afa2-17bea97954b0)', 'reason': 'CrashLoopBackOff'}}}], 'host_ip': '172.18.0.9', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.11', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 10, 11, 54, 47, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test7-5dd99f9b45-jtpmp', 'generateName': 'live-test7-5dd99f9b45-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test7-5dd99f9b45-jtpmp', 'uid': '14e71b26-1d97-42ed-afa2-17bea97954b0', 'resourceVersion': '1242254', 'creationTimestamp': '2020-07-10T11:54:47Z', 'labels': {'pod-template-hash': '5dd99f9b45', 'run': 'live-test7'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'live-test7-5dd99f9b45', 'uid': '8ed5db99-a572-42f0-9075-cb5fccdb5994', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'containers': [{'name': 'live-test7', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:54:47Z'}, {'type': 'Ready', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:37:15Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test7]'}, {'type': 'ContainersReady', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:37:15Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test7]'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:54:47Z'}], 'hostIP': '172.18.0.9', 'podIP': '10.244.2.11', 'startTime': '2020-07-10T11:54:47Z', 'containerStatuses': [{'name': 'live-test7', 'state': {'waiting': {'reason': 'CrashLoopBackOff', 'message': 'Back-off 5m0s restarting failed container=live-test7 pod=live-test7-5dd99f9b45-jtpmp_default(14e71b26-1d97-42ed-afa2-17bea97954b0)'}}, 'lastState': {'terminated': {'exitCode': 1, 'reason': 'Error', 'startedAt': '2020-07-16T14:37:13Z', 'finishedAt': '2020-07-16T14:37:14Z', 'containerID': 'containerd://01733f22bf0c6e648c00f359813e7a3ff57925ca2be4ded46975f0b00ddd5490'}}, 'ready': False, 'restartCount': 1693, 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'imageID': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'containerID': 'containerd://01733f22bf0c6e648c00f359813e7a3ff57925ca2be4ded46975f0b00ddd5490'}], 'qosClass': 'BestEffort'}}} 2020-07-16 14:37:38,951 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'homer-74dd4556d9-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '74dd4556d9', 'service': 'homer'}, 'managed_fields': None, 'name': 'homer-74dd4556d9-9gtr9', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'homer-74dd4556d9', 'uid': 'b3f48afb-ef77-43c7-83b1-3bbc38f7669f'}], 'resource_version': '1241857', 'self_link': '/api/v1/namespaces/default/pods/homer-74dd4556d9-9gtr9', 'uid': 'b5046e8c-7e94-493f-8d27-43f728eb8323'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homer:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'name': 'homer', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup cassandra; do echo ' 'waiting for cassandra to start ' '...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'iruya-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 34, 44, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 35, 6, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 35, 6, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://240f04523e3e72c0399c36c52a5d21fbb611f7d659121834d86a6d6406caf302', 'image': 'docker.io/ollivier/clearwater-homer:latest', 'image_id': 'docker.io/ollivier/clearwater-homer@sha256:69b5406c3dcf61c95a067571c873b8691dc7cb23b24dbe3749b0a1d2b7c08ca9', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'homer', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 16, 14, 34, 51, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.9', 'init_container_statuses': [{'container_id': 'containerd://db4c00f0e99bfb31d44ec944425730ccc49a64fced78beedca8e508e43e5f01d', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-cassandra', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://db4c00f0e99bfb31d44ec944425730ccc49a64fced78beedca8e508e43e5f01d', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 16, 14, 34, 42, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 16, 14, 32, 48, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.156', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'homer-74dd4556d9-9gtr9', 'generateName': 'homer-74dd4556d9-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/homer-74dd4556d9-9gtr9', 'uid': 'b5046e8c-7e94-493f-8d27-43f728eb8323', 'resourceVersion': '1241857', 'creationTimestamp': '2020-07-16T14:32:35Z', 'labels': {'pod-template-hash': '74dd4556d9', 'service': 'homer'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'homer-74dd4556d9', 'uid': 'b3f48afb-ef77-43c7-83b1-3bbc38f7669f', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homer', 'image': 'ollivier/clearwater-homer:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'tcpSocket': {'port': 7888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 7888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:34:44Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:35:06Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:35:06Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:32:35Z'}], 'hostIP': '172.18.0.9', 'podIP': '10.244.2.156', 'startTime': '2020-07-16T14:32:35Z', 'initContainerStatuses': [{'name': 'wait-on-cassandra', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-16T14:32:48Z', 'finishedAt': '2020-07-16T14:34:42Z', 'containerID': 'containerd://db4c00f0e99bfb31d44ec944425730ccc49a64fced78beedca8e508e43e5f01d'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://db4c00f0e99bfb31d44ec944425730ccc49a64fced78beedca8e508e43e5f01d'}], 'containerStatuses': [{'name': 'homer', 'state': {'running': {'startedAt': '2020-07-16T14:34:51Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-homer:latest', 'imageID': 'docker.io/ollivier/clearwater-homer@sha256:69b5406c3dcf61c95a067571c873b8691dc7cb23b24dbe3749b0a1d2b7c08ca9', 'containerID': 'containerd://240f04523e3e72c0399c36c52a5d21fbb611f7d659121834d86a6d6406caf302'}], 'qosClass': 'BestEffort'}}} 2020-07-16 14:37:38,973 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'astaire-5ddcdd6b7f-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '5ddcdd6b7f', 'service': 'astaire'}, 'managed_fields': None, 'name': 'astaire-5ddcdd6b7f-gqbj6', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'astaire-5ddcdd6b7f', 'uid': '32a3b0fc-14ac-4174-a23d-98dc9c247319'}], 'resource_version': '1241956', 'self_link': '/api/v1/namespaces/default/pods/astaire-5ddcdd6b7f-gqbj6', 'uid': '35a04a0d-5433-454a-83e2-908acdc5f80c'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-astaire:latest', 'image_pull_policy': 'Always', 'lifecycle': {'post_start': None, 'pre_stop': {'_exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}, 'http_get': None, 'tcp_socket': None}}, 'liveness_probe': {'_exec': None, 'failure_threshold': 9, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 11311}, 'timeout_seconds': 1}, 'name': 'astaire', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 11211, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 11311, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 11311}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/astaire', 'mount_propagation': None, 'name': 'astairelogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/astaire/astaire_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/astaire', 'mount_propagation': None, 'name': 'astairelogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup cassandra; do echo ' 'waiting for cassandra to start ' '...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'iruya-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 120, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'astairelogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}, {'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 34, 46, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 35, 43, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 35, 43, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://c12be07261bbfd9d9fc347aa71e4d60f3668b1f9bf4d94428b892126cd98a4a1', 'image': 'docker.io/ollivier/clearwater-astaire:latest', 'image_id': 'docker.io/ollivier/clearwater-astaire@sha256:24e9186a8be32af9559f4d198c5c423eaac0d6c7b827c5ab674f2d124385c2fb', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'astaire', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 16, 14, 34, 56, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}, {'container_id': 'containerd://9c013f6be2c6bf0a9a7c40216350557b79d2008bb0e934d4083e4a1c704204f8', 'image': 'docker.io/library/busybox:latest', 'image_id': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'tailer', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 16, 14, 35, 1, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.9', 'init_container_statuses': [{'container_id': 'containerd://fcd9c70d173d0bc910d71206bc529fd25088859cbfcb7f68de6a32aa1651f8d9', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-cassandra', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://fcd9c70d173d0bc910d71206bc529fd25088859cbfcb7f68de6a32aa1651f8d9', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 16, 14, 34, 45, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 16, 14, 32, 40, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.152', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'astaire-5ddcdd6b7f-gqbj6', 'generateName': 'astaire-5ddcdd6b7f-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/astaire-5ddcdd6b7f-gqbj6', 'uid': '35a04a0d-5433-454a-83e2-908acdc5f80c', 'resourceVersion': '1241956', 'creationTimestamp': '2020-07-16T14:32:35Z', 'labels': {'pod-template-hash': '5ddcdd6b7f', 'service': 'astaire'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'astaire-5ddcdd6b7f', 'uid': '32a3b0fc-14ac-4174-a23d-98dc9c247319', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'astairelogs', 'emptyDir': {}}, {'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'astaire', 'image': 'ollivier/clearwater-astaire:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 11211, 'protocol': 'TCP'}, {'containerPort': 11311, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'astairelogs', 'mountPath': '/var/log/astaire'}, {'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'tcpSocket': {'port': 11311}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 9}, 'readinessProbe': {'tcpSocket': {'port': 11311}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'lifecycle': {'preStop': {'exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}}}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/astaire/astaire_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'astairelogs', 'mountPath': '/var/log/astaire'}, {'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 120, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:34:46Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:35:43Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:35:43Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:32:35Z'}], 'hostIP': '172.18.0.9', 'podIP': '10.244.2.152', 'startTime': '2020-07-16T14:32:35Z', 'initContainerStatuses': [{'name': 'wait-on-cassandra', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-16T14:32:40Z', 'finishedAt': '2020-07-16T14:34:45Z', 'containerID': 'containerd://fcd9c70d173d0bc910d71206bc529fd25088859cbfcb7f68de6a32aa1651f8d9'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://fcd9c70d173d0bc910d71206bc529fd25088859cbfcb7f68de6a32aa1651f8d9'}], 'containerStatuses': [{'name': 'astaire', 'state': {'running': {'startedAt': '2020-07-16T14:34:56Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-astaire:latest', 'imageID': 'docker.io/ollivier/clearwater-astaire@sha256:24e9186a8be32af9559f4d198c5c423eaac0d6c7b827c5ab674f2d124385c2fb', 'containerID': 'containerd://c12be07261bbfd9d9fc347aa71e4d60f3668b1f9bf4d94428b892126cd98a4a1'}, {'name': 'tailer', 'state': {'running': {'startedAt': '2020-07-16T14:35:01Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:latest', 'imageID': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'containerID': 'containerd://9c013f6be2c6bf0a9a7c40216350557b79d2008bb0e934d4083e4a1c704204f8'}], 'qosClass': 'BestEffort'}}} 2020-07-16 14:37:39,003 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'homestead-prov-756c8bff5d-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '756c8bff5d', 'service': 'homestead-prov', 'snmp': 'enabled'}, 'managed_fields': None, 'name': 'homestead-prov-756c8bff5d-92gmx', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'homestead-prov-756c8bff5d', 'uid': '4f722fc1-7616-4475-bc2a-316303a44d48'}], 'resource_version': '1242122', 'self_link': '/api/v1/namespaces/default/pods/homestead-prov-756c8bff5d-92gmx', 'uid': '2ef4f9cb-ec29-4659-9b8a-9125ddf3730e'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead-prov:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead-prov', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8889, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup homestead; do echo ' 'waiting for homestead to start ' '...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'iruya-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 36, 29, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 36, 49, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 36, 49, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://a6366cafd225db6d33be62d8361b2da28da71deda25a33836139dffce21d28ef', 'image': 'docker.io/ollivier/clearwater-homestead-prov:latest', 'image_id': 'docker.io/ollivier/clearwater-homestead-prov@sha256:21ea1bbce8747d80fc46c07ee0bdb94653036ee544413853074f39900798a7d8', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'homestead-prov', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 16, 14, 36, 34, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.9', 'init_container_statuses': [{'container_id': 'containerd://5aa906c657ef2c6da2116217b28452622679f33a0413f2b69c7d6e2abc422b62', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-homestead', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://5aa906c657ef2c6da2116217b28452622679f33a0413f2b69c7d6e2abc422b62', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 16, 14, 36, 27, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 16, 14, 32, 48, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.157', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'homestead-prov-756c8bff5d-92gmx', 'generateName': 'homestead-prov-756c8bff5d-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/homestead-prov-756c8bff5d-92gmx', 'uid': '2ef4f9cb-ec29-4659-9b8a-9125ddf3730e', 'resourceVersion': '1242122', 'creationTimestamp': '2020-07-16T14:32:35Z', 'labels': {'pod-template-hash': '756c8bff5d', 'service': 'homestead-prov', 'snmp': 'enabled'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'homestead-prov-756c8bff5d', 'uid': '4f722fc1-7616-4475-bc2a-316303a44d48', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-homestead', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead-prov', 'image': 'ollivier/clearwater-homestead-prov:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8889, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:36:29Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:36:49Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:36:49Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:32:35Z'}], 'hostIP': '172.18.0.9', 'podIP': '10.244.2.157', 'startTime': '2020-07-16T14:32:35Z', 'initContainerStatuses': [{'name': 'wait-on-homestead', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-16T14:32:48Z', 'finishedAt': '2020-07-16T14:36:27Z', 'containerID': 'containerd://5aa906c657ef2c6da2116217b28452622679f33a0413f2b69c7d6e2abc422b62'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://5aa906c657ef2c6da2116217b28452622679f33a0413f2b69c7d6e2abc422b62'}], 'containerStatuses': [{'name': 'homestead-prov', 'state': {'running': {'startedAt': '2020-07-16T14:36:34Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-homestead-prov:latest', 'imageID': 'docker.io/ollivier/clearwater-homestead-prov@sha256:21ea1bbce8747d80fc46c07ee0bdb94653036ee544413853074f39900798a7d8', 'containerID': 'containerd://a6366cafd225db6d33be62d8361b2da28da71deda25a33836139dffce21d28ef'}], 'qosClass': 'BestEffort'}}} 2020-07-16 14:37:39,026 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'homestead-57586d6cdc-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '57586d6cdc', 'service': 'homestead', 'snmp': 'enabled'}, 'managed_fields': None, 'name': 'homestead-57586d6cdc-xsqgq', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'homestead-57586d6cdc', 'uid': 'ed268e9d-6eea-481e-bf6d-7cedfef1418c'}], 'resource_version': '1242017', 'self_link': '/api/v1/namespaces/default/pods/homestead-57586d6cdc-xsqgq', 'uid': '1b3f6b76-255d-4be7-9c3c-b54fcd9f658b'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/homestead', 'mount_propagation': None, 'name': 'homesteadlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/homestead/homestead_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/homestead', 'mount_propagation': None, 'name': 'homesteadlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup cassandra; do echo ' 'waiting for cassandra to start ' '...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until nslookup astaire; do echo ' 'waiting for astaire to start ...; ' 'sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-astaire', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'homesteadlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}, {'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 35, 53, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 36, 8, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 36, 8, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://f6fb88bcb3b7aed8987f2acd7b1bce31f47b3074ebed42c527ca7f8af5cb370f', 'image': 'docker.io/ollivier/clearwater-homestead:latest', 'image_id': 'docker.io/ollivier/clearwater-homestead@sha256:6eebbdbc9e424dd87b3d149b9fa1c779ad5c402e2f7ef414ec585a43ebb782d6', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'homestead', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 16, 14, 35, 58, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}, {'container_id': 'containerd://14aa6c21b4946922a61719f586c6ba789361a8d1bf64f5415778afb62bb27c46', 'image': 'docker.io/library/busybox:latest', 'image_id': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'tailer', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 16, 14, 36, 1, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.5', 'init_container_statuses': [{'container_id': 'containerd://d05a95268ee46c596d56559528d74200678f7c98a03e18ec2b41671c1edb3f8e', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-cassandra', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://d05a95268ee46c596d56559528d74200678f7c98a03e18ec2b41671c1edb3f8e', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 16, 14, 34, 43, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 16, 14, 32, 47, tzinfo=tzlocal())}, 'waiting': None}}, {'container_id': 'containerd://83daae012d193636ab6436bc36d17d3ce9beaf101562d3826272c3528e5574b6', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-astaire', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://83daae012d193636ab6436bc36d17d3ce9beaf101562d3826272c3528e5574b6', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 16, 14, 35, 52, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 16, 14, 34, 46, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.245', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'homestead-57586d6cdc-xsqgq', 'generateName': 'homestead-57586d6cdc-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/homestead-57586d6cdc-xsqgq', 'uid': '1b3f6b76-255d-4be7-9c3c-b54fcd9f658b', 'resourceVersion': '1242017', 'creationTimestamp': '2020-07-16T14:32:35Z', 'labels': {'pod-template-hash': '57586d6cdc', 'service': 'homestead', 'snmp': 'enabled'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'homestead-57586d6cdc', 'uid': 'ed268e9d-6eea-481e-bf6d-7cedfef1418c', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'homesteadlogs', 'emptyDir': {}}, {'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-astaire', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup astaire; do echo waiting for astaire to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead', 'image': 'ollivier/clearwater-homestead:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'homesteadlogs', 'mountPath': '/var/log/homestead'}, {'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/homestead/homestead_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'homesteadlogs', 'mountPath': '/var/log/homestead'}, {'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:35:53Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:36:08Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:36:08Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:32:35Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.245', 'startTime': '2020-07-16T14:32:35Z', 'initContainerStatuses': [{'name': 'wait-on-cassandra', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-16T14:32:47Z', 'finishedAt': '2020-07-16T14:34:43Z', 'containerID': 'containerd://d05a95268ee46c596d56559528d74200678f7c98a03e18ec2b41671c1edb3f8e'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://d05a95268ee46c596d56559528d74200678f7c98a03e18ec2b41671c1edb3f8e'}, {'name': 'wait-on-astaire', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-16T14:34:46Z', 'finishedAt': '2020-07-16T14:35:52Z', 'containerID': 'containerd://83daae012d193636ab6436bc36d17d3ce9beaf101562d3826272c3528e5574b6'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://83daae012d193636ab6436bc36d17d3ce9beaf101562d3826272c3528e5574b6'}], 'containerStatuses': [{'name': 'homestead', 'state': {'running': {'startedAt': '2020-07-16T14:35:58Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-homestead:latest', 'imageID': 'docker.io/ollivier/clearwater-homestead@sha256:6eebbdbc9e424dd87b3d149b9fa1c779ad5c402e2f7ef414ec585a43ebb782d6', 'containerID': 'containerd://f6fb88bcb3b7aed8987f2acd7b1bce31f47b3074ebed42c527ca7f8af5cb370f'}, {'name': 'tailer', 'state': {'running': {'startedAt': '2020-07-16T14:36:01Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:latest', 'imageID': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'containerID': 'containerd://14aa6c21b4946922a61719f586c6ba789361a8d1bf64f5415778afb62bb27c46'}], 'qosClass': 'BestEffort'}}} 2020-07-16 14:37:39,059 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'chronos-687b9884c5-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '687b9884c5', 'service': 'chronos'}, 'managed_fields': None, 'name': 'chronos-687b9884c5-gcrm7', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'chronos-687b9884c5', 'uid': '5b21a185-fe33-406f-a687-19c442fd3733'}], 'resource_version': '1241877', 'self_link': '/api/v1/namespaces/default/pods/chronos-687b9884c5-gcrm7', 'uid': 'd29946a7-ef74-4e1a-b40a-75472e8ee84b'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-chronos:latest', 'image_pull_policy': 'Always', 'lifecycle': {'post_start': None, 'pre_stop': {'_exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}, 'http_get': None, 'tcp_socket': None}}, 'liveness_probe': {'_exec': None, 'failure_threshold': 9, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7253}, 'timeout_seconds': 1}, 'name': 'chronos', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7253, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7253}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/chronos', 'mount_propagation': None, 'name': 'chronoslogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/chronos/chronos_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/chronos', 'mount_propagation': None, 'name': 'chronoslogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup cassandra; do echo ' 'waiting for cassandra to start ' '...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 120, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'chronoslogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}, {'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 34, 45, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 35, 13, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 35, 13, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://f33ae14f0d840742cc7578ad07378c488a0c0ed41201a0720b463a416f5103c5', 'image': 'docker.io/ollivier/clearwater-chronos:latest', 'image_id': 'docker.io/ollivier/clearwater-chronos@sha256:83359fb6320eefc0adbf56fcd4eb7a19be2c53dadaa4944a20510cc761536222', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'chronos', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 16, 14, 35, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}, {'container_id': 'containerd://4f95bc67c6f69bad046ed9415b566e19f270b04470745c5ce7ab36fa440bcd28', 'image': 'docker.io/library/busybox:latest', 'image_id': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'tailer', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 16, 14, 35, 4, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.5', 'init_container_statuses': [{'container_id': 'containerd://edef3da22bfc4b36689d143edcc9d875c5d2a0f042267a02e08dee327ba4c940', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-cassandra', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://edef3da22bfc4b36689d143edcc9d875c5d2a0f042267a02e08dee327ba4c940', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 16, 14, 34, 44, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 16, 14, 32, 44, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.243', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'chronos-687b9884c5-gcrm7', 'generateName': 'chronos-687b9884c5-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/chronos-687b9884c5-gcrm7', 'uid': 'd29946a7-ef74-4e1a-b40a-75472e8ee84b', 'resourceVersion': '1241877', 'creationTimestamp': '2020-07-16T14:32:35Z', 'labels': {'pod-template-hash': '687b9884c5', 'service': 'chronos'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'chronos-687b9884c5', 'uid': '5b21a185-fe33-406f-a687-19c442fd3733', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'chronoslogs', 'emptyDir': {}}, {'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'chronos', 'image': 'ollivier/clearwater-chronos:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7253, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'chronoslogs', 'mountPath': '/var/log/chronos'}, {'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'tcpSocket': {'port': 7253}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 9}, 'readinessProbe': {'tcpSocket': {'port': 7253}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'lifecycle': {'preStop': {'exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}}}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/chronos/chronos_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'chronoslogs', 'mountPath': '/var/log/chronos'}, {'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 120, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:34:45Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:35:13Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:35:13Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:32:35Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.243', 'startTime': '2020-07-16T14:32:35Z', 'initContainerStatuses': [{'name': 'wait-on-cassandra', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-16T14:32:44Z', 'finishedAt': '2020-07-16T14:34:44Z', 'containerID': 'containerd://edef3da22bfc4b36689d143edcc9d875c5d2a0f042267a02e08dee327ba4c940'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://edef3da22bfc4b36689d143edcc9d875c5d2a0f042267a02e08dee327ba4c940'}], 'containerStatuses': [{'name': 'chronos', 'state': {'running': {'startedAt': '2020-07-16T14:35:00Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-chronos:latest', 'imageID': 'docker.io/ollivier/clearwater-chronos@sha256:83359fb6320eefc0adbf56fcd4eb7a19be2c53dadaa4944a20510cc761536222', 'containerID': 'containerd://f33ae14f0d840742cc7578ad07378c488a0c0ed41201a0720b463a416f5103c5'}, {'name': 'tailer', 'state': {'running': {'startedAt': '2020-07-16T14:35:04Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:latest', 'imageID': 'docker.io/library/busybox@sha256:9ddee63a712cea977267342e8750ecbc60d3aab25f04ceacfa795e6fce341793', 'containerID': 'containerd://4f95bc67c6f69bad046ed9415b566e19f270b04470745c5ce7ab36fa440bcd28'}], 'qosClass': 'BestEffort'}}} 2020-07-16 14:37:39,089 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'ellis-57b84b6dd7-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '57b84b6dd7', 'service': 'ellis'}, 'managed_fields': None, 'name': 'ellis-57b84b6dd7-vrp8j', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'ellis-57b84b6dd7', 'uid': '8f5f16a9-292a-4641-a464-3c8c178fab01'}], 'resource_version': '1242280', 'self_link': '/api/v1/namespaces/default/pods/ellis-57b84b6dd7-vrp8j', 'uid': 'c94d0ca0-a119-4722-9c30-4e1bee3cfd66'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-ellis:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 80}, 'timeout_seconds': 1}, 'name': 'ellis', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 80, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 80}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup homestead-prov; do ' 'echo waiting for homestead-prov to ' 'start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead-prov', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until nslookup sprout; do echo ' 'waiting for sprout to start ...; ' 'sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'iruya-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 37, 16, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 37, 38, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 37, 38, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://758fe10fb1df86fc685bb6952aa32565279b69d08444405bd6a3256ed1273766', 'image': 'docker.io/ollivier/clearwater-ellis:latest', 'image_id': 'docker.io/ollivier/clearwater-ellis@sha256:ba47a8963e0683886890de11cf65942f3460ec4e2ad313f1e0fe0d144b12969b', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'ellis', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 16, 14, 37, 21, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.9', 'init_container_statuses': [{'container_id': 'containerd://a58ede85da4d8df6f2ec4a30b70106b7902d5ffd08979a255581912bfa3aa1b8', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-homestead-prov', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://a58ede85da4d8df6f2ec4a30b70106b7902d5ffd08979a255581912bfa3aa1b8', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 16, 14, 37, 5, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 16, 14, 32, 48, tzinfo=tzlocal())}, 'waiting': None}}, {'container_id': 'containerd://432e84f457cd9dddf14bd03dc250e9a1d827994ef87704f8c43142f44495a9af', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-sprout', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://432e84f457cd9dddf14bd03dc250e9a1d827994ef87704f8c43142f44495a9af', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 16, 14, 37, 15, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 16, 14, 37, 11, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.155', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 16, 14, 32, 35, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'ellis-57b84b6dd7-vrp8j', 'generateName': 'ellis-57b84b6dd7-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/ellis-57b84b6dd7-vrp8j', 'uid': 'c94d0ca0-a119-4722-9c30-4e1bee3cfd66', 'resourceVersion': '1242280', 'creationTimestamp': '2020-07-16T14:32:35Z', 'labels': {'pod-template-hash': '57b84b6dd7', 'service': 'ellis'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'ellis-57b84b6dd7', 'uid': '8f5f16a9-292a-4641-a464-3c8c178fab01', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-homestead-prov', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead-prov; do echo waiting for homestead-prov to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'ellis', 'image': 'ollivier/clearwater-ellis:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 80, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'tcpSocket': {'port': 80}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 80}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:37:16Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:37:38Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:37:38Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:32:35Z'}], 'hostIP': '172.18.0.9', 'podIP': '10.244.2.155', 'startTime': '2020-07-16T14:32:35Z', 'initContainerStatuses': [{'name': 'wait-on-homestead-prov', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-16T14:32:48Z', 'finishedAt': '2020-07-16T14:37:05Z', 'containerID': 'containerd://a58ede85da4d8df6f2ec4a30b70106b7902d5ffd08979a255581912bfa3aa1b8'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://a58ede85da4d8df6f2ec4a30b70106b7902d5ffd08979a255581912bfa3aa1b8'}, {'name': 'wait-on-sprout', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-16T14:37:11Z', 'finishedAt': '2020-07-16T14:37:15Z', 'containerID': 'containerd://432e84f457cd9dddf14bd03dc250e9a1d827994ef87704f8c43142f44495a9af'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://432e84f457cd9dddf14bd03dc250e9a1d827994ef87704f8c43142f44495a9af'}], 'containerStatuses': [{'name': 'ellis', 'state': {'running': {'startedAt': '2020-07-16T14:37:21Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-ellis:latest', 'imageID': 'docker.io/ollivier/clearwater-ellis@sha256:ba47a8963e0683886890de11cf65942f3460ec4e2ad313f1e0fe0d144b12969b', 'containerID': 'containerd://758fe10fb1df86fc685bb6952aa32565279b69d08444405bd6a3256ed1273766'}], 'qosClass': 'BestEffort'}}} 2020-07-16 14:37:39,117 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 37, 38, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'live-test', 'namespace': 'default', 'owner_references': None, 'resource_version': '1242288', 'self_link': '/api/v1/namespaces/default/pods/live-test', 'uid': 'e6ca5fd5-4d48-491c-a9b5-6235cd4ece9c'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Never', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 37, 38, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 37, 38, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 37, 38, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 37, 38, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_id': '', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'live-test', 'ready': False, 'restart_count': 0, 'state': {'running': None, 'terminated': None, 'waiting': {'message': None, 'reason': 'ContainerCreating'}}}], 'host_ip': '172.18.0.5', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Pending', 'pod_ip': None, 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 16, 14, 37, 38, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test', 'uid': 'e6ca5fd5-4d48-491c-a9b5-6235cd4ece9c', 'resourceVersion': '1242288', 'creationTimestamp': '2020-07-16T14:37:38Z'}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'containers': [{'name': 'live-test', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Never', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Pending', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:37:38Z'}, {'type': 'Ready', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:37:38Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test]'}, {'type': 'ContainersReady', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:37:38Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test]'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:37:38Z'}], 'hostIP': '172.18.0.5', 'startTime': '2020-07-16T14:37:38Z', 'containerStatuses': [{'name': 'live-test', 'state': {'waiting': {'reason': 'ContainerCreating'}}, 'lastState': {}, 'ready': False, 'restartCount': 0, 'image': 'ollivier/clearwater-live-test:latest', 'imageID': ''}], 'qosClass': 'BestEffort'}}} 2020-07-16 14:37:43,763 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 37, 38, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'live-test', 'namespace': 'default', 'owner_references': None, 'resource_version': '1242300', 'self_link': '/api/v1/namespaces/default/pods/live-test', 'uid': 'e6ca5fd5-4d48-491c-a9b5-6235cd4ece9c'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Never', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 37, 38, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 37, 43, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 37, 43, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 37, 38, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://aaf84d225e7cdc6abcf1abdbac3337bf87eb9caaf06d3414004bb80eb7c8e84e', 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'image_id': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'live-test', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 16, 14, 37, 42, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.5', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.247', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 16, 14, 37, 38, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test', 'uid': 'e6ca5fd5-4d48-491c-a9b5-6235cd4ece9c', 'resourceVersion': '1242300', 'creationTimestamp': '2020-07-16T14:37:38Z'}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'containers': [{'name': 'live-test', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Never', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:37:38Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:37:43Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:37:43Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:37:38Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.247', 'startTime': '2020-07-16T14:37:38Z', 'containerStatuses': [{'name': 'live-test', 'state': {'running': {'startedAt': '2020-07-16T14:37:42Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'imageID': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'containerID': 'containerd://aaf84d225e7cdc6abcf1abdbac3337bf87eb9caaf06d3414004bb80eb7c8e84e'}], 'qosClass': 'BestEffort'}}} 2020-07-16 14:37:45,778 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 22, 41, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'live-test6-988dbb567-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '988dbb567', 'run': 'live-test6'}, 'managed_fields': None, 'name': 'live-test6-988dbb567-rqc7x', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'live-test6-988dbb567', 'uid': '2aefcc7f-ce12-4f7f-a4a9-a58b67a26778'}], 'resource_version': '1242305', 'self_link': '/api/v1/namespaces/default/pods/live-test6-988dbb567-rqc7x', 'uid': 'd3a4086d-f6c3-49ab-8e6d-e47e0c9accc6'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test6', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 22, 41, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 37, 45, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 37, 45, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 22, 41, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://3961b1f55adb3945e4b6d47cb966d311d6a343202592b4a9fdb87bffdf708150', 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'image_id': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'last_state': {'running': None, 'terminated': {'container_id': 'containerd://ea1c69c3562e4ebbf5d32c5e03b1dedb886d208da87b11dc2130ac8fd3a4f755', 'exit_code': 1, 'finished_at': datetime.datetime(2020, 7, 16, 14, 32, 29, tzinfo=tzlocal()), 'message': None, 'reason': 'Error', 'signal': None, 'started_at': datetime.datetime(2020, 7, 16, 14, 32, 28, tzinfo=tzlocal())}, 'waiting': None}, 'name': 'live-test6', 'ready': True, 'restart_count': 1707, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 16, 14, 37, 44, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.5', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.11', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 10, 11, 22, 41, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test6-988dbb567-rqc7x', 'generateName': 'live-test6-988dbb567-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test6-988dbb567-rqc7x', 'uid': 'd3a4086d-f6c3-49ab-8e6d-e47e0c9accc6', 'resourceVersion': '1242305', 'creationTimestamp': '2020-07-10T11:22:41Z', 'labels': {'pod-template-hash': '988dbb567', 'run': 'live-test6'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'live-test6-988dbb567', 'uid': '2aefcc7f-ce12-4f7f-a4a9-a58b67a26778', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'containers': [{'name': 'live-test6', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:22:41Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:37:45Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:37:45Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:22:41Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.11', 'startTime': '2020-07-10T11:22:41Z', 'containerStatuses': [{'name': 'live-test6', 'state': {'running': {'startedAt': '2020-07-16T14:37:44Z'}}, 'lastState': {'terminated': {'exitCode': 1, 'reason': 'Error', 'startedAt': '2020-07-16T14:32:28Z', 'finishedAt': '2020-07-16T14:32:29Z', 'containerID': 'containerd://ea1c69c3562e4ebbf5d32c5e03b1dedb886d208da87b11dc2130ac8fd3a4f755'}}, 'ready': True, 'restartCount': 1707, 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'imageID': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'containerID': 'containerd://3961b1f55adb3945e4b6d47cb966d311d6a343202592b4a9fdb87bffdf708150'}], 'qosClass': 'BestEffort'}}} 2020-07-16 14:38:11,835 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 0, 4, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'live-test3-6556bf7d77-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '6556bf7d77', 'run': 'live-test3'}, 'managed_fields': None, 'name': 'live-test3-6556bf7d77-2k9dg', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'live-test3-6556bf7d77', 'uid': 'ae0f16c1-4489-44cd-a9fe-d94031eb8eca'}], 'resource_version': '1242360', 'self_link': '/api/v1/namespaces/default/pods/live-test3-6556bf7d77-2k9dg', 'uid': 'b882c1fd-7708-4a01-8d12-ebbdd4f09b7e'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test3', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 0, 5, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 38, 11, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 38, 11, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 0, 4, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://4d873faa683350123bd1b674dbcd5ec75743002ce0966d9608ac1a40ad171365', 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'image_id': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'last_state': {'running': None, 'terminated': {'container_id': 'containerd://7eaf193ecb1d41f492e10df9e66ba169a7bbac909e8d3a156c32cebf192f648e', 'exit_code': 1, 'finished_at': datetime.datetime(2020, 7, 16, 14, 33, 4, tzinfo=tzlocal()), 'message': None, 'reason': 'Error', 'signal': None, 'started_at': datetime.datetime(2020, 7, 16, 14, 33, 3, tzinfo=tzlocal())}, 'waiting': None}, 'name': 'live-test3', 'ready': True, 'restart_count': 1707, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 16, 14, 38, 11, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.5', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.9', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 10, 11, 0, 5, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test3-6556bf7d77-2k9dg', 'generateName': 'live-test3-6556bf7d77-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test3-6556bf7d77-2k9dg', 'uid': 'b882c1fd-7708-4a01-8d12-ebbdd4f09b7e', 'resourceVersion': '1242360', 'creationTimestamp': '2020-07-10T11:00:04Z', 'labels': {'pod-template-hash': '6556bf7d77', 'run': 'live-test3'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'live-test3-6556bf7d77', 'uid': 'ae0f16c1-4489-44cd-a9fe-d94031eb8eca', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'containers': [{'name': 'live-test3', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:00:05Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:38:11Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:38:11Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:00:04Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.9', 'startTime': '2020-07-10T11:00:05Z', 'containerStatuses': [{'name': 'live-test3', 'state': {'running': {'startedAt': '2020-07-16T14:38:11Z'}}, 'lastState': {'terminated': {'exitCode': 1, 'reason': 'Error', 'startedAt': '2020-07-16T14:33:03Z', 'finishedAt': '2020-07-16T14:33:04Z', 'containerID': 'containerd://7eaf193ecb1d41f492e10df9e66ba169a7bbac909e8d3a156c32cebf192f648e'}}, 'ready': True, 'restartCount': 1707, 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'imageID': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'containerID': 'containerd://4d873faa683350123bd1b674dbcd5ec75743002ce0966d9608ac1a40ad171365'}], 'qosClass': 'BestEffort'}}} 2020-07-16 14:38:12,839 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 10, 58, 2, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'live-test2-54d9dcd87-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '54d9dcd87', 'run': 'live-test2'}, 'managed_fields': None, 'name': 'live-test2-54d9dcd87-bsdvc', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'live-test2-54d9dcd87', 'uid': 'd5763685-12a1-4103-8892-dc97fbdfd081'}], 'resource_version': '1242366', 'self_link': '/api/v1/namespaces/default/pods/live-test2-54d9dcd87-bsdvc', 'uid': '4207ade2-9821-446c-ba06-f7a392fee6fd'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test2', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 10, 58, 2, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 38, 12, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 38, 12, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 10, 58, 2, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://08ac5cfdf2cac0438d4ebc6a5b4fef2ebec7dbf117f68f767aade9de68db65d0', 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'image_id': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'last_state': {'running': None, 'terminated': {'container_id': 'containerd://361ef5806f82f60323fa6924c4146814f56b3111ee12b8a4e0f4cd759bc03e51', 'exit_code': 1, 'finished_at': datetime.datetime(2020, 7, 16, 14, 33, 8, tzinfo=tzlocal()), 'message': None, 'reason': 'Error', 'signal': None, 'started_at': datetime.datetime(2020, 7, 16, 14, 33, 7, tzinfo=tzlocal())}, 'waiting': None}, 'name': 'live-test2', 'ready': True, 'restart_count': 1711, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 16, 14, 38, 12, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.5', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.8', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 10, 10, 58, 2, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test2-54d9dcd87-bsdvc', 'generateName': 'live-test2-54d9dcd87-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test2-54d9dcd87-bsdvc', 'uid': '4207ade2-9821-446c-ba06-f7a392fee6fd', 'resourceVersion': '1242366', 'creationTimestamp': '2020-07-10T10:58:02Z', 'labels': {'pod-template-hash': '54d9dcd87', 'run': 'live-test2'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'live-test2-54d9dcd87', 'uid': 'd5763685-12a1-4103-8892-dc97fbdfd081', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'containers': [{'name': 'live-test2', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T10:58:02Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:38:12Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:38:12Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T10:58:02Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.8', 'startTime': '2020-07-10T10:58:02Z', 'containerStatuses': [{'name': 'live-test2', 'state': {'running': {'startedAt': '2020-07-16T14:38:12Z'}}, 'lastState': {'terminated': {'exitCode': 1, 'reason': 'Error', 'startedAt': '2020-07-16T14:33:07Z', 'finishedAt': '2020-07-16T14:33:08Z', 'containerID': 'containerd://361ef5806f82f60323fa6924c4146814f56b3111ee12b8a4e0f4cd759bc03e51'}}, 'ready': True, 'restartCount': 1711, 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'imageID': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'containerID': 'containerd://08ac5cfdf2cac0438d4ebc6a5b4fef2ebec7dbf117f68f767aade9de68db65d0'}], 'qosClass': 'BestEffort'}}} 2020-07-16 14:39:47,122 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 6, 28, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'live-test5-b6fcb7757-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': 'b6fcb7757', 'run': 'live-test5'}, 'managed_fields': None, 'name': 'live-test5-b6fcb7757-w869x', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'live-test5-b6fcb7757', 'uid': '36f2bc87-4a91-4618-ab50-e994944be46b'}], 'resource_version': '1242553', 'self_link': '/api/v1/namespaces/default/pods/live-test5-b6fcb7757-w869x', 'uid': '019da30b-30ef-440c-a083-30e5b4ddc74a'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test5', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 6, 28, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 39, 47, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 39, 47, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 6, 28, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://c08e5dc72b82dd88c8c1a9ed21029f5ade9c659752f32fe47c6136278838d9bf', 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'image_id': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'last_state': {'running': None, 'terminated': {'container_id': 'containerd://f007890998757245dc3df2a0347eb1ac6805efb14d42ab8d9992160791cfc65f', 'exit_code': 1, 'finished_at': datetime.datetime(2020, 7, 16, 14, 34, 32, tzinfo=tzlocal()), 'message': None, 'reason': 'Error', 'signal': None, 'started_at': datetime.datetime(2020, 7, 16, 14, 34, 31, tzinfo=tzlocal())}, 'waiting': None}, 'name': 'live-test5', 'ready': True, 'restart_count': 1707, 'state': {'running': {'started_at': datetime.datetime(2020, 7, 16, 14, 39, 46, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.5', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.10', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 10, 11, 6, 28, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test5-b6fcb7757-w869x', 'generateName': 'live-test5-b6fcb7757-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test5-b6fcb7757-w869x', 'uid': '019da30b-30ef-440c-a083-30e5b4ddc74a', 'resourceVersion': '1242553', 'creationTimestamp': '2020-07-10T11:06:28Z', 'labels': {'pod-template-hash': 'b6fcb7757', 'run': 'live-test5'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'live-test5-b6fcb7757', 'uid': '36f2bc87-4a91-4618-ab50-e994944be46b', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'containers': [{'name': 'live-test5', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:06:28Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:39:47Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:39:47Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:06:28Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.10', 'startTime': '2020-07-10T11:06:28Z', 'containerStatuses': [{'name': 'live-test5', 'state': {'running': {'startedAt': '2020-07-16T14:39:46Z'}}, 'lastState': {'terminated': {'exitCode': 1, 'reason': 'Error', 'startedAt': '2020-07-16T14:34:31Z', 'finishedAt': '2020-07-16T14:34:32Z', 'containerID': 'containerd://f007890998757245dc3df2a0347eb1ac6805efb14d42ab8d9992160791cfc65f'}}, 'ready': True, 'restartCount': 1707, 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'imageID': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'containerID': 'containerd://c08e5dc72b82dd88c8c1a9ed21029f5ade9c659752f32fe47c6136278838d9bf'}], 'qosClass': 'BestEffort'}}} 2020-07-16 14:40:23,146 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 10, 11, 22, 41, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'live-test6-988dbb567-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '988dbb567', 'run': 'live-test6'}, 'managed_fields': None, 'name': 'live-test6-988dbb567-rqc7x', 'namespace': 'default', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'live-test6-988dbb567', 'uid': '2aefcc7f-ce12-4f7f-a4a9-a58b67a26778'}], 'resource_version': '1242627', 'self_link': '/api/v1/namespaces/default/pods/live-test6-988dbb567-rqc7x', 'uid': 'd3a4086d-f6c3-49ab-8e6d-e47e0c9accc6'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test6', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': True, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': True, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 22, 41, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 40, 23, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test6]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 40, 23, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test6]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 10, 11, 22, 41, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://3961b1f55adb3945e4b6d47cb966d311d6a343202592b4a9fdb87bffdf708150', 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'image_id': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'last_state': {'running': None, 'terminated': {'container_id': 'containerd://ea1c69c3562e4ebbf5d32c5e03b1dedb886d208da87b11dc2130ac8fd3a4f755', 'exit_code': 1, 'finished_at': datetime.datetime(2020, 7, 16, 14, 32, 29, tzinfo=tzlocal()), 'message': None, 'reason': 'Error', 'signal': None, 'started_at': datetime.datetime(2020, 7, 16, 14, 32, 28, tzinfo=tzlocal())}, 'waiting': None}, 'name': 'live-test6', 'ready': False, 'restart_count': 1707, 'state': {'running': None, 'terminated': {'container_id': 'containerd://3961b1f55adb3945e4b6d47cb966d311d6a343202592b4a9fdb87bffdf708150', 'exit_code': 1, 'finished_at': datetime.datetime(2020, 7, 16, 14, 40, 21, tzinfo=tzlocal()), 'message': None, 'reason': 'Error', 'signal': None, 'started_at': datetime.datetime(2020, 7, 16, 14, 37, 44, tzinfo=tzlocal())}, 'waiting': None}}], 'host_ip': '172.18.0.5', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.11', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 10, 11, 22, 41, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test6-988dbb567-rqc7x', 'generateName': 'live-test6-988dbb567-', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test6-988dbb567-rqc7x', 'uid': 'd3a4086d-f6c3-49ab-8e6d-e47e0c9accc6', 'resourceVersion': '1242627', 'creationTimestamp': '2020-07-10T11:22:41Z', 'labels': {'pod-template-hash': '988dbb567', 'run': 'live-test6'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'live-test6-988dbb567', 'uid': '2aefcc7f-ce12-4f7f-a4a9-a58b67a26778', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'containers': [{'name': 'live-test6', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always', 'stdin': True, 'tty': True}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:22:41Z'}, {'type': 'Ready', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:40:23Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test6]'}, {'type': 'ContainersReady', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:40:23Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test6]'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-10T11:22:41Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.11', 'startTime': '2020-07-10T11:22:41Z', 'containerStatuses': [{'name': 'live-test6', 'state': {'terminated': {'exitCode': 1, 'reason': 'Error', 'startedAt': '2020-07-16T14:37:44Z', 'finishedAt': '2020-07-16T14:40:21Z', 'containerID': 'containerd://3961b1f55adb3945e4b6d47cb966d311d6a343202592b4a9fdb87bffdf708150'}}, 'lastState': {'terminated': {'exitCode': 1, 'reason': 'Error', 'startedAt': '2020-07-16T14:32:28Z', 'finishedAt': '2020-07-16T14:32:29Z', 'containerID': 'containerd://ea1c69c3562e4ebbf5d32c5e03b1dedb886d208da87b11dc2130ac8fd3a4f755'}}, 'ready': False, 'restartCount': 1707, 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'imageID': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'containerID': 'containerd://3961b1f55adb3945e4b6d47cb966d311d6a343202592b4a9fdb87bffdf708150'}], 'qosClass': 'BestEffort'}}} 2020-07-16 14:40:23,217 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 7, 16, 14, 37, 38, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'live-test', 'namespace': 'default', 'owner_references': None, 'resource_version': '1242630', 'self_link': '/api/v1/namespaces/default/pods/live-test', 'uid': 'e6ca5fd5-4d48-491c-a9b5-6235cd4ece9c'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-nksct', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Never', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-nksct', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-nksct'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 37, 38, tzinfo=tzlocal()), 'message': None, 'reason': 'PodCompleted', 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 40, 23, tzinfo=tzlocal()), 'message': None, 'reason': 'PodCompleted', 'status': 'False', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 40, 23, tzinfo=tzlocal()), 'message': None, 'reason': 'PodCompleted', 'status': 'False', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 7, 16, 14, 37, 38, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://aaf84d225e7cdc6abcf1abdbac3337bf87eb9caaf06d3414004bb80eb7c8e84e', 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'image_id': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'live-test', 'ready': False, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://aaf84d225e7cdc6abcf1abdbac3337bf87eb9caaf06d3414004bb80eb7c8e84e', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 7, 16, 14, 40, 21, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 7, 16, 14, 37, 42, tzinfo=tzlocal())}, 'waiting': None}}], 'host_ip': '172.18.0.5', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Succeeded', 'pod_ip': '10.244.1.247', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 7, 16, 14, 37, 38, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test', 'namespace': 'default', 'selfLink': '/api/v1/namespaces/default/pods/live-test', 'uid': 'e6ca5fd5-4d48-491c-a9b5-6235cd4ece9c', 'resourceVersion': '1242630', 'creationTimestamp': '2020-07-16T14:37:38Z'}, 'spec': {'volumes': [{'name': 'default-token-nksct', 'secret': {'secretName': 'default-token-nksct', 'defaultMode': 420}}], 'containers': [{'name': 'live-test', 'image': 'ollivier/clearwater-live-test:latest', 'resources': {}, 'volumeMounts': [{'name': 'default-token-nksct', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Never', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Succeeded', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:37:38Z', 'reason': 'PodCompleted'}, {'type': 'Ready', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:40:23Z', 'reason': 'PodCompleted'}, {'type': 'ContainersReady', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:40:23Z', 'reason': 'PodCompleted'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-07-16T14:37:38Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.247', 'startTime': '2020-07-16T14:37:38Z', 'containerStatuses': [{'name': 'live-test', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-07-16T14:37:42Z', 'finishedAt': '2020-07-16T14:40:21Z', 'containerID': 'containerd://aaf84d225e7cdc6abcf1abdbac3337bf87eb9caaf06d3414004bb80eb7c8e84e'}}, 'lastState': {}, 'ready': False, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'imageID': 'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', 'containerID': 'containerd://aaf84d225e7cdc6abcf1abdbac3337bf87eb9caaf06d3414004bb80eb7c8e84e'}], 'qosClass': 'BestEffort'}}} 2020-07-16 14:40:23,259 - kubernetes.client.rest - DEBUG - response body: ** Invoke test (first_time) ** Execute test /usr/lib/ruby/gems/2.6.0/gems/httpi-2.4.0/lib/httpi/auth/ssl.rb:13: warning: constant OpenSSL::SSL::SSLContext::METHODS is deprecated # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' Basic Call - Mainline (TCP) - (6505550390, 6505550108) Passed Basic Call - SDP (TCP) - (6505550182, 6505550830) Passed Basic Call - Tel URIs (TCP) - (6505550191, 6505550896) Passed Basic Call - Unknown number (TCP) - (6505550156, 6505550651) Passed Basic Call - Rejected by remote endpoint (TCP) - (6505550821, 6505550571) Passed Basic Call - Messages - Pager model (TCP) - (6505550934, 6505550693) Passed Basic Call - Pracks (TCP) - (6505550290, 6505550751) Passed Basic Registration (TCP) - (6505550135) Passed Emergency Registration (TCP) - Skipped (Not running with emergency registrations) - Call with EMERGENCY_REG=Y to run test Multiple Identities (TCP) - (6505550870, 6505550898) Passed Call Barring - Outbound Rejection (TCP) - (6505550021, 6505550164) Passed Call Barring - Allow non-international call (TCP) - Skipped (No PSTN support) - Call with PSTN=true to run test Call Barring - Reject international call (TCP) - Skipped (No PSTN support) - Call with PSTN=true to run test Call Barring - Inbound Rejection (TCP) - (6505550151, 6505550071) Passed Call Diversion AS - Unconditional (TCP) - Skipped (No Call Diversion AS hostname provided) - Call with CDIV_AS= Call Diversion AS - Busy (TCP) - Skipped (No Call Diversion AS hostname provided) - Call with CDIV_AS= Call Diversion AS - No answer (TCP) - Skipped (No Call Diversion AS hostname provided) - Call with CDIV_AS= Call Diversion - Not registered (TCP) - (6505550753, 6505550663, 6505550098) Passed Call Diversion - Not reachable (not registered) (TCP) - (6505550878, 6505550306, 6505550767) Passed Call Diversion - Not reachable (408) (TCP) - (6505550979, 6505550627, 6505550339) Passed Call Diversion - Not reachable (503) (TCP) - (6505550373, 6505550985, 6505550795) Passed Call Diversion - Not reachable (500) (TCP) - (6505550888, 6505550737, 6505550785) Passed Call Diversion - Busy (TCP) - (6505550300, 6505550660, 6505550142) Passed Call Diversion - Unconditional (TCP) - (6505550636, 6505550978, 6505550120) Passed Call Diversion - No answer (TCP) - (6505550111, 6505550054, 6505550375) Passed Call Diversion - Bad target URI (TCP) - (6505550896, 6505550570) Passed Call Diversion - Audio-only call (TCP) - (6505550123, 6505550925, 6505550214, 6505550158) Passed Call Diversion - Audio-video call (TCP) - (6505550484, 6505550341, 6505550876, 6505550013) Passed Call Forking - Mainline (TCP) - (6505550941, 6505550728) Passed Call Forking - Endpoint offline (TCP) - (6505550487, 6505550799) Passed Call Forking - Endpoint offline while ringing (TCP) - (6505550119, 6505550655) Passed Call Waiting - Accepted (TCP) - (6505550494, 6505550029, 6505550097) Passed Call Waiting - Cancelled (TCP) - (6505550044, 6505550973, 6505550008) Passed CANCEL - Mainline (TCP) - (6505550097, 6505550821) Passed Filtering - Accept-Contact (TCP) - (6505550958, 6505550736) Passed Accept-Contact with response (SFR 511195) (TCP) - (6505550350, 6505550500) Passed Filtering - Accept-Contact no match (TCP) - (6505550834, 6505550491) Passed Filtering - Accept-Contact negated match (TCP) - (6505550958, 6505550099) Passed Filtering - RFC3841 example (TCP) - (6505550121, 6505550658) Passed Filtering - Reject-Contact no match (TCP) - (6505550482, 6505550303) Passed Filtering - Reject-Contact match (TCP) - (6505550856, 6505550774) Passed Gemini - INVITE - VoIP device answers (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Mobile device answers (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - VoIP device rejects (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Mobile device rejects (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Mobile device rejects with a 480 (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Both reject, choose mobile response (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Both reject, choose VoIP response (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Successful call with GR (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Failed call with GR (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Successful call with Accept-Contact (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Failed call with Accept-Contact (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - SUBSCRIBE - Mobile Notifies (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - SUBSCRIBE - Joint 408 (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= GRUU - REGISTER - two bindings with and without GRUU (TCP) - (6505550487) Passed GRUU - REGISTER - binding suggested GRUU (TCP) - (6505550229) Passed GRUU - REGISTER - instance ID requires escaping (TCP) - (6505550574) Passed GRUU - REGISTER - three bindings with GRUUs (TCP) - (6505550416) Passed GRUU - Call - first endpoint GRUU as target (TCP) - (6505550597, 6505550066) Passed GRUU - Call - second endpoint GRUU as target (TCP) - (6505550964, 6505550078) Passed GRUU - Call - only GRUU as target (TCP) - (6505550404, 6505550414) Passed GRUU - Call - AoR as target (TCP) - (6505550087, 6505550745) Passed GRUU - Call - unknown GRUU as target (TCP) - (6505550382, 6505550489) Passed GRUU - Call - unknown GRUU as target - no GRUUs assigned (TCP) - (6505550666, 6505550901) Passed GRUU - Call - Reject-Contact interop (TCP) - (6505550350, 6505550781) Passed GRUU - Call - Accept-Contact interop (TCP) - (6505550365, 6505550532) Passed GRUU - Call - AoR with other param as target (TCP) - (6505550716, 6505550969) Passed GRUU - Call - GRUU with other param as target (TCP) - (6505550898, 6505550358) Passed ISC Interface - Terminating (TCP) - Skipped (No hostname given) - Call with HOST_NAME= ISC Interface - Terminating (UDP AS) (TCP) - Skipped (No hostname given) - Call with HOST_NAME= ISC Interface - Terminating Failed (TCP) - Skipped (No hostname given) - Call with HOST_NAME= ISC Interface - Third-party Registration (TCP) - Skipped (No hostname given) - Call with HOST_NAME= ISC Interface - Third-party Registration - implicit registration (TCP) - Skipped (No hostname given) - Call with HOST_NAME= ISC Interface - Redirect (TCP) - Skipped (No hostname given) - Call with HOST_NAME= ISC Interface - B2BUA (TCP) - Skipped (No hostname given) - Call with HOST_NAME= Live Call - Dial out to a real number (TCP) - Skipped (No live number given) - Call with LIVENUMBER= Memento - Incorrect Password (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Wrong Call List (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Basic Call (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Unknown Number (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Rejected Call (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Cancelled Call (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Privacy Call (TCP) - Skipped (No memento hostnames provided) /usr/lib/ruby/gems/2.6.0/gems/nokogiri-1.6.6.2/lib/nokogiri/xml/document.rb:44: warning: constant ::Fixnum is deprecated # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Barred Call (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Busy Call Forwarding (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Nonce-Count - Mainline (TCP) - Skipped (No nonce-count support) - Call with NONCE_COUNT=Y to run test Nonce-Count - Reject Re-Use (TCP) - Skipped (No nonce-count support) - Call with NONCE_COUNT=Y to run test Off-net calls - tel: URI (TCP) - Skipped (No off-net number given) - Call with OFF_NET_TEL= Off-net calls - sip: URI (TCP) - Skipped (No off-net number given) - Call with OFF_NET_TEL= SUBSCRIBE - reg-event (TCP) - (6505550411) Passed SUBSCRIBE - reg-event with a GRUU (TCP) - (6505550832) Passed SUBSCRIBE - Subscription timeout (TCP) - (6505550338) Passed SUBSCRIBE - Registration timeout (TCP) - Skipped (Not running with short registrations) - Call with SHORT_REG=Y to run test Multiple SUBSCRIBErs to one UE's reg-event (TCP) - (6505550470, 6505550186) Passed Message - URN URIs (TCP) - Skipped (No hostname given) - Call with HOST_NAME= Message - URN URIs to AS (TCP) - Skipped (No hostname given) - Call with HOST_NAME= Deleting leaked number: sip:6505550642@default.svc.cluster.local Deleting leaked number: sip:6505550137@default.svc.cluster.local Deleting leaked number: sip:6505550156@default.svc.cluster.local Deleting leaked number: sip:6505550359@default.svc.cluster.local Deleting leaked number: sip:6505550448@default.svc.cluster.local Deleting leaked number: sip:6505550715@default.svc.cluster.local Failed to delete leaked number, check Ellis logs Deleting leaked number: sip:6505550727@default.svc.cluster.local Failed to delete leaked number, check Ellis logs Deleting leaked number: sip:6505550757@default.svc.cluster.local Failed to delete leaked number, check Ellis logs Deleting leaked number: sip:6505550884@default.svc.cluster.local Failed to delete leaked number, check Ellis logs 0 failures out of 96 tests run 43 tests skipped 2020-07-16 14:40:23,260 - functest_kubernetes.ims.ims - INFO - ** Invoke test (first_time) ** Execute test /usr/lib/ruby/gems/2.6.0/gems/httpi-2.4.0/lib/httpi/auth/ssl.rb:13: warning: constant OpenSSL::SSL::SSLContext::METHODS is deprecated # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' Basic Call - Mainline (TCP) - (6505550390, 6505550108) Passed Basic Call - SDP (TCP) - (6505550182, 6505550830) Passed Basic Call - Tel URIs (TCP) - (6505550191, 6505550896) Passed Basic Call - Unknown number (TCP) - (6505550156, 6505550651) Passed Basic Call - Rejected by remote endpoint (TCP) - (6505550821, 6505550571) Passed Basic Call - Messages - Pager model (TCP) - (6505550934, 6505550693) Passed Basic Call - Pracks (TCP) - (6505550290, 6505550751) Passed Basic Registration (TCP) - (6505550135) Passed Emergency Registration (TCP) - Skipped (Not running with emergency registrations) - Call with EMERGENCY_REG=Y to run test Multiple Identities (TCP) - (6505550870, 6505550898) Passed Call Barring - Outbound Rejection (TCP) - (6505550021, 6505550164) Passed Call Barring - Allow non-international call (TCP) - Skipped (No PSTN support) - Call with PSTN=true to run test Call Barring - Reject international call (TCP) - Skipped (No PSTN support) - Call with PSTN=true to run test Call Barring - Inbound Rejection (TCP) - (6505550151, 6505550071) Passed Call Diversion AS - Unconditional (TCP) - Skipped (No Call Diversion AS hostname provided) - Call with CDIV_AS= Call Diversion AS - Busy (TCP) - Skipped (No Call Diversion AS hostname provided) - Call with CDIV_AS= Call Diversion AS - No answer (TCP) - Skipped (No Call Diversion AS hostname provided) - Call with CDIV_AS= Call Diversion - Not registered (TCP) - (6505550753, 6505550663, 6505550098) Passed Call Diversion - Not reachable (not registered) (TCP) - (6505550878, 6505550306, 6505550767) Passed Call Diversion - Not reachable (408) (TCP) - (6505550979, 6505550627, 6505550339) Passed Call Diversion - Not reachable (503) (TCP) - (6505550373, 6505550985, 6505550795) Passed Call Diversion - Not reachable (500) (TCP) - (6505550888, 6505550737, 6505550785) Passed Call Diversion - Busy (TCP) - (6505550300, 6505550660, 6505550142) Passed Call Diversion - Unconditional (TCP) - (6505550636, 6505550978, 6505550120) Passed Call Diversion - No answer (TCP) - (6505550111, 6505550054, 6505550375) Passed Call Diversion - Bad target URI (TCP) - (6505550896, 6505550570) Passed Call Diversion - Audio-only call (TCP) - (6505550123, 6505550925, 6505550214, 6505550158) Passed Call Diversion - Audio-video call (TCP) - (6505550484, 6505550341, 6505550876, 6505550013) Passed Call Forking - Mainline (TCP) - (6505550941, 6505550728) Passed Call Forking - Endpoint offline (TCP) - (6505550487, 6505550799) Passed Call Forking - Endpoint offline while ringing (TCP) - (6505550119, 6505550655) Passed Call Waiting - Accepted (TCP) - (6505550494, 6505550029, 6505550097) Passed Call Waiting - Cancelled (TCP) - (6505550044, 6505550973, 6505550008) Passed CANCEL - Mainline (TCP) - (6505550097, 6505550821) Passed Filtering - Accept-Contact (TCP) - (6505550958, 6505550736) Passed Accept-Contact with response (SFR 511195) (TCP) - (6505550350, 6505550500) Passed Filtering - Accept-Contact no match (TCP) - (6505550834, 6505550491) Passed Filtering - Accept-Contact negated match (TCP) - (6505550958, 6505550099) Passed Filtering - RFC3841 example (TCP) - (6505550121, 6505550658) Passed Filtering - Reject-Contact no match (TCP) - (6505550482, 6505550303) Passed Filtering - Reject-Contact match (TCP) - (6505550856, 6505550774) Passed Gemini - INVITE - VoIP device answers (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Mobile device answers (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - VoIP device rejects (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Mobile device rejects (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Mobile device rejects with a 480 (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Both reject, choose mobile response (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Both reject, choose VoIP response (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Successful call with GR (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Failed call with GR (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Successful call with Accept-Contact (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Failed call with Accept-Contact (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - SUBSCRIBE - Mobile Notifies (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - SUBSCRIBE - Joint 408 (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= GRUU - REGISTER - two bindings with and without GRUU (TCP) - (6505550487) Passed GRUU - REGISTER - binding suggested GRUU (TCP) - (6505550229) Passed GRUU - REGISTER - instance ID requires escaping (TCP) - (6505550574) Passed GRUU - REGISTER - three bindings with GRUUs (TCP) - (6505550416) Passed GRUU - Call - first endpoint GRUU as target (TCP) - (6505550597, 6505550066) Passed GRUU - Call - second endpoint GRUU as target (TCP) - (6505550964, 6505550078) Passed GRUU - Call - only GRUU as target (TCP) - (6505550404, 6505550414) Passed GRUU - Call - AoR as target (TCP) - (6505550087, 6505550745) Passed GRUU - Call - unknown GRUU as target (TCP) - (6505550382, 6505550489) Passed GRUU - Call - unknown GRUU as target - no GRUUs assigned (TCP) - (6505550666, 6505550901) Passed GRUU - Call - Reject-Contact interop (TCP) - (6505550350, 6505550781) Passed GRUU - Call - Accept-Contact interop (TCP) - (6505550365, 6505550532) Passed GRUU - Call - AoR with other param as target (TCP) - (6505550716, 6505550969) Passed GRUU - Call - GRUU with other param as target (TCP) - (6505550898, 6505550358) Passed ISC Interface - Terminating (TCP) - Skipped (No hostname given) - Call with HOST_NAME= ISC Interface - Terminating (UDP AS) (TCP) - Skipped (No hostname given) - Call with HOST_NAME= ISC Interface - Terminating Failed (TCP) - Skipped (No hostname given) - Call with HOST_NAME= ISC Interface - Third-party Registration (TCP) - Skipped (No hostname given) - Call with HOST_NAME= ISC Interface - Third-party Registration - implicit registration (TCP) - Skipped (No hostname given) - Call with HOST_NAME= ISC Interface - Redirect (TCP) - Skipped (No hostname given) - Call with HOST_NAME= ISC Interface - B2BUA (TCP) - Skipped (No hostname given) - Call with HOST_NAME= Live Call - Dial out to a real number (TCP) - Skipped (No live number given) - Call with LIVENUMBER= Memento - Incorrect Password (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Wrong Call List (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Basic Call (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Unknown Number (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Rejected Call (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Cancelled Call (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Privacy Call (TCP) - Skipped (No memento hostnames provided) /usr/lib/ruby/gems/2.6.0/gems/nokogiri-1.6.6.2/lib/nokogiri/xml/document.rb:44: warning: constant ::Fixnum is deprecated # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' # terminated with exception (report_on_exception is true): /src/vims-test/quaff/lib/sip_parser.rb:23:in `gets': stream closed in another thread (IOError) from /src/vims-test/quaff/lib/sip_parser.rb:23:in `parse_from_io' from /src/vims-test/quaff/lib/endpoint.rb:343:in `recv_msg_from_sock' from /src/vims-test/quaff/lib/endpoint.rb:338:in `block in recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:337:in `each' from /src/vims-test/quaff/lib/endpoint.rb:337:in `recv_msg' from /src/vims-test/quaff/lib/endpoint.rb:246:in `block in start' - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Barred Call (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Busy Call Forwarding (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Nonce-Count - Mainline (TCP) - Skipped (No nonce-count support) - Call with NONCE_COUNT=Y to run test Nonce-Count - Reject Re-Use (TCP) - Skipped (No nonce-count support) - Call with NONCE_COUNT=Y to run test Off-net calls - tel: URI (TCP) - Skipped (No off-net number given) - Call with OFF_NET_TEL= Off-net calls - sip: URI (TCP) - Skipped (No off-net number given) - Call with OFF_NET_TEL= SUBSCRIBE - reg-event (TCP) - (6505550411) Passed SUBSCRIBE - reg-event with a GRUU (TCP) - (6505550832) Passed SUBSCRIBE - Subscription timeout (TCP) - (6505550338) Passed SUBSCRIBE - Registration timeout (TCP) - Skipped (Not running with short registrations) - Call with SHORT_REG=Y to run test Multiple SUBSCRIBErs to one UE's reg-event (TCP) - (6505550470, 6505550186) Passed Message - URN URIs (TCP) - Skipped (No hostname given) - Call with HOST_NAME= Message - URN URIs to AS (TCP) - Skipped (No hostname given) - Call with HOST_NAME= Deleting leaked number: sip:6505550642@default.svc.cluster.local Deleting leaked number: sip:6505550137@default.svc.cluster.local Deleting leaked number: sip:6505550156@default.svc.cluster.local Deleting leaked number: sip:6505550359@default.svc.cluster.local Deleting leaked number: sip:6505550448@default.svc.cluster.local Deleting leaked number: sip:6505550715@default.svc.cluster.local Failed to delete leaked number, check Ellis logs Deleting leaked number: sip:6505550727@default.svc.cluster.local Failed to delete leaked number, check Ellis logs Deleting leaked number: sip:6505550757@default.svc.cluster.local Failed to delete leaked number, check Ellis logs Deleting leaked number: sip:6505550884@default.svc.cluster.local Failed to delete leaked number, check Ellis logs 0 failures out of 96 tests run 43 tests skipped 2020-07-16 14:40:23,269 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | k8s_vims | functest | 07:48 | PASS | +-------------------+------------------+------------------+----------------+ 2020-07-16 14:40:23,280 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"env-vars","kind":"configmaps","uid":"dc34d644-c397-488f-a732-ec2f9e3fa065"}} 2020-07-16 14:40:23,281 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_config_map: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'configmaps', 'name': 'env-vars', 'retry_after_seconds': None, 'uid': 'dc34d644-c397-488f-a732-ec2f9e3fa065'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-16 14:40:23,356 - kubernetes.client.rest - DEBUG - response body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"live-test","namespace":"default","selfLink":"/api/v1/namespaces/default/pods/live-test","uid":"e6ca5fd5-4d48-491c-a9b5-6235cd4ece9c","resourceVersion":"1242632","creationTimestamp":"2020-07-16T14:37:38Z","deletionTimestamp":"2020-07-16T14:40:23Z","deletionGracePeriodSeconds":0},"spec":{"volumes":[{"name":"default-token-nksct","secret":{"secretName":"default-token-nksct","defaultMode":420}}],"containers":[{"name":"live-test","image":"ollivier/clearwater-live-test:latest","resources":{},"volumeMounts":[{"name":"default-token-nksct","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"restartPolicy":"Never","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"iruya-worker2","securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Succeeded","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-07-16T14:37:38Z","reason":"PodCompleted"},{"type":"Ready","status":"False","lastProbeTime":null,"lastTransitionTime":"2020-07-16T14:40:23Z","reason":"PodCompleted"},{"type":"ContainersReady","status":"False","lastProbeTime":null,"lastTransitionTime":"2020-07-16T14:40:23Z","reason":"PodCompleted"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-07-16T14:37:38Z"}],"hostIP":"172.18.0.5","podIP":"10.244.1.247","startTime":"2020-07-16T14:37:38Z","containerStatuses":[{"name":"live-test","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-07-16T14:37:42Z","finishedAt":"2020-07-16T14:40:21Z","containerID":"containerd://aaf84d225e7cdc6abcf1abdbac3337bf87eb9caaf06d3414004bb80eb7c8e84e"}},"lastState":{},"ready":false,"restartCount":0,"image":"docker.io/ollivier/clearwater-live-test:latest","imageID":"docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4","containerID":"containerd://aaf84d225e7cdc6abcf1abdbac3337bf87eb9caaf06d3414004bb80eb7c8e84e"}],"qosClass":"BestEffort"}} 2020-07-16 14:40:23,358 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_pod: {'api_version': 'v1', 'code': None, 'details': None, 'kind': 'Pod', 'message': None, 'metadata': {'_continue': None, 'resource_version': '1242632', 'self_link': '/api/v1/namespaces/default/pods/live-test'}, 'reason': None, 'status': "{'phase': 'Succeeded', 'conditions': [{'type': 'Initialized', " "'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': " "'2020-07-16T14:37:38Z', 'reason': 'PodCompleted'}, {'type': " "'Ready', 'status': 'False', 'lastProbeTime': None, " "'lastTransitionTime': '2020-07-16T14:40:23Z', 'reason': " "'PodCompleted'}, {'type': 'ContainersReady', 'status': 'False', " "'lastProbeTime': None, 'lastTransitionTime': " "'2020-07-16T14:40:23Z', 'reason': 'PodCompleted'}, {'type': " "'PodScheduled', 'status': 'True', 'lastProbeTime': None, " "'lastTransitionTime': '2020-07-16T14:37:38Z'}], 'hostIP': " "'172.18.0.5', 'podIP': '10.244.1.247', 'startTime': " "'2020-07-16T14:37:38Z', 'containerStatuses': [{'name': " "'live-test', 'state': {'terminated': {'exitCode': 0, 'reason': " "'Completed', 'startedAt': '2020-07-16T14:37:42Z', 'finishedAt': " "'2020-07-16T14:40:21Z', 'containerID': " "'containerd://aaf84d225e7cdc6abcf1abdbac3337bf87eb9caaf06d3414004bb80eb7c8e84e'}}, " "'lastState': {}, 'ready': False, 'restartCount': 0, 'image': " "'docker.io/ollivier/clearwater-live-test:latest', 'imageID': " "'docker.io/ollivier/clearwater-live-test@sha256:7d2da02dca6f486c0f48830ae9d064712a7429523a749953e9fb516ec77637c4', " "'containerID': " "'containerd://aaf84d225e7cdc6abcf1abdbac3337bf87eb9caaf06d3414004bb80eb7c8e84e'}], " "'qosClass': 'BestEffort'}"} 2020-07-16 14:40:23,558 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"astaire","group":"apps","kind":"deployments","uid":"a719a6f5-a461-4be5-8214-898af088df3f"}} 2020-07-16 14:40:23,559 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'astaire', 'retry_after_seconds': None, 'uid': 'a719a6f5-a461-4be5-8214-898af088df3f'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-16 14:40:23,837 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"astaire","kind":"services","uid":"0fed5bd2-03dd-45e1-81c6-428ba89778d2"}} 2020-07-16 14:40:23,838 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'astaire', 'retry_after_seconds': None, 'uid': '0fed5bd2-03dd-45e1-81c6-428ba89778d2'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-16 14:40:23,880 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"bono","group":"apps","kind":"deployments","uid":"d1d5a413-946b-49c3-a5b6-1f554725ba3a"}} 2020-07-16 14:40:23,880 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'bono', 'retry_after_seconds': None, 'uid': 'd1d5a413-946b-49c3-a5b6-1f554725ba3a'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-16 14:40:24,065 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"bono","kind":"services","uid":"499280b6-06ca-4e94-a504-9191fade277b"}} 2020-07-16 14:40:24,066 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'bono', 'retry_after_seconds': None, 'uid': '499280b6-06ca-4e94-a504-9191fade277b'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-16 14:40:24,081 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"cassandra","group":"apps","kind":"deployments","uid":"38c0a876-12ce-40c0-b323-212af3468120"}} 2020-07-16 14:40:24,081 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'cassandra', 'retry_after_seconds': None, 'uid': '38c0a876-12ce-40c0-b323-212af3468120'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-16 14:40:24,318 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"cassandra","kind":"services","uid":"30654d3c-5cea-46ec-aeed-a04e50269cd9"}} 2020-07-16 14:40:24,319 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'cassandra', 'retry_after_seconds': None, 'uid': '30654d3c-5cea-46ec-aeed-a04e50269cd9'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-16 14:40:24,375 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"chronos","group":"apps","kind":"deployments","uid":"2139a1ec-34aa-4887-a963-0a75fe256d98"}} 2020-07-16 14:40:24,375 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'chronos', 'retry_after_seconds': None, 'uid': '2139a1ec-34aa-4887-a963-0a75fe256d98'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-16 14:40:24,415 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"chronos","kind":"services","uid":"8caa0b31-47b9-4f54-93f3-927e77e0d303"}} 2020-07-16 14:40:24,415 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'chronos', 'retry_after_seconds': None, 'uid': '8caa0b31-47b9-4f54-93f3-927e77e0d303'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-16 14:40:24,444 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"ellis","group":"apps","kind":"deployments","uid":"d83c33af-71ff-49fc-b323-649742f54f07"}} 2020-07-16 14:40:24,444 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'ellis', 'retry_after_seconds': None, 'uid': 'd83c33af-71ff-49fc-b323-649742f54f07'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-16 14:40:24,521 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"ellis","kind":"services","uid":"bc95c1eb-66de-40d4-8222-52db97f9306d"}} 2020-07-16 14:40:24,522 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'ellis', 'retry_after_seconds': None, 'uid': 'bc95c1eb-66de-40d4-8222-52db97f9306d'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-16 14:40:24,540 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"etcd","group":"apps","kind":"deployments","uid":"58ec500f-8a45-4870-a91a-ccafbbc23315"}} 2020-07-16 14:40:24,540 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'etcd', 'retry_after_seconds': None, 'uid': '58ec500f-8a45-4870-a91a-ccafbbc23315'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-16 14:40:24,628 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"etcd","kind":"services","uid":"8fe83dc4-5312-4aa1-be90-06000f3c4026"}} 2020-07-16 14:40:24,628 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'etcd', 'retry_after_seconds': None, 'uid': '8fe83dc4-5312-4aa1-be90-06000f3c4026'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-16 14:40:24,636 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"homer","group":"apps","kind":"deployments","uid":"10c5b30b-97b5-4a4e-b334-ef77a1a652ad"}} 2020-07-16 14:40:24,637 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'homer', 'retry_after_seconds': None, 'uid': '10c5b30b-97b5-4a4e-b334-ef77a1a652ad'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-16 14:40:24,687 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"homer","kind":"services","uid":"99c39f78-76b7-4ef0-acf6-19488f8147a9"}} 2020-07-16 14:40:24,688 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'homer', 'retry_after_seconds': None, 'uid': '99c39f78-76b7-4ef0-acf6-19488f8147a9'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-16 14:40:24,712 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"homestead","group":"apps","kind":"deployments","uid":"e112f04c-bc51-4e58-a54d-8f1880bd09ab"}} 2020-07-16 14:40:24,712 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'homestead', 'retry_after_seconds': None, 'uid': 'e112f04c-bc51-4e58-a54d-8f1880bd09ab'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-16 14:40:24,779 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"homestead","kind":"services","uid":"e78ea8ec-de7d-4185-9d3f-bfddc59a39fc"}} 2020-07-16 14:40:24,780 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'homestead', 'retry_after_seconds': None, 'uid': 'e78ea8ec-de7d-4185-9d3f-bfddc59a39fc'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-16 14:40:24,851 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"homestead-prov","group":"apps","kind":"deployments","uid":"67040119-0611-4a1f-9d68-cf00bbff900e"}} 2020-07-16 14:40:25,104 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'homestead-prov', 'retry_after_seconds': None, 'uid': '67040119-0611-4a1f-9d68-cf00bbff900e'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-16 14:40:25,855 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"homestead-prov","kind":"services","uid":"be9c3fca-b210-4045-9295-716628694453"}} 2020-07-16 14:40:25,856 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'homestead-prov', 'retry_after_seconds': None, 'uid': 'be9c3fca-b210-4045-9295-716628694453'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-16 14:40:25,876 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"ralf","group":"apps","kind":"deployments","uid":"4f24a10d-9c29-4114-b079-0f83735d4688"}} 2020-07-16 14:40:25,876 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'ralf', 'retry_after_seconds': None, 'uid': '4f24a10d-9c29-4114-b079-0f83735d4688'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-16 14:40:25,893 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"ralf","kind":"services","uid":"0bf8da88-dc62-4add-95f0-1a6b53951be0"}} 2020-07-16 14:40:25,893 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'ralf', 'retry_after_seconds': None, 'uid': '0bf8da88-dc62-4add-95f0-1a6b53951be0'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-16 14:40:25,994 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"sprout","group":"apps","kind":"deployments","uid":"40a25977-918e-4559-a2b3-31b12ddf0799"}} 2020-07-16 14:40:25,994 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'sprout', 'retry_after_seconds': None, 'uid': '40a25977-918e-4559-a2b3-31b12ddf0799'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-16 14:40:26,665 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"sprout","kind":"services","uid":"b894708e-7fe4-4bc0-9ba1-fcd473880490"}} 2020-07-16 14:40:26,665 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'sprout', 'retry_after_seconds': None, 'uid': 'b894708e-7fe4-4bc0-9ba1-fcd473880490'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-07-16 14:40:26,922 - xtesting.core.testcase - DEBUG - Publishing /var/lib/xtesting/results/functest-kubernetes.log ('text/plain', None) 2020-07-16 14:40:27,279 - xtesting.core.testcase - DEBUG - Publishing /var/lib/xtesting/results/functest-kubernetes.debug.log ('text/plain', None)