2020-08-19 03:59:37,109 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------+
|         ENV VAR         |                                                                         VALUE                                                                         |
+-------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------+
|         CI_LOOP         |                                                                         daily                                                                         |
|          DEBUG          |                                                                          true                                                                         |
|     DEPLOY_SCENARIO     |                                                                k8-nosdn-nofeature-noha                                                                |
|      INSTALLER_TYPE     |                                                                        unknown                                                                        |
|        BUILD_TAG        |                                                                      3FJERE4MJFK1                                                                     |
|        NODE_NAME        |                                                                     lf-virtual1-2                                                                     |
|       TEST_DB_URL       |                                                    http://testresults.opnfv.org/test/api/v1/results                                                   |
|     TEST_DB_EXT_URL     |                                                    http://testresults.opnfv.org/test/api/v1/results                                                   |
|     S3_ENDPOINT_URL     |                                                             https://storage.googleapis.com                                                            |
|        S3_DST_URL       |      s3://artifacts.opnfv.org/functest-kubernetes/3FJERE4MJFK1/functest-kubernetes-pi-ollivier-functest-kubernetes-cnf-arm-iruya-k8s_vims-run-12      |
|       HTTP_DST_URL      |     http://artifacts.opnfv.org/functest-kubernetes/3FJERE4MJFK1/functest-kubernetes-pi-ollivier-functest-kubernetes-cnf-arm-iruya-k8s_vims-run-12     |
+-------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------+

2020-08-19 03:59:37,160 - xtesting.ci.run_tests - DEBUG - No env file /var/lib/xtesting/conf/env_file found
2020-08-19 03:59:37,163 - xtesting.ci.run_tests - DEBUG - Test args: k8s_vims
2020-08-19 03:59:37,210 - xtesting.ci.run_tests - INFO - Loading test case 'k8s_vims'...
2020-08-19 03:59:39,284 - xtesting.ci.run_tests - INFO - Running test case 'k8s_vims'...
2020-08-19 03:59:39,545 - kubernetes.client.rest - DEBUG - response body: {"kind":"Namespace","apiVersion":"v1","metadata":{"name":"ims-h4q84","generateName":"ims-","selfLink":"/api/v1/namespaces/ims-h4q84","uid":"5c6e206b-0717-4f1d-a9b8-548a04d8f354","resourceVersion":"981036","creationTimestamp":"2020-08-19T03:59:39Z"},"spec":{"finalizers":["kubernetes"]},"status":{"phase":"Active"}}

2020-08-19 03:59:39,555 - functest_kubernetes.ims.ims - DEBUG - create_namespace: {'api_version': 'v1',
 'kind': 'Namespace',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 39, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': 'ims-',
              'generation': None,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'ims-h4q84',
              'namespace': None,
              'owner_references': None,
              'resource_version': '981036',
              'self_link': '/api/v1/namespaces/ims-h4q84',
              'uid': '5c6e206b-0717-4f1d-a9b8-548a04d8f354'},
 'spec': {'finalizers': ['kubernetes']},
 'status': {'phase': 'Active'}}
2020-08-19 03:59:39,586 - kubernetes.client.rest - DEBUG - response body: {"kind":"ConfigMap","apiVersion":"v1","metadata":{"name":"env-vars","namespace":"ims-h4q84","selfLink":"/api/v1/namespaces/ims-h4q84/configmaps/env-vars","uid":"c06b3a3a-06ab-4866-a4c3-efb42f39cfaf","resourceVersion":"981040","creationTimestamp":"2020-08-19T03:59:39Z"},"data":{"ADDITIONAL_SHARED_CONFIG":"","ZONE":"ims-h4q84.svc.cluster.local"}}

2020-08-19 03:59:39,592 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_config_map: {'api_version': 'v1',
 'binary_data': None,
 'data': {'ADDITIONAL_SHARED_CONFIG': '',
          'ZONE': 'ims-h4q84.svc.cluster.local'},
 'kind': 'ConfigMap',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 39, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': None,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'env-vars',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981040',
              'self_link': '/api/v1/namespaces/ims-h4q84/configmaps/env-vars',
              'uid': 'c06b3a3a-06ab-4866-a4c3-efb42f39cfaf'}}
2020-08-19 03:59:39,883 - kubernetes.client.rest - DEBUG - response body: {"kind":"Deployment","apiVersion":"apps/v1","metadata":{"name":"astaire","namespace":"ims-h4q84","selfLink":"/apis/apps/v1/namespaces/ims-h4q84/deployments/astaire","uid":"70bf9edb-e201-4cbe-8cba-1b1ae3f80a33","resourceVersion":"981042","generation":1,"creationTimestamp":"2020-08-19T03:59:39Z"},"spec":{"replicas":1,"selector":{"matchLabels":{"service":"astaire"}},"template":{"metadata":{"creationTimestamp":null,"labels":{"service":"astaire"}},"spec":{"volumes":[{"name":"astairelogs","emptyDir":{}}],"initContainers":[{"name":"wait-on-cassandra","image":"busybox:1.28","command":["sh","-c","until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"containers":[{"name":"astaire","image":"ollivier/clearwater-astaire:latest","ports":[{"containerPort":22,"protocol":"TCP"},{"containerPort":11211,"protocol":"TCP"},{"containerPort":11311,"protocol":"TCP"}],"envFrom":[{"configMapRef":{"name":"env-vars"}}],"env":[{"name":"MY_POD_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}}],"resources":{},"volumeMounts":[{"name":"astairelogs","mountPath":"/var/log/astaire"}],"livenessProbe":{"tcpSocket":{"port":11311},"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":9},"readinessProbe":{"tcpSocket":{"port":11311},"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"lifecycle":{"preStop":{"exec":{"command":["/bin/bash","-c","/usr/bin/pre-stop"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"},{"name":"tailer","image":"busybox","command":["tail","-F","/var/log/astaire/astaire_current.txt"],"resources":{},"volumeMounts":[{"name":"astairelogs","mountPath":"/var/log/astaire"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"restartPolicy":"Always","terminationGracePeriodSeconds":120,"dnsPolicy":"ClusterFirst","securityContext":{},"imagePullSecrets":[{}],"schedulerName":"default-scheduler"}},"strategy":{"type":"RollingUpdate","rollingUpdate":{"maxUnavailable":"25%","maxSurge":"25%"}},"revisionHistoryLimit":10,"progressDeadlineSeconds":600},"status":{}}

2020-08-19 03:59:39,896 - functest_kubernetes.ims.ims - INFO - Deployment astaire created
2020-08-19 03:59:39,897 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1',
 'binary_data': None,
 'data': {'ADDITIONAL_SHARED_CONFIG': '',
          'ZONE': 'ims-h4q84.svc.cluster.local'},
 'kind': 'ConfigMap',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 39, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': None,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'env-vars',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981040',
              'self_link': '/api/v1/namespaces/ims-h4q84/configmaps/env-vars',
              'uid': 'c06b3a3a-06ab-4866-a4c3-efb42f39cfaf'}}
2020-08-19 03:59:40,142 - kubernetes.client.rest - DEBUG - response body: {"kind":"Deployment","apiVersion":"apps/v1","metadata":{"name":"bono","namespace":"ims-h4q84","selfLink":"/apis/apps/v1/namespaces/ims-h4q84/deployments/bono","uid":"08f3c434-4caf-4735-8f74-93f1561b3c04","resourceVersion":"981055","generation":1,"creationTimestamp":"2020-08-19T03:59:40Z"},"spec":{"replicas":1,"selector":{"matchLabels":{"service":"bono"}},"template":{"metadata":{"creationTimestamp":null,"labels":{"service":"bono","snmp":"enabled"}},"spec":{"volumes":[{"name":"bonologs","emptyDir":{}}],"initContainers":[{"name":"wait-on-sprout","image":"busybox:1.28","command":["sh","-c","until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"containers":[{"name":"bono","image":"ollivier/clearwater-bono:latest","ports":[{"containerPort":22,"protocol":"TCP"},{"containerPort":3478,"protocol":"TCP"},{"containerPort":5060,"protocol":"TCP"},{"containerPort":5062,"protocol":"TCP"},{"containerPort":5060,"protocol":"UDP"},{"containerPort":5062,"protocol":"UDP"}],"envFrom":[{"configMapRef":{"name":"env-vars"}}],"env":[{"name":"MY_POD_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}}],"resources":{},"volumeMounts":[{"name":"bonologs","mountPath":"/var/log/bono"}],"livenessProbe":{"exec":{"command":["/bin/bash","/usr/share/kubernetes/liveness.sh","3478 5060 5062"]},"initialDelaySeconds":30,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"exec":{"command":["/bin/bash","/usr/share/kubernetes/liveness.sh","3478 5060 5062"]},"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"},{"name":"tailer","image":"busybox","command":["tail","-F","/var/log/bono/bono_current.txt"],"resources":{},"volumeMounts":[{"name":"bonologs","mountPath":"/var/log/bono"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","securityContext":{},"imagePullSecrets":[{}],"schedulerName":"default-scheduler"}},"strategy":{"type":"RollingUpdate","rollingUpdate":{"maxUnavailable":"25%","maxSurge":"25%"}},"revisionHistoryLimit":10,"progressDeadlineSeconds":600},"status":{}}

2020-08-19 03:59:40,154 - functest_kubernetes.ims.ims - INFO - Deployment bono created
2020-08-19 03:59:40,154 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1',
 'binary_data': None,
 'data': {'ADDITIONAL_SHARED_CONFIG': '',
          'ZONE': 'ims-h4q84.svc.cluster.local'},
 'kind': 'ConfigMap',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 39, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': None,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'env-vars',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981040',
              'self_link': '/api/v1/namespaces/ims-h4q84/configmaps/env-vars',
              'uid': 'c06b3a3a-06ab-4866-a4c3-efb42f39cfaf'}}
2020-08-19 03:59:40,323 - kubernetes.client.rest - DEBUG - response body: {"kind":"Deployment","apiVersion":"apps/v1","metadata":{"name":"cassandra","namespace":"ims-h4q84","selfLink":"/apis/apps/v1/namespaces/ims-h4q84/deployments/cassandra","uid":"2450d20d-764f-48c7-bd78-68a4bcdc93c2","resourceVersion":"981068","generation":1,"creationTimestamp":"2020-08-19T03:59:40Z"},"spec":{"replicas":1,"selector":{"matchLabels":{"service":"cassandra"}},"template":{"metadata":{"creationTimestamp":null,"labels":{"service":"cassandra"}},"spec":{"initContainers":[{"name":"wait-on-etcd","image":"busybox:1.28","command":["sh","-c","until nslookup etcd; do echo waiting for etcd to start ...; sleep 2; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"containers":[{"name":"cassandra","image":"ollivier/clearwater-cassandra:latest","ports":[{"containerPort":22,"protocol":"TCP"},{"containerPort":7001,"protocol":"TCP"},{"containerPort":9042,"protocol":"TCP"},{"containerPort":9160,"protocol":"TCP"}],"envFrom":[{"configMapRef":{"name":"env-vars"}}],"env":[{"name":"MY_POD_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}}],"resources":{},"livenessProbe":{"exec":{"command":["/bin/bash","/usr/share/kubernetes/liveness.sh","7000 9042 9160"]},"initialDelaySeconds":600,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"exec":{"command":["/bin/bash","/usr/share/kubernetes/liveness.sh","7000 9042 9160"]},"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","securityContext":{},"imagePullSecrets":[{}],"schedulerName":"default-scheduler"}},"strategy":{"type":"RollingUpdate","rollingUpdate":{"maxUnavailable":"25%","maxSurge":"25%"}},"revisionHistoryLimit":10,"progressDeadlineSeconds":600},"status":{}}

2020-08-19 03:59:40,333 - functest_kubernetes.ims.ims - INFO - Deployment cassandra created
2020-08-19 03:59:40,334 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1',
 'binary_data': None,
 'data': {'ADDITIONAL_SHARED_CONFIG': '',
          'ZONE': 'ims-h4q84.svc.cluster.local'},
 'kind': 'ConfigMap',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 39, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': None,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'env-vars',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981040',
              'self_link': '/api/v1/namespaces/ims-h4q84/configmaps/env-vars',
              'uid': 'c06b3a3a-06ab-4866-a4c3-efb42f39cfaf'}}
2020-08-19 03:59:40,621 - kubernetes.client.rest - DEBUG - response body: {"kind":"Deployment","apiVersion":"apps/v1","metadata":{"name":"chronos","namespace":"ims-h4q84","selfLink":"/apis/apps/v1/namespaces/ims-h4q84/deployments/chronos","uid":"0fc1b512-88a4-4734-8f1e-3c57dc26a77b","resourceVersion":"981081","generation":1,"creationTimestamp":"2020-08-19T03:59:40Z","labels":{"service":"chronos"}},"spec":{"replicas":1,"selector":{"matchLabels":{"service":"chronos"}},"template":{"metadata":{"creationTimestamp":null,"labels":{"service":"chronos"}},"spec":{"volumes":[{"name":"chronoslogs","emptyDir":{}}],"initContainers":[{"name":"wait-on-cassandra","image":"busybox:1.28","command":["sh","-c","until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"containers":[{"name":"chronos","image":"ollivier/clearwater-chronos:latest","ports":[{"containerPort":22,"protocol":"TCP"},{"containerPort":7253,"protocol":"TCP"}],"envFrom":[{"configMapRef":{"name":"env-vars"}}],"env":[{"name":"MY_POD_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}}],"resources":{},"volumeMounts":[{"name":"chronoslogs","mountPath":"/var/log/chronos"}],"livenessProbe":{"tcpSocket":{"port":7253},"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":9},"readinessProbe":{"tcpSocket":{"port":7253},"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"lifecycle":{"preStop":{"exec":{"command":["/bin/bash","-c","/usr/bin/pre-stop"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"},{"name":"tailer","image":"busybox","command":["tail","-F","/var/log/chronos/chronos_current.txt"],"resources":{},"volumeMounts":[{"name":"chronoslogs","mountPath":"/var/log/chronos"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"restartPolicy":"Always","terminationGracePeriodSeconds":120,"dnsPolicy":"ClusterFirst","securityContext":{},"imagePullSecrets":[{}],"schedulerName":"default-scheduler"}},"strategy":{"type":"RollingUpdate","rollingUpdate":{"maxUnavailable":"25%","maxSurge":"25%"}},"revisionHistoryLimit":10,"progressDeadlineSeconds":600},"status":{}}

2020-08-19 03:59:40,633 - functest_kubernetes.ims.ims - INFO - Deployment chronos created
2020-08-19 03:59:40,634 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1',
 'binary_data': None,
 'data': {'ADDITIONAL_SHARED_CONFIG': '',
          'ZONE': 'ims-h4q84.svc.cluster.local'},
 'kind': 'ConfigMap',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 39, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': None,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'env-vars',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981040',
              'self_link': '/api/v1/namespaces/ims-h4q84/configmaps/env-vars',
              'uid': 'c06b3a3a-06ab-4866-a4c3-efb42f39cfaf'}}
2020-08-19 03:59:40,789 - kubernetes.client.rest - DEBUG - response body: {"kind":"Deployment","apiVersion":"apps/v1","metadata":{"name":"ellis","namespace":"ims-h4q84","selfLink":"/apis/apps/v1/namespaces/ims-h4q84/deployments/ellis","uid":"1489ad06-8c54-4f56-a6b8-5cfd2daffb39","resourceVersion":"981095","generation":1,"creationTimestamp":"2020-08-19T03:59:40Z"},"spec":{"replicas":1,"selector":{"matchLabels":{"service":"ellis"}},"template":{"metadata":{"creationTimestamp":null,"labels":{"service":"ellis"}},"spec":{"initContainers":[{"name":"wait-on-homestead-prov","image":"busybox:1.28","command":["sh","-c","until nslookup homestead-prov; do echo waiting for homestead-prov to start ...; sleep 2; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"},{"name":"wait-on-sprout","image":"busybox:1.28","command":["sh","-c","until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"containers":[{"name":"ellis","image":"ollivier/clearwater-ellis:latest","ports":[{"containerPort":22,"protocol":"TCP"},{"containerPort":80,"protocol":"TCP"}],"envFrom":[{"configMapRef":{"name":"env-vars"}}],"env":[{"name":"MY_POD_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}}],"resources":{},"livenessProbe":{"tcpSocket":{"port":80},"initialDelaySeconds":30,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"tcpSocket":{"port":80},"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","securityContext":{},"imagePullSecrets":[{}],"schedulerName":"default-scheduler"}},"strategy":{"type":"RollingUpdate","rollingUpdate":{"maxUnavailable":"25%","maxSurge":"25%"}},"revisionHistoryLimit":10,"progressDeadlineSeconds":600},"status":{}}

2020-08-19 03:59:40,803 - functest_kubernetes.ims.ims - INFO - Deployment ellis created
2020-08-19 03:59:40,804 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1',
 'binary_data': None,
 'data': {'ADDITIONAL_SHARED_CONFIG': '',
          'ZONE': 'ims-h4q84.svc.cluster.local'},
 'kind': 'ConfigMap',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 39, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': None,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'env-vars',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981040',
              'self_link': '/api/v1/namespaces/ims-h4q84/configmaps/env-vars',
              'uid': 'c06b3a3a-06ab-4866-a4c3-efb42f39cfaf'}}
2020-08-19 03:59:40,977 - kubernetes.client.rest - DEBUG - response body: {"kind":"Deployment","apiVersion":"apps/v1","metadata":{"name":"etcd","namespace":"ims-h4q84","selfLink":"/apis/apps/v1/namespaces/ims-h4q84/deployments/etcd","uid":"ec404eeb-f1f4-4c19-abd5-a7605d350dd1","resourceVersion":"981108","generation":1,"creationTimestamp":"2020-08-19T03:59:40Z"},"spec":{"replicas":1,"selector":{"matchLabels":{"instance-type":"etcd-pod"}},"template":{"metadata":{"creationTimestamp":null,"labels":{"instance-type":"etcd-pod"}},"spec":{"containers":[{"name":"etcd","image":"quay.io/coreos/etcd:v2.2.5","args":["--name","$(MY_POD_NAME)","--advertise-client-urls","http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001","--listen-client-urls","http://0.0.0.0:2379,http://0.0.0.0:4001","--initial-advertise-peer-urls","http://$(MY_POD_IP):2380","--listen-peer-urls","http://0.0.0.0:2380","--initial-cluster","$(MY_POD_NAME)=http://$(MY_POD_IP):2380","--initial-cluster-state","new"],"ports":[{"containerPort":2379,"protocol":"TCP"},{"containerPort":2380,"protocol":"TCP"},{"containerPort":4001,"protocol":"TCP"}],"env":[{"name":"MY_POD_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}},{"name":"MY_POD_NAME","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.name"}}}],"resources":{},"livenessProbe":{"tcpSocket":{"port":4001},"initialDelaySeconds":300,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"tcpSocket":{"port":4001},"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","securityContext":{},"imagePullSecrets":[{}],"schedulerName":"default-scheduler"}},"strategy":{"type":"RollingUpdate","rollingUpdate":{"maxUnavailable":"25%","maxSurge":"25%"}},"revisionHistoryLimit":10,"progressDeadlineSeconds":600},"status":{}}

2020-08-19 03:59:40,987 - functest_kubernetes.ims.ims - INFO - Deployment etcd created
2020-08-19 03:59:40,988 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1',
 'binary_data': None,
 'data': {'ADDITIONAL_SHARED_CONFIG': '',
          'ZONE': 'ims-h4q84.svc.cluster.local'},
 'kind': 'ConfigMap',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 39, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': None,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'env-vars',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981040',
              'self_link': '/api/v1/namespaces/ims-h4q84/configmaps/env-vars',
              'uid': 'c06b3a3a-06ab-4866-a4c3-efb42f39cfaf'}}
2020-08-19 03:59:41,145 - kubernetes.client.rest - DEBUG - response body: {"kind":"Deployment","apiVersion":"apps/v1","metadata":{"name":"homer","namespace":"ims-h4q84","selfLink":"/apis/apps/v1/namespaces/ims-h4q84/deployments/homer","uid":"75f3b2f0-529c-4fd0-8647-466ea1b655bc","resourceVersion":"981120","generation":1,"creationTimestamp":"2020-08-19T03:59:41Z"},"spec":{"replicas":1,"selector":{"matchLabels":{"service":"homer"}},"template":{"metadata":{"creationTimestamp":null,"labels":{"service":"homer"}},"spec":{"initContainers":[{"name":"wait-on-cassandra","image":"busybox:1.28","command":["sh","-c","until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"containers":[{"name":"homer","image":"ollivier/clearwater-homer:latest","ports":[{"containerPort":22,"protocol":"TCP"},{"containerPort":7888,"protocol":"TCP"}],"envFrom":[{"configMapRef":{"name":"env-vars"}}],"env":[{"name":"MY_POD_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}}],"resources":{},"livenessProbe":{"tcpSocket":{"port":7888},"initialDelaySeconds":30,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"tcpSocket":{"port":7888},"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","securityContext":{},"imagePullSecrets":[{}],"schedulerName":"default-scheduler"}},"strategy":{"type":"RollingUpdate","rollingUpdate":{"maxUnavailable":"25%","maxSurge":"25%"}},"revisionHistoryLimit":10,"progressDeadlineSeconds":600},"status":{}}

2020-08-19 03:59:41,157 - functest_kubernetes.ims.ims - INFO - Deployment homer created
2020-08-19 03:59:41,158 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1',
 'binary_data': None,
 'data': {'ADDITIONAL_SHARED_CONFIG': '',
          'ZONE': 'ims-h4q84.svc.cluster.local'},
 'kind': 'ConfigMap',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 39, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': None,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'env-vars',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981040',
              'self_link': '/api/v1/namespaces/ims-h4q84/configmaps/env-vars',
              'uid': 'c06b3a3a-06ab-4866-a4c3-efb42f39cfaf'}}
2020-08-19 03:59:41,405 - kubernetes.client.rest - DEBUG - response body: {"kind":"Deployment","apiVersion":"apps/v1","metadata":{"name":"homestead","namespace":"ims-h4q84","selfLink":"/apis/apps/v1/namespaces/ims-h4q84/deployments/homestead","uid":"165d9c1c-79b2-4d12-9ff0-a0801d1c1839","resourceVersion":"981135","generation":1,"creationTimestamp":"2020-08-19T03:59:41Z"},"spec":{"replicas":1,"selector":{"matchLabels":{"service":"homestead"}},"template":{"metadata":{"creationTimestamp":null,"labels":{"service":"homestead","snmp":"enabled"}},"spec":{"volumes":[{"name":"homesteadlogs","emptyDir":{}}],"initContainers":[{"name":"wait-on-cassandra","image":"busybox:1.28","command":["sh","-c","until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"},{"name":"wait-on-astaire","image":"busybox:1.28","command":["sh","-c","until nslookup astaire; do echo waiting for astaire to start ...; sleep 2; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"containers":[{"name":"homestead","image":"ollivier/clearwater-homestead:latest","ports":[{"containerPort":22,"protocol":"TCP"},{"containerPort":8888,"protocol":"TCP"}],"envFrom":[{"configMapRef":{"name":"env-vars"}}],"env":[{"name":"MY_POD_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}}],"resources":{},"volumeMounts":[{"name":"homesteadlogs","mountPath":"/var/log/homestead"}],"livenessProbe":{"exec":{"command":["/bin/bash","/usr/share/kubernetes/liveness.sh","8888"]},"initialDelaySeconds":60,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"exec":{"command":["/bin/bash","/usr/share/kubernetes/liveness.sh","8888"]},"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"},{"name":"tailer","image":"busybox","command":["tail","-F","/var/log/homestead/homestead_current.txt"],"resources":{},"volumeMounts":[{"name":"homesteadlogs","mountPath":"/var/log/homestead"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","securityContext":{},"imagePullSecrets":[{}],"schedulerName":"default-scheduler"}},"strategy":{"type":"RollingUpdate","rollingUpdate":{"maxUnavailable":"25%","maxSurge":"25%"}},"revisionHistoryLimit":10,"progressDeadlineSeconds":600},"status":{}}

2020-08-19 03:59:41,417 - functest_kubernetes.ims.ims - INFO - Deployment homestead created
2020-08-19 03:59:41,418 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1',
 'binary_data': None,
 'data': {'ADDITIONAL_SHARED_CONFIG': '',
          'ZONE': 'ims-h4q84.svc.cluster.local'},
 'kind': 'ConfigMap',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 39, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': None,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'env-vars',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981040',
              'self_link': '/api/v1/namespaces/ims-h4q84/configmaps/env-vars',
              'uid': 'c06b3a3a-06ab-4866-a4c3-efb42f39cfaf'}}
2020-08-19 03:59:41,580 - kubernetes.client.rest - DEBUG - response body: {"kind":"Deployment","apiVersion":"apps/v1","metadata":{"name":"homestead-prov","namespace":"ims-h4q84","selfLink":"/apis/apps/v1/namespaces/ims-h4q84/deployments/homestead-prov","uid":"74868f80-4d95-45cd-823a-a73146cb3109","resourceVersion":"981147","generation":1,"creationTimestamp":"2020-08-19T03:59:41Z"},"spec":{"replicas":1,"selector":{"matchLabels":{"service":"homestead-prov"}},"template":{"metadata":{"creationTimestamp":null,"labels":{"service":"homestead-prov","snmp":"enabled"}},"spec":{"initContainers":[{"name":"wait-on-homestead","image":"busybox:1.28","command":["sh","-c","until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"containers":[{"name":"homestead-prov","image":"ollivier/clearwater-homestead-prov:latest","ports":[{"containerPort":22,"protocol":"TCP"},{"containerPort":8889,"protocol":"TCP"}],"envFrom":[{"configMapRef":{"name":"env-vars"}}],"env":[{"name":"MY_POD_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}}],"resources":{},"livenessProbe":{"exec":{"command":["/bin/bash","/usr/share/clearwater/bin/poll_homestead-prov.sh"]},"initialDelaySeconds":60,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"exec":{"command":["/bin/bash","/usr/share/clearwater/bin/poll_homestead-prov.sh"]},"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","securityContext":{},"imagePullSecrets":[{}],"schedulerName":"default-scheduler"}},"strategy":{"type":"RollingUpdate","rollingUpdate":{"maxUnavailable":"25%","maxSurge":"25%"}},"revisionHistoryLimit":10,"progressDeadlineSeconds":600},"status":{}}

2020-08-19 03:59:41,590 - functest_kubernetes.ims.ims - INFO - Deployment homestead-prov created
2020-08-19 03:59:41,591 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1',
 'binary_data': None,
 'data': {'ADDITIONAL_SHARED_CONFIG': '',
          'ZONE': 'ims-h4q84.svc.cluster.local'},
 'kind': 'ConfigMap',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 39, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': None,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'env-vars',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981040',
              'self_link': '/api/v1/namespaces/ims-h4q84/configmaps/env-vars',
              'uid': 'c06b3a3a-06ab-4866-a4c3-efb42f39cfaf'}}
2020-08-19 03:59:41,850 - kubernetes.client.rest - DEBUG - response body: {"kind":"Deployment","apiVersion":"apps/v1","metadata":{"name":"ralf","namespace":"ims-h4q84","selfLink":"/apis/apps/v1/namespaces/ims-h4q84/deployments/ralf","uid":"23b67868-499b-47be-94c2-817ef8fb0c04","resourceVersion":"981161","generation":1,"creationTimestamp":"2020-08-19T03:59:41Z"},"spec":{"replicas":1,"selector":{"matchLabels":{"service":"ralf"}},"template":{"metadata":{"creationTimestamp":null,"labels":{"service":"ralf","snmp":"enabled"}},"spec":{"volumes":[{"name":"ralflogs","emptyDir":{}}],"initContainers":[{"name":"wait-on-cassandra","image":"busybox:1.28","command":["sh","-c","until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"containers":[{"name":"ralf","image":"ollivier/clearwater-ralf:latest","ports":[{"containerPort":22,"protocol":"TCP"},{"containerPort":10888,"protocol":"TCP"}],"envFrom":[{"configMapRef":{"name":"env-vars"}}],"env":[{"name":"MY_POD_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}}],"resources":{},"volumeMounts":[{"name":"ralflogs","mountPath":"/var/log/ralf"}],"livenessProbe":{"tcpSocket":{"port":10888},"initialDelaySeconds":30,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"tcpSocket":{"port":10888},"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"},{"name":"tailer","image":"busybox","command":["tail","-F","/var/log/ralf/ralf_current.txt"],"resources":{},"volumeMounts":[{"name":"ralflogs","mountPath":"/var/log/ralf"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","securityContext":{},"imagePullSecrets":[{}],"schedulerName":"default-scheduler"}},"strategy":{"type":"RollingUpdate","rollingUpdate":{"maxUnavailable":"25%","maxSurge":"25%"}},"revisionHistoryLimit":10,"progressDeadlineSeconds":600},"status":{}}

2020-08-19 03:59:41,870 - functest_kubernetes.ims.ims - INFO - Deployment ralf created
2020-08-19 03:59:41,879 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1',
 'binary_data': None,
 'data': {'ADDITIONAL_SHARED_CONFIG': '',
          'ZONE': 'ims-h4q84.svc.cluster.local'},
 'kind': 'ConfigMap',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 39, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': None,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'env-vars',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981040',
              'self_link': '/api/v1/namespaces/ims-h4q84/configmaps/env-vars',
              'uid': 'c06b3a3a-06ab-4866-a4c3-efb42f39cfaf'}}
2020-08-19 03:59:42,182 - kubernetes.client.rest - DEBUG - response body: {"kind":"Deployment","apiVersion":"apps/v1","metadata":{"name":"sprout","namespace":"ims-h4q84","selfLink":"/apis/apps/v1/namespaces/ims-h4q84/deployments/sprout","uid":"3a87fa02-60fb-44d1-aade-be3745d8c918","resourceVersion":"981174","generation":1,"creationTimestamp":"2020-08-19T03:59:42Z"},"spec":{"replicas":1,"selector":{"matchLabels":{"service":"sprout"}},"template":{"metadata":{"creationTimestamp":null,"labels":{"service":"sprout","snmp":"enabled"}},"spec":{"volumes":[{"name":"sproutlogs","emptyDir":{}}],"initContainers":[{"name":"wait-on-ralf","image":"busybox:1.28","command":["sh","-c","until nslookup ralf; do echo waiting for ralf to start ...; sleep 2; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"},{"name":"wait-on-chronos","image":"busybox:1.28","command":["sh","-c","until nslookup chronos; do echo waiting for chronos to start ...; sleep 2; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"},{"name":"wait-on-homestead","image":"busybox:1.28","command":["sh","-c","until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"containers":[{"name":"sprout","image":"ollivier/clearwater-sprout:latest","ports":[{"containerPort":22,"protocol":"TCP"}],"envFrom":[{"configMapRef":{"name":"env-vars"}}],"env":[{"name":"MY_POD_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}}],"resources":{},"volumeMounts":[{"name":"sproutlogs","mountPath":"/var/log/sprout"}],"livenessProbe":{"exec":{"command":["/bin/bash","/usr/share/kubernetes/liveness.sh","5052 5054"]},"initialDelaySeconds":30,"timeoutSeconds":1,"periodSeconds":3,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"exec":{"command":["/bin/bash","/usr/share/kubernetes/liveness.sh","5052 5054"]},"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"},{"name":"tailer","image":"busybox","command":["tail","-F","/var/log/sprout/sprout_current.txt"],"resources":{},"volumeMounts":[{"name":"sproutlogs","mountPath":"/var/log/sprout"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","securityContext":{},"imagePullSecrets":[{}],"schedulerName":"default-scheduler"}},"strategy":{"type":"RollingUpdate","rollingUpdate":{"maxUnavailable":"25%","maxSurge":"25%"}},"revisionHistoryLimit":10,"progressDeadlineSeconds":600},"status":{}}

2020-08-19 03:59:42,197 - functest_kubernetes.ims.ims - INFO - Deployment sprout created
2020-08-19 03:59:42,199 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1',
 'binary_data': None,
 'data': {'ADDITIONAL_SHARED_CONFIG': '',
          'ZONE': 'ims-h4q84.svc.cluster.local'},
 'kind': 'ConfigMap',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 39, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': None,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'env-vars',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981040',
              'self_link': '/api/v1/namespaces/ims-h4q84/configmaps/env-vars',
              'uid': 'c06b3a3a-06ab-4866-a4c3-efb42f39cfaf'}}
2020-08-19 03:59:42,279 - kubernetes.client.rest - DEBUG - response body: {"kind":"Service","apiVersion":"v1","metadata":{"name":"astaire","namespace":"ims-h4q84","selfLink":"/api/v1/namespaces/ims-h4q84/services/astaire","uid":"1d37a723-5ef3-4efb-bb33-65a62aba438c","resourceVersion":"981183","creationTimestamp":"2020-08-19T03:59:42Z"},"spec":{"ports":[{"name":"11311","protocol":"TCP","port":11311,"targetPort":11311}],"selector":{"service":"astaire"},"clusterIP":"None","type":"ClusterIP","sessionAffinity":"None"},"status":{"loadBalancer":{}}}

2020-08-19 03:59:42,286 - functest_kubernetes.ims.ims - INFO - Service astaire created
2020-08-19 03:59:42,287 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1',
 'binary_data': None,
 'data': {'ADDITIONAL_SHARED_CONFIG': '',
          'ZONE': 'ims-h4q84.svc.cluster.local'},
 'kind': 'ConfigMap',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 39, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': None,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'env-vars',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981040',
              'self_link': '/api/v1/namespaces/ims-h4q84/configmaps/env-vars',
              'uid': 'c06b3a3a-06ab-4866-a4c3-efb42f39cfaf'}}
2020-08-19 03:59:42,380 - kubernetes.client.rest - DEBUG - response body: {"kind":"Service","apiVersion":"v1","metadata":{"name":"bono","namespace":"ims-h4q84","selfLink":"/api/v1/namespaces/ims-h4q84/services/bono","uid":"c7194672-5e0d-454a-92e1-93f73e065896","resourceVersion":"981188","creationTimestamp":"2020-08-19T03:59:42Z"},"spec":{"ports":[{"name":"3478","protocol":"TCP","port":3478,"targetPort":3478},{"name":"5060","protocol":"TCP","port":5060,"targetPort":5060},{"name":"5062","protocol":"TCP","port":5062,"targetPort":5062}],"selector":{"service":"bono"},"clusterIP":"None","type":"ClusterIP","sessionAffinity":"None"},"status":{"loadBalancer":{}}}

2020-08-19 03:59:42,386 - functest_kubernetes.ims.ims - INFO - Service bono created
2020-08-19 03:59:42,387 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1',
 'binary_data': None,
 'data': {'ADDITIONAL_SHARED_CONFIG': '',
          'ZONE': 'ims-h4q84.svc.cluster.local'},
 'kind': 'ConfigMap',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 39, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': None,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'env-vars',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981040',
              'self_link': '/api/v1/namespaces/ims-h4q84/configmaps/env-vars',
              'uid': 'c06b3a3a-06ab-4866-a4c3-efb42f39cfaf'}}
2020-08-19 03:59:42,664 - kubernetes.client.rest - DEBUG - response body: {"kind":"Service","apiVersion":"v1","metadata":{"name":"cassandra","namespace":"ims-h4q84","selfLink":"/api/v1/namespaces/ims-h4q84/services/cassandra","uid":"c2b895c1-af93-4493-975b-7828556fbb66","resourceVersion":"981192","creationTimestamp":"2020-08-19T03:59:42Z"},"spec":{"ports":[{"name":"7001","protocol":"TCP","port":7001,"targetPort":7001},{"name":"7000","protocol":"TCP","port":7000,"targetPort":7000},{"name":"9042","protocol":"TCP","port":9042,"targetPort":9042},{"name":"9160","protocol":"TCP","port":9160,"targetPort":9160}],"selector":{"service":"cassandra"},"clusterIP":"None","type":"ClusterIP","sessionAffinity":"None"},"status":{"loadBalancer":{}}}

2020-08-19 03:59:42,671 - functest_kubernetes.ims.ims - INFO - Service cassandra created
2020-08-19 03:59:42,672 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1',
 'binary_data': None,
 'data': {'ADDITIONAL_SHARED_CONFIG': '',
          'ZONE': 'ims-h4q84.svc.cluster.local'},
 'kind': 'ConfigMap',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 39, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': None,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'env-vars',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981040',
              'self_link': '/api/v1/namespaces/ims-h4q84/configmaps/env-vars',
              'uid': 'c06b3a3a-06ab-4866-a4c3-efb42f39cfaf'}}
2020-08-19 03:59:42,907 - kubernetes.client.rest - DEBUG - response body: {"kind":"Service","apiVersion":"v1","metadata":{"name":"chronos","namespace":"ims-h4q84","selfLink":"/api/v1/namespaces/ims-h4q84/services/chronos","uid":"05427d05-8835-4c01-b3fe-4c79d0faac64","resourceVersion":"981195","creationTimestamp":"2020-08-19T03:59:42Z"},"spec":{"ports":[{"name":"7253","protocol":"TCP","port":7253,"targetPort":7253}],"selector":{"service":"chronos"},"clusterIP":"None","type":"ClusterIP","sessionAffinity":"None"},"status":{"loadBalancer":{}}}

2020-08-19 03:59:42,913 - functest_kubernetes.ims.ims - INFO - Service chronos created
2020-08-19 03:59:42,914 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1',
 'binary_data': None,
 'data': {'ADDITIONAL_SHARED_CONFIG': '',
          'ZONE': 'ims-h4q84.svc.cluster.local'},
 'kind': 'ConfigMap',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 39, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': None,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'env-vars',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981040',
              'self_link': '/api/v1/namespaces/ims-h4q84/configmaps/env-vars',
              'uid': 'c06b3a3a-06ab-4866-a4c3-efb42f39cfaf'}}
2020-08-19 03:59:42,976 - kubernetes.client.rest - DEBUG - response body: {"kind":"Service","apiVersion":"v1","metadata":{"name":"ellis","namespace":"ims-h4q84","selfLink":"/api/v1/namespaces/ims-h4q84/services/ellis","uid":"a9c333e0-5f90-4ae8-8b24-55470b511925","resourceVersion":"981199","creationTimestamp":"2020-08-19T03:59:42Z"},"spec":{"ports":[{"name":"http","protocol":"TCP","port":80,"targetPort":80}],"selector":{"service":"ellis"},"clusterIP":"None","type":"ClusterIP","sessionAffinity":"None"},"status":{"loadBalancer":{}}}

2020-08-19 03:59:42,984 - functest_kubernetes.ims.ims - INFO - Service ellis created
2020-08-19 03:59:42,985 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1',
 'binary_data': None,
 'data': {'ADDITIONAL_SHARED_CONFIG': '',
          'ZONE': 'ims-h4q84.svc.cluster.local'},
 'kind': 'ConfigMap',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 39, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': None,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'env-vars',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981040',
              'self_link': '/api/v1/namespaces/ims-h4q84/configmaps/env-vars',
              'uid': 'c06b3a3a-06ab-4866-a4c3-efb42f39cfaf'}}
2020-08-19 03:59:43,202 - kubernetes.client.rest - DEBUG - response body: {"kind":"Service","apiVersion":"v1","metadata":{"name":"etcd","namespace":"ims-h4q84","selfLink":"/api/v1/namespaces/ims-h4q84/services/etcd","uid":"a672f67b-10a6-4a63-aaf9-da166771c983","resourceVersion":"981202","creationTimestamp":"2020-08-19T03:59:43Z","labels":{"instance-type":"etcd-pod"}},"spec":{"ports":[{"name":"etcd-client","protocol":"TCP","port":2379,"targetPort":2379},{"name":"etcd-server","protocol":"TCP","port":2380,"targetPort":2380},{"name":"4001","protocol":"TCP","port":4001,"targetPort":4001}],"selector":{"instance-type":"etcd-pod"},"clusterIP":"None","type":"ClusterIP","sessionAffinity":"None"},"status":{"loadBalancer":{}}}

2020-08-19 03:59:43,210 - functest_kubernetes.ims.ims - INFO - Service etcd created
2020-08-19 03:59:43,211 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1',
 'binary_data': None,
 'data': {'ADDITIONAL_SHARED_CONFIG': '',
          'ZONE': 'ims-h4q84.svc.cluster.local'},
 'kind': 'ConfigMap',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 39, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': None,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'env-vars',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981040',
              'self_link': '/api/v1/namespaces/ims-h4q84/configmaps/env-vars',
              'uid': 'c06b3a3a-06ab-4866-a4c3-efb42f39cfaf'}}
2020-08-19 03:59:44,111 - kubernetes.client.rest - DEBUG - response body: {"kind":"Service","apiVersion":"v1","metadata":{"name":"homer","namespace":"ims-h4q84","selfLink":"/api/v1/namespaces/ims-h4q84/services/homer","uid":"8e41d516-5475-412a-b2cc-8a5153d124e5","resourceVersion":"981204","creationTimestamp":"2020-08-19T03:59:43Z"},"spec":{"ports":[{"name":"7888","protocol":"TCP","port":7888,"targetPort":7888}],"selector":{"service":"homer"},"clusterIP":"None","type":"ClusterIP","sessionAffinity":"None"},"status":{"loadBalancer":{}}}

2020-08-19 03:59:44,159 - functest_kubernetes.ims.ims - INFO - Service homer created
2020-08-19 03:59:44,161 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1',
 'binary_data': None,
 'data': {'ADDITIONAL_SHARED_CONFIG': '',
          'ZONE': 'ims-h4q84.svc.cluster.local'},
 'kind': 'ConfigMap',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 39, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': None,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'env-vars',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981040',
              'self_link': '/api/v1/namespaces/ims-h4q84/configmaps/env-vars',
              'uid': 'c06b3a3a-06ab-4866-a4c3-efb42f39cfaf'}}
2020-08-19 03:59:44,388 - kubernetes.client.rest - DEBUG - response body: {"kind":"Service","apiVersion":"v1","metadata":{"name":"homestead","namespace":"ims-h4q84","selfLink":"/api/v1/namespaces/ims-h4q84/services/homestead","uid":"5365f334-2697-4fc4-921f-e8da33bdd788","resourceVersion":"981206","creationTimestamp":"2020-08-19T03:59:44Z"},"spec":{"ports":[{"name":"8888","protocol":"TCP","port":8888,"targetPort":8888}],"selector":{"service":"homestead"},"clusterIP":"None","type":"ClusterIP","sessionAffinity":"None"},"status":{"loadBalancer":{}}}

2020-08-19 03:59:44,408 - functest_kubernetes.ims.ims - INFO - Service homestead created
2020-08-19 03:59:44,409 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1',
 'binary_data': None,
 'data': {'ADDITIONAL_SHARED_CONFIG': '',
          'ZONE': 'ims-h4q84.svc.cluster.local'},
 'kind': 'ConfigMap',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 39, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': None,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'env-vars',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981040',
              'self_link': '/api/v1/namespaces/ims-h4q84/configmaps/env-vars',
              'uid': 'c06b3a3a-06ab-4866-a4c3-efb42f39cfaf'}}
2020-08-19 03:59:44,470 - kubernetes.client.rest - DEBUG - response body: {"kind":"Service","apiVersion":"v1","metadata":{"name":"homestead-prov","namespace":"ims-h4q84","selfLink":"/api/v1/namespaces/ims-h4q84/services/homestead-prov","uid":"be768512-659e-40d3-b6ba-fa78194f32fe","resourceVersion":"981210","creationTimestamp":"2020-08-19T03:59:44Z"},"spec":{"ports":[{"name":"8889","protocol":"TCP","port":8889,"targetPort":8889}],"selector":{"service":"homestead-prov"},"clusterIP":"None","type":"ClusterIP","sessionAffinity":"None"},"status":{"loadBalancer":{}}}

2020-08-19 03:59:44,475 - functest_kubernetes.ims.ims - INFO - Service homestead-prov created
2020-08-19 03:59:44,476 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1',
 'binary_data': None,
 'data': {'ADDITIONAL_SHARED_CONFIG': '',
          'ZONE': 'ims-h4q84.svc.cluster.local'},
 'kind': 'ConfigMap',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 39, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': None,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'env-vars',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981040',
              'self_link': '/api/v1/namespaces/ims-h4q84/configmaps/env-vars',
              'uid': 'c06b3a3a-06ab-4866-a4c3-efb42f39cfaf'}}
2020-08-19 03:59:44,754 - kubernetes.client.rest - DEBUG - response body: {"kind":"Service","apiVersion":"v1","metadata":{"name":"ralf","namespace":"ims-h4q84","selfLink":"/api/v1/namespaces/ims-h4q84/services/ralf","uid":"cbc6ed58-1221-4c9b-8f1b-a95ecd1d6fc7","resourceVersion":"981212","creationTimestamp":"2020-08-19T03:59:44Z"},"spec":{"ports":[{"name":"10888","protocol":"TCP","port":10888,"targetPort":10888}],"selector":{"service":"ralf"},"clusterIP":"None","type":"ClusterIP","sessionAffinity":"None"},"status":{"loadBalancer":{}}}

2020-08-19 03:59:44,761 - functest_kubernetes.ims.ims - INFO - Service ralf created
2020-08-19 03:59:44,762 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1',
 'binary_data': None,
 'data': {'ADDITIONAL_SHARED_CONFIG': '',
          'ZONE': 'ims-h4q84.svc.cluster.local'},
 'kind': 'ConfigMap',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 39, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': None,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'env-vars',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981040',
              'self_link': '/api/v1/namespaces/ims-h4q84/configmaps/env-vars',
              'uid': 'c06b3a3a-06ab-4866-a4c3-efb42f39cfaf'}}
2020-08-19 03:59:45,246 - kubernetes.client.rest - DEBUG - response body: {"kind":"Service","apiVersion":"v1","metadata":{"name":"sprout","namespace":"ims-h4q84","selfLink":"/api/v1/namespaces/ims-h4q84/services/sprout","uid":"43eadbdf-18db-4c16-9f0f-e6451e1b7b3c","resourceVersion":"981214","creationTimestamp":"2020-08-19T03:59:44Z"},"spec":{"ports":[{"name":"5052","protocol":"TCP","port":5052,"targetPort":5052},{"name":"5054","protocol":"TCP","port":5054,"targetPort":5054}],"selector":{"service":"sprout"},"clusterIP":"None","type":"ClusterIP","sessionAffinity":"None"},"status":{"loadBalancer":{}}}

2020-08-19 03:59:45,351 - functest_kubernetes.ims.ims - INFO - Service sprout created
2020-08-19 03:59:45,352 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1',
 'binary_data': None,
 'data': {'ADDITIONAL_SHARED_CONFIG': '',
          'ZONE': 'ims-h4q84.svc.cluster.local'},
 'kind': 'ConfigMap',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 39, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': None,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'env-vars',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981040',
              'self_link': '/api/v1/namespaces/ims-h4q84/configmaps/env-vars',
              'uid': 'c06b3a3a-06ab-4866-a4c3-efb42f39cfaf'}}
2020-08-19 03:59:45,399 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1',
 'kind': 'Deployment',
 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'},
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': 1,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'etcd',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981119',
              'self_link': '/apis/apps/v1/namespaces/ims-h4q84/deployments/etcd',
              'uid': 'ec404eeb-f1f4-4c19-abd5-a7605d350dd1'},
 'spec': {'min_ready_seconds': None,
          'paused': None,
          'progress_deadline_seconds': 600,
          'replicas': 1,
          'revision_history_limit': 10,
          'selector': {'match_expressions': None,
                       'match_labels': {'instance-type': 'etcd-pod'}},
          'strategy': {'rolling_update': {'max_surge': '25%',
                                          'max_unavailable': '25%'},
                       'type': 'RollingUpdate'},
          'template': {'metadata': {'annotations': None,
                                    'cluster_name': None,
                                    'creation_timestamp': None,
                                    'deletion_grace_period_seconds': None,
                                    'deletion_timestamp': None,
                                    'finalizers': None,
                                    'generate_name': None,
                                    'generation': None,
                                    'initializers': None,
                                    'labels': {'instance-type': 'etcd-pod'},
                                    'managed_fields': None,
                                    'name': None,
                                    'namespace': None,
                                    'owner_references': None,
                                    'resource_version': None,
                                    'self_link': None,
                                    'uid': None},
                       'spec': {'active_deadline_seconds': None,
                                'affinity': None,
                                'automount_service_account_token': None,
                                'containers': [{'args': ['--name',
                                                         '$(MY_POD_NAME)',
                                                         '--advertise-client-urls',
                                                         'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001',
                                                         '--listen-client-urls',
                                                         'http://0.0.0.0:2379,http://0.0.0.0:4001',
                                                         '--initial-advertise-peer-urls',
                                                         'http://$(MY_POD_IP):2380',
                                                         '--listen-peer-urls',
                                                         'http://0.0.0.0:2380',
                                                         '--initial-cluster',
                                                         '$(MY_POD_NAME)=http://$(MY_POD_IP):2380',
                                                         '--initial-cluster-state',
                                                         'new'],
                                                'command': None,
                                                'env': [{'name': 'MY_POD_IP',
                                                         'value': None,
                                                         'value_from': {'config_map_key_ref': None,
                                                                        'field_ref': {'api_version': 'v1',
                                                                                      'field_path': 'status.podIP'},
                                                                        'resource_field_ref': None,
                                                                        'secret_key_ref': None}},
                                                        {'name': 'MY_POD_NAME',
                                                         'value': None,
                                                         'value_from': {'config_map_key_ref': None,
                                                                        'field_ref': {'api_version': 'v1',
                                                                                      'field_path': 'metadata.name'},
                                                                        'resource_field_ref': None,
                                                                        'secret_key_ref': None}}],
                                                'env_from': None,
                                                'image': 'quay.io/coreos/etcd:v2.2.5',
                                                'image_pull_policy': 'IfNotPresent',
                                                'lifecycle': None,
                                                'liveness_probe': {'_exec': None,
                                                                   'failure_threshold': 3,
                                                                   'http_get': None,
                                                                   'initial_delay_seconds': 300,
                                                                   'period_seconds': 10,
                                                                   'success_threshold': 1,
                                                                   'tcp_socket': {'host': None,
                                                                                  'port': 4001},
                                                                   'timeout_seconds': 1},
                                                'name': 'etcd',
                                                'ports': [{'container_port': 2379,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'},
                                                          {'container_port': 2380,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'},
                                                          {'container_port': 4001,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'}],
                                                'readiness_probe': {'_exec': None,
                                                                    'failure_threshold': 3,
                                                                    'http_get': None,
                                                                    'initial_delay_seconds': None,
                                                                    'period_seconds': 10,
                                                                    'success_threshold': 1,
                                                                    'tcp_socket': {'host': None,
                                                                                   'port': 4001},
                                                                    'timeout_seconds': 1},
                                                'resources': {'limits': None,
                                                              'requests': None},
                                                'security_context': None,
                                                'stdin': None,
                                                'stdin_once': None,
                                                'termination_message_path': '/dev/termination-log',
                                                'termination_message_policy': 'File',
                                                'tty': None,
                                                'volume_devices': None,
                                                'volume_mounts': None,
                                                'working_dir': None}],
                                'dns_config': None,
                                'dns_policy': 'ClusterFirst',
                                'enable_service_links': None,
                                'host_aliases': None,
                                'host_ipc': None,
                                'host_network': None,
                                'host_pid': None,
                                'hostname': None,
                                'image_pull_secrets': [{'name': None}],
                                'init_containers': None,
                                'node_name': None,
                                'node_selector': None,
                                'priority': None,
                                'priority_class_name': None,
                                'readiness_gates': None,
                                'restart_policy': 'Always',
                                'runtime_class_name': None,
                                'scheduler_name': 'default-scheduler',
                                'security_context': {'fs_group': None,
                                                     'run_as_group': None,
                                                     'run_as_non_root': None,
                                                     'run_as_user': None,
                                                     'se_linux_options': None,
                                                     'supplemental_groups': None,
                                                     'sysctls': None},
                                'service_account': None,
                                'service_account_name': None,
                                'share_process_namespace': None,
                                'subdomain': None,
                                'termination_grace_period_seconds': 30,
                                'tolerations': None,
                                'volumes': None}}},
 'status': {'available_replicas': None,
            'collision_count': None,
            'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
                            'message': 'Deployment does not have minimum '
                                       'availability.',
                            'reason': 'MinimumReplicasUnavailable',
                            'status': 'False',
                            'type': 'Available'},
                           {'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
                            'message': 'ReplicaSet "etcd-5cbf55c8c" is '
                                       'progressing.',
                            'reason': 'ReplicaSetUpdated',
                            'status': 'True',
                            'type': 'Progressing'}],
            'observed_generation': 1,
            'ready_replicas': None,
            'replicas': 1,
            'unavailable_replicas': 1,
            'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'etcd', 'namespace': 'ims-h4q84', 'selfLink': '/apis/apps/v1/namespaces/ims-h4q84/deployments/etcd', 'uid': 'ec404eeb-f1f4-4c19-abd5-a7605d350dd1', 'resourceVersion': '981119', 'generation': 1, 'creationTimestamp': '2020-08-19T03:59:40Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'instance-type': 'etcd-pod'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'instance-type': 'etcd-pod'}}, 'spec': {'containers': [{'name': 'etcd', 'image': 'quay.io/coreos/etcd:v2.2.5', 'args': ['--name', '$(MY_POD_NAME)', '--advertise-client-urls', 'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', '--listen-client-urls', 'http://0.0.0.0:2379,http://0.0.0.0:4001', '--initial-advertise-peer-urls', 'http://$(MY_POD_IP):2380', '--listen-peer-urls', 'http://0.0.0.0:2380', '--initial-cluster', '$(MY_POD_NAME)=http://$(MY_POD_IP):2380', '--initial-cluster-state', 'new'], 'ports': [{'containerPort': 2379, 'protocol': 'TCP'}, {'containerPort': 2380, 'protocol': 'TCP'}, {'containerPort': 4001, 'protocol': 'TCP'}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}, {'name': 'MY_POD_NAME', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'metadata.name'}}}], 'resources': {}, 'livenessProbe': {'tcpSocket': {'port': 4001}, 'initialDelaySeconds': 300, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 4001}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-08-19T03:59:41Z', 'lastTransitionTime': '2020-08-19T03:59:41Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-19T03:59:41Z', 'lastTransitionTime': '2020-08-19T03:59:41Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "etcd-5cbf55c8c" is progressing.'}]}}}
2020-08-19 03:59:45,636 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1',
 'kind': 'Deployment',
 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'},
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': 1,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'homer',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981132',
              'self_link': '/apis/apps/v1/namespaces/ims-h4q84/deployments/homer',
              'uid': '75f3b2f0-529c-4fd0-8647-466ea1b655bc'},
 'spec': {'min_ready_seconds': None,
          'paused': None,
          'progress_deadline_seconds': 600,
          'replicas': 1,
          'revision_history_limit': 10,
          'selector': {'match_expressions': None,
                       'match_labels': {'service': 'homer'}},
          'strategy': {'rolling_update': {'max_surge': '25%',
                                          'max_unavailable': '25%'},
                       'type': 'RollingUpdate'},
          'template': {'metadata': {'annotations': None,
                                    'cluster_name': None,
                                    'creation_timestamp': None,
                                    'deletion_grace_period_seconds': None,
                                    'deletion_timestamp': None,
                                    'finalizers': None,
                                    'generate_name': None,
                                    'generation': None,
                                    'initializers': None,
                                    'labels': {'service': 'homer'},
                                    'managed_fields': None,
                                    'name': None,
                                    'namespace': None,
                                    'owner_references': None,
                                    'resource_version': None,
                                    'self_link': None,
                                    'uid': None},
                       'spec': {'active_deadline_seconds': None,
                                'affinity': None,
                                'automount_service_account_token': None,
                                'containers': [{'args': None,
                                                'command': None,
                                                'env': [{'name': 'MY_POD_IP',
                                                         'value': None,
                                                         'value_from': {'config_map_key_ref': None,
                                                                        'field_ref': {'api_version': 'v1',
                                                                                      'field_path': 'status.podIP'},
                                                                        'resource_field_ref': None,
                                                                        'secret_key_ref': None}}],
                                                'env_from': [{'config_map_ref': {'name': 'env-vars',
                                                                                 'optional': None},
                                                              'prefix': None,
                                                              'secret_ref': None}],
                                                'image': 'ollivier/clearwater-homer:latest',
                                                'image_pull_policy': 'Always',
                                                'lifecycle': None,
                                                'liveness_probe': {'_exec': None,
                                                                   'failure_threshold': 3,
                                                                   'http_get': None,
                                                                   'initial_delay_seconds': 30,
                                                                   'period_seconds': 10,
                                                                   'success_threshold': 1,
                                                                   'tcp_socket': {'host': None,
                                                                                  'port': 7888},
                                                                   'timeout_seconds': 1},
                                                'name': 'homer',
                                                'ports': [{'container_port': 22,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'},
                                                          {'container_port': 7888,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'}],
                                                'readiness_probe': {'_exec': None,
                                                                    'failure_threshold': 3,
                                                                    'http_get': None,
                                                                    'initial_delay_seconds': None,
                                                                    'period_seconds': 10,
                                                                    'success_threshold': 1,
                                                                    'tcp_socket': {'host': None,
                                                                                   'port': 7888},
                                                                    'timeout_seconds': 1},
                                                'resources': {'limits': None,
                                                              'requests': None},
                                                'security_context': None,
                                                'stdin': None,
                                                'stdin_once': None,
                                                'termination_message_path': '/dev/termination-log',
                                                'termination_message_policy': 'File',
                                                'tty': None,
                                                'volume_devices': None,
                                                'volume_mounts': None,
                                                'working_dir': None}],
                                'dns_config': None,
                                'dns_policy': 'ClusterFirst',
                                'enable_service_links': None,
                                'host_aliases': None,
                                'host_ipc': None,
                                'host_network': None,
                                'host_pid': None,
                                'hostname': None,
                                'image_pull_secrets': [{'name': None}],
                                'init_containers': [{'args': None,
                                                     'command': ['sh',
                                                                 '-c',
                                                                 'until '
                                                                 'nslookup '
                                                                 'cassandra; '
                                                                 'do echo '
                                                                 'waiting for '
                                                                 'cassandra to '
                                                                 'start ...; '
                                                                 'sleep 2; '
                                                                 'done'],
                                                     'env': None,
                                                     'env_from': None,
                                                     'image': 'busybox:1.28',
                                                     'image_pull_policy': 'IfNotPresent',
                                                     'lifecycle': None,
                                                     'liveness_probe': None,
                                                     'name': 'wait-on-cassandra',
                                                     'ports': None,
                                                     'readiness_probe': None,
                                                     'resources': {'limits': None,
                                                                   'requests': None},
                                                     'security_context': None,
                                                     'stdin': None,
                                                     'stdin_once': None,
                                                     'termination_message_path': '/dev/termination-log',
                                                     'termination_message_policy': 'File',
                                                     'tty': None,
                                                     'volume_devices': None,
                                                     'volume_mounts': None,
                                                     'working_dir': None}],
                                'node_name': None,
                                'node_selector': None,
                                'priority': None,
                                'priority_class_name': None,
                                'readiness_gates': None,
                                'restart_policy': 'Always',
                                'runtime_class_name': None,
                                'scheduler_name': 'default-scheduler',
                                'security_context': {'fs_group': None,
                                                     'run_as_group': None,
                                                     'run_as_non_root': None,
                                                     'run_as_user': None,
                                                     'se_linux_options': None,
                                                     'supplemental_groups': None,
                                                     'sysctls': None},
                                'service_account': None,
                                'service_account_name': None,
                                'share_process_namespace': None,
                                'subdomain': None,
                                'termination_grace_period_seconds': 30,
                                'tolerations': None,
                                'volumes': None}}},
 'status': {'available_replicas': None,
            'collision_count': None,
            'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
                            'message': 'Deployment does not have minimum '
                                       'availability.',
                            'reason': 'MinimumReplicasUnavailable',
                            'status': 'False',
                            'type': 'Available'},
                           {'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
                            'message': 'ReplicaSet "homer-74dd4556d9" is '
                                       'progressing.',
                            'reason': 'ReplicaSetUpdated',
                            'status': 'True',
                            'type': 'Progressing'}],
            'observed_generation': 1,
            'ready_replicas': None,
            'replicas': 1,
            'unavailable_replicas': 1,
            'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homer', 'namespace': 'ims-h4q84', 'selfLink': '/apis/apps/v1/namespaces/ims-h4q84/deployments/homer', 'uid': '75f3b2f0-529c-4fd0-8647-466ea1b655bc', 'resourceVersion': '981132', 'generation': 1, 'creationTimestamp': '2020-08-19T03:59:41Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homer'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homer'}}, 'spec': {'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homer', 'image': 'ollivier/clearwater-homer:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'tcpSocket': {'port': 7888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 7888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-08-19T03:59:41Z', 'lastTransitionTime': '2020-08-19T03:59:41Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-19T03:59:41Z', 'lastTransitionTime': '2020-08-19T03:59:41Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "homer-74dd4556d9" is progressing.'}]}}}
2020-08-19 03:59:45,849 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1',
 'kind': 'Deployment',
 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'},
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': 1,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'homestead-prov',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981160',
              'self_link': '/apis/apps/v1/namespaces/ims-h4q84/deployments/homestead-prov',
              'uid': '74868f80-4d95-45cd-823a-a73146cb3109'},
 'spec': {'min_ready_seconds': None,
          'paused': None,
          'progress_deadline_seconds': 600,
          'replicas': 1,
          'revision_history_limit': 10,
          'selector': {'match_expressions': None,
                       'match_labels': {'service': 'homestead-prov'}},
          'strategy': {'rolling_update': {'max_surge': '25%',
                                          'max_unavailable': '25%'},
                       'type': 'RollingUpdate'},
          'template': {'metadata': {'annotations': None,
                                    'cluster_name': None,
                                    'creation_timestamp': None,
                                    'deletion_grace_period_seconds': None,
                                    'deletion_timestamp': None,
                                    'finalizers': None,
                                    'generate_name': None,
                                    'generation': None,
                                    'initializers': None,
                                    'labels': {'service': 'homestead-prov',
                                               'snmp': 'enabled'},
                                    'managed_fields': None,
                                    'name': None,
                                    'namespace': None,
                                    'owner_references': None,
                                    'resource_version': None,
                                    'self_link': None,
                                    'uid': None},
                       'spec': {'active_deadline_seconds': None,
                                'affinity': None,
                                'automount_service_account_token': None,
                                'containers': [{'args': None,
                                                'command': None,
                                                'env': [{'name': 'MY_POD_IP',
                                                         'value': None,
                                                         'value_from': {'config_map_key_ref': None,
                                                                        'field_ref': {'api_version': 'v1',
                                                                                      'field_path': 'status.podIP'},
                                                                        'resource_field_ref': None,
                                                                        'secret_key_ref': None}}],
                                                'env_from': [{'config_map_ref': {'name': 'env-vars',
                                                                                 'optional': None},
                                                              'prefix': None,
                                                              'secret_ref': None}],
                                                'image': 'ollivier/clearwater-homestead-prov:latest',
                                                'image_pull_policy': 'Always',
                                                'lifecycle': None,
                                                'liveness_probe': {'_exec': {'command': ['/bin/bash',
                                                                                         '/usr/share/clearwater/bin/poll_homestead-prov.sh']},
                                                                   'failure_threshold': 3,
                                                                   'http_get': None,
                                                                   'initial_delay_seconds': 60,
                                                                   'period_seconds': 10,
                                                                   'success_threshold': 1,
                                                                   'tcp_socket': None,
                                                                   'timeout_seconds': 1},
                                                'name': 'homestead-prov',
                                                'ports': [{'container_port': 22,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'},
                                                          {'container_port': 8889,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'}],
                                                'readiness_probe': {'_exec': {'command': ['/bin/bash',
                                                                                          '/usr/share/clearwater/bin/poll_homestead-prov.sh']},
                                                                    'failure_threshold': 3,
                                                                    'http_get': None,
                                                                    'initial_delay_seconds': None,
                                                                    'period_seconds': 10,
                                                                    'success_threshold': 1,
                                                                    'tcp_socket': None,
                                                                    'timeout_seconds': 1},
                                                'resources': {'limits': None,
                                                              'requests': None},
                                                'security_context': None,
                                                'stdin': None,
                                                'stdin_once': None,
                                                'termination_message_path': '/dev/termination-log',
                                                'termination_message_policy': 'File',
                                                'tty': None,
                                                'volume_devices': None,
                                                'volume_mounts': None,
                                                'working_dir': None}],
                                'dns_config': None,
                                'dns_policy': 'ClusterFirst',
                                'enable_service_links': None,
                                'host_aliases': None,
                                'host_ipc': None,
                                'host_network': None,
                                'host_pid': None,
                                'hostname': None,
                                'image_pull_secrets': [{'name': None}],
                                'init_containers': [{'args': None,
                                                     'command': ['sh',
                                                                 '-c',
                                                                 'until '
                                                                 'nslookup '
                                                                 'homestead; '
                                                                 'do echo '
                                                                 'waiting for '
                                                                 'homestead to '
                                                                 'start ...; '
                                                                 'sleep 2; '
                                                                 'done'],
                                                     'env': None,
                                                     'env_from': None,
                                                     'image': 'busybox:1.28',
                                                     'image_pull_policy': 'IfNotPresent',
                                                     'lifecycle': None,
                                                     'liveness_probe': None,
                                                     'name': 'wait-on-homestead',
                                                     'ports': None,
                                                     'readiness_probe': None,
                                                     'resources': {'limits': None,
                                                                   'requests': None},
                                                     'security_context': None,
                                                     'stdin': None,
                                                     'stdin_once': None,
                                                     'termination_message_path': '/dev/termination-log',
                                                     'termination_message_policy': 'File',
                                                     'tty': None,
                                                     'volume_devices': None,
                                                     'volume_mounts': None,
                                                     'working_dir': None}],
                                'node_name': None,
                                'node_selector': None,
                                'priority': None,
                                'priority_class_name': None,
                                'readiness_gates': None,
                                'restart_policy': 'Always',
                                'runtime_class_name': None,
                                'scheduler_name': 'default-scheduler',
                                'security_context': {'fs_group': None,
                                                     'run_as_group': None,
                                                     'run_as_non_root': None,
                                                     'run_as_user': None,
                                                     'se_linux_options': None,
                                                     'supplemental_groups': None,
                                                     'sysctls': None},
                                'service_account': None,
                                'service_account_name': None,
                                'share_process_namespace': None,
                                'subdomain': None,
                                'termination_grace_period_seconds': 30,
                                'tolerations': None,
                                'volumes': None}}},
 'status': {'available_replicas': None,
            'collision_count': None,
            'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
                            'message': 'Deployment does not have minimum '
                                       'availability.',
                            'reason': 'MinimumReplicasUnavailable',
                            'status': 'False',
                            'type': 'Available'},
                           {'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
                            'message': 'ReplicaSet "homestead-prov-756c8bff5d" '
                                       'is progressing.',
                            'reason': 'ReplicaSetUpdated',
                            'status': 'True',
                            'type': 'Progressing'}],
            'observed_generation': 1,
            'ready_replicas': None,
            'replicas': 1,
            'unavailable_replicas': 1,
            'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homestead-prov', 'namespace': 'ims-h4q84', 'selfLink': '/apis/apps/v1/namespaces/ims-h4q84/deployments/homestead-prov', 'uid': '74868f80-4d95-45cd-823a-a73146cb3109', 'resourceVersion': '981160', 'generation': 1, 'creationTimestamp': '2020-08-19T03:59:41Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homestead-prov'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homestead-prov', 'snmp': 'enabled'}}, 'spec': {'initContainers': [{'name': 'wait-on-homestead', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead-prov', 'image': 'ollivier/clearwater-homestead-prov:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8889, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-08-19T03:59:41Z', 'lastTransitionTime': '2020-08-19T03:59:41Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-19T03:59:41Z', 'lastTransitionTime': '2020-08-19T03:59:41Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "homestead-prov-756c8bff5d" is progressing.'}]}}}
2020-08-19 03:59:46,051 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1',
 'kind': 'Deployment',
 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'},
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': 1,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'cassandra',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981079',
              'self_link': '/apis/apps/v1/namespaces/ims-h4q84/deployments/cassandra',
              'uid': '2450d20d-764f-48c7-bd78-68a4bcdc93c2'},
 'spec': {'min_ready_seconds': None,
          'paused': None,
          'progress_deadline_seconds': 600,
          'replicas': 1,
          'revision_history_limit': 10,
          'selector': {'match_expressions': None,
                       'match_labels': {'service': 'cassandra'}},
          'strategy': {'rolling_update': {'max_surge': '25%',
                                          'max_unavailable': '25%'},
                       'type': 'RollingUpdate'},
          'template': {'metadata': {'annotations': None,
                                    'cluster_name': None,
                                    'creation_timestamp': None,
                                    'deletion_grace_period_seconds': None,
                                    'deletion_timestamp': None,
                                    'finalizers': None,
                                    'generate_name': None,
                                    'generation': None,
                                    'initializers': None,
                                    'labels': {'service': 'cassandra'},
                                    'managed_fields': None,
                                    'name': None,
                                    'namespace': None,
                                    'owner_references': None,
                                    'resource_version': None,
                                    'self_link': None,
                                    'uid': None},
                       'spec': {'active_deadline_seconds': None,
                                'affinity': None,
                                'automount_service_account_token': None,
                                'containers': [{'args': None,
                                                'command': None,
                                                'env': [{'name': 'MY_POD_IP',
                                                         'value': None,
                                                         'value_from': {'config_map_key_ref': None,
                                                                        'field_ref': {'api_version': 'v1',
                                                                                      'field_path': 'status.podIP'},
                                                                        'resource_field_ref': None,
                                                                        'secret_key_ref': None}}],
                                                'env_from': [{'config_map_ref': {'name': 'env-vars',
                                                                                 'optional': None},
                                                              'prefix': None,
                                                              'secret_ref': None}],
                                                'image': 'ollivier/clearwater-cassandra:latest',
                                                'image_pull_policy': 'Always',
                                                'lifecycle': None,
                                                'liveness_probe': {'_exec': {'command': ['/bin/bash',
                                                                                         '/usr/share/kubernetes/liveness.sh',
                                                                                         '7000 '
                                                                                         '9042 '
                                                                                         '9160']},
                                                                   'failure_threshold': 3,
                                                                   'http_get': None,
                                                                   'initial_delay_seconds': 600,
                                                                   'period_seconds': 10,
                                                                   'success_threshold': 1,
                                                                   'tcp_socket': None,
                                                                   'timeout_seconds': 1},
                                                'name': 'cassandra',
                                                'ports': [{'container_port': 22,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'},
                                                          {'container_port': 7001,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'},
                                                          {'container_port': 9042,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'},
                                                          {'container_port': 9160,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'}],
                                                'readiness_probe': {'_exec': {'command': ['/bin/bash',
                                                                                          '/usr/share/kubernetes/liveness.sh',
                                                                                          '7000 '
                                                                                          '9042 '
                                                                                          '9160']},
                                                                    'failure_threshold': 3,
                                                                    'http_get': None,
                                                                    'initial_delay_seconds': None,
                                                                    'period_seconds': 10,
                                                                    'success_threshold': 1,
                                                                    'tcp_socket': None,
                                                                    'timeout_seconds': 1},
                                                'resources': {'limits': None,
                                                              'requests': None},
                                                'security_context': None,
                                                'stdin': None,
                                                'stdin_once': None,
                                                'termination_message_path': '/dev/termination-log',
                                                'termination_message_policy': 'File',
                                                'tty': None,
                                                'volume_devices': None,
                                                'volume_mounts': None,
                                                'working_dir': None}],
                                'dns_config': None,
                                'dns_policy': 'ClusterFirst',
                                'enable_service_links': None,
                                'host_aliases': None,
                                'host_ipc': None,
                                'host_network': None,
                                'host_pid': None,
                                'hostname': None,
                                'image_pull_secrets': [{'name': None}],
                                'init_containers': [{'args': None,
                                                     'command': ['sh',
                                                                 '-c',
                                                                 'until '
                                                                 'nslookup '
                                                                 'etcd; do '
                                                                 'echo waiting '
                                                                 'for etcd to '
                                                                 'start ...; '
                                                                 'sleep 2; '
                                                                 'done'],
                                                     'env': None,
                                                     'env_from': None,
                                                     'image': 'busybox:1.28',
                                                     'image_pull_policy': 'IfNotPresent',
                                                     'lifecycle': None,
                                                     'liveness_probe': None,
                                                     'name': 'wait-on-etcd',
                                                     'ports': None,
                                                     'readiness_probe': None,
                                                     'resources': {'limits': None,
                                                                   'requests': None},
                                                     'security_context': None,
                                                     'stdin': None,
                                                     'stdin_once': None,
                                                     'termination_message_path': '/dev/termination-log',
                                                     'termination_message_policy': 'File',
                                                     'tty': None,
                                                     'volume_devices': None,
                                                     'volume_mounts': None,
                                                     'working_dir': None}],
                                'node_name': None,
                                'node_selector': None,
                                'priority': None,
                                'priority_class_name': None,
                                'readiness_gates': None,
                                'restart_policy': 'Always',
                                'runtime_class_name': None,
                                'scheduler_name': 'default-scheduler',
                                'security_context': {'fs_group': None,
                                                     'run_as_group': None,
                                                     'run_as_non_root': None,
                                                     'run_as_user': None,
                                                     'se_linux_options': None,
                                                     'supplemental_groups': None,
                                                     'sysctls': None},
                                'service_account': None,
                                'service_account_name': None,
                                'share_process_namespace': None,
                                'subdomain': None,
                                'termination_grace_period_seconds': 30,
                                'tolerations': None,
                                'volumes': None}}},
 'status': {'available_replicas': None,
            'collision_count': None,
            'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
                            'message': 'Deployment does not have minimum '
                                       'availability.',
                            'reason': 'MinimumReplicasUnavailable',
                            'status': 'False',
                            'type': 'Available'},
                           {'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
                            'message': 'ReplicaSet "cassandra-76f5c4d86c" is '
                                       'progressing.',
                            'reason': 'ReplicaSetUpdated',
                            'status': 'True',
                            'type': 'Progressing'}],
            'observed_generation': 1,
            'ready_replicas': None,
            'replicas': 1,
            'unavailable_replicas': 1,
            'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'cassandra', 'namespace': 'ims-h4q84', 'selfLink': '/apis/apps/v1/namespaces/ims-h4q84/deployments/cassandra', 'uid': '2450d20d-764f-48c7-bd78-68a4bcdc93c2', 'resourceVersion': '981079', 'generation': 1, 'creationTimestamp': '2020-08-19T03:59:40Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'cassandra'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'cassandra'}}, 'spec': {'initContainers': [{'name': 'wait-on-etcd', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup etcd; do echo waiting for etcd to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'cassandra', 'image': 'ollivier/clearwater-cassandra:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7001, 'protocol': 'TCP'}, {'containerPort': 9042, 'protocol': 'TCP'}, {'containerPort': 9160, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 9160']}, 'initialDelaySeconds': 600, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 9160']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-08-19T03:59:40Z', 'lastTransitionTime': '2020-08-19T03:59:40Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-19T03:59:40Z', 'lastTransitionTime': '2020-08-19T03:59:40Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "cassandra-76f5c4d86c" is progressing.'}]}}}
2020-08-19 03:59:46,377 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1',
 'kind': 'Deployment',
 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'},
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': 1,
              'initializers': None,
              'labels': {'service': 'chronos'},
              'managed_fields': None,
              'name': 'chronos',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981092',
              'self_link': '/apis/apps/v1/namespaces/ims-h4q84/deployments/chronos',
              'uid': '0fc1b512-88a4-4734-8f1e-3c57dc26a77b'},
 'spec': {'min_ready_seconds': None,
          'paused': None,
          'progress_deadline_seconds': 600,
          'replicas': 1,
          'revision_history_limit': 10,
          'selector': {'match_expressions': None,
                       'match_labels': {'service': 'chronos'}},
          'strategy': {'rolling_update': {'max_surge': '25%',
                                          'max_unavailable': '25%'},
                       'type': 'RollingUpdate'},
          'template': {'metadata': {'annotations': None,
                                    'cluster_name': None,
                                    'creation_timestamp': None,
                                    'deletion_grace_period_seconds': None,
                                    'deletion_timestamp': None,
                                    'finalizers': None,
                                    'generate_name': None,
                                    'generation': None,
                                    'initializers': None,
                                    'labels': {'service': 'chronos'},
                                    'managed_fields': None,
                                    'name': None,
                                    'namespace': None,
                                    'owner_references': None,
                                    'resource_version': None,
                                    'self_link': None,
                                    'uid': None},
                       'spec': {'active_deadline_seconds': None,
                                'affinity': None,
                                'automount_service_account_token': None,
                                'containers': [{'args': None,
                                                'command': None,
                                                'env': [{'name': 'MY_POD_IP',
                                                         'value': None,
                                                         'value_from': {'config_map_key_ref': None,
                                                                        'field_ref': {'api_version': 'v1',
                                                                                      'field_path': 'status.podIP'},
                                                                        'resource_field_ref': None,
                                                                        'secret_key_ref': None}}],
                                                'env_from': [{'config_map_ref': {'name': 'env-vars',
                                                                                 'optional': None},
                                                              'prefix': None,
                                                              'secret_ref': None}],
                                                'image': 'ollivier/clearwater-chronos:latest',
                                                'image_pull_policy': 'Always',
                                                'lifecycle': {'post_start': None,
                                                              'pre_stop': {'_exec': {'command': ['/bin/bash',
                                                                                                 '-c',
                                                                                                 '/usr/bin/pre-stop']},
                                                                           'http_get': None,
                                                                           'tcp_socket': None}},
                                                'liveness_probe': {'_exec': None,
                                                                   'failure_threshold': 9,
                                                                   'http_get': None,
                                                                   'initial_delay_seconds': None,
                                                                   'period_seconds': 10,
                                                                   'success_threshold': 1,
                                                                   'tcp_socket': {'host': None,
                                                                                  'port': 7253},
                                                                   'timeout_seconds': 1},
                                                'name': 'chronos',
                                                'ports': [{'container_port': 22,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'},
                                                          {'container_port': 7253,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'}],
                                                'readiness_probe': {'_exec': None,
                                                                    'failure_threshold': 3,
                                                                    'http_get': None,
                                                                    'initial_delay_seconds': None,
                                                                    'period_seconds': 10,
                                                                    'success_threshold': 1,
                                                                    'tcp_socket': {'host': None,
                                                                                   'port': 7253},
                                                                    'timeout_seconds': 1},
                                                'resources': {'limits': None,
                                                              'requests': None},
                                                'security_context': None,
                                                'stdin': None,
                                                'stdin_once': None,
                                                'termination_message_path': '/dev/termination-log',
                                                'termination_message_policy': 'File',
                                                'tty': None,
                                                'volume_devices': None,
                                                'volume_mounts': [{'mount_path': '/var/log/chronos',
                                                                   'mount_propagation': None,
                                                                   'name': 'chronoslogs',
                                                                   'read_only': None,
                                                                   'sub_path': None,
                                                                   'sub_path_expr': None}],
                                                'working_dir': None},
                                               {'args': None,
                                                'command': ['tail',
                                                            '-F',
                                                            '/var/log/chronos/chronos_current.txt'],
                                                'env': None,
                                                'env_from': None,
                                                'image': 'busybox',
                                                'image_pull_policy': 'Always',
                                                'lifecycle': None,
                                                'liveness_probe': None,
                                                'name': 'tailer',
                                                'ports': None,
                                                'readiness_probe': None,
                                                'resources': {'limits': None,
                                                              'requests': None},
                                                'security_context': None,
                                                'stdin': None,
                                                'stdin_once': None,
                                                'termination_message_path': '/dev/termination-log',
                                                'termination_message_policy': 'File',
                                                'tty': None,
                                                'volume_devices': None,
                                                'volume_mounts': [{'mount_path': '/var/log/chronos',
                                                                   'mount_propagation': None,
                                                                   'name': 'chronoslogs',
                                                                   'read_only': None,
                                                                   'sub_path': None,
                                                                   'sub_path_expr': None}],
                                                'working_dir': None}],
                                'dns_config': None,
                                'dns_policy': 'ClusterFirst',
                                'enable_service_links': None,
                                'host_aliases': None,
                                'host_ipc': None,
                                'host_network': None,
                                'host_pid': None,
                                'hostname': None,
                                'image_pull_secrets': [{'name': None}],
                                'init_containers': [{'args': None,
                                                     'command': ['sh',
                                                                 '-c',
                                                                 'until '
                                                                 'nslookup '
                                                                 'cassandra; '
                                                                 'do echo '
                                                                 'waiting for '
                                                                 'cassandra to '
                                                                 'start ...; '
                                                                 'sleep 2; '
                                                                 'done'],
                                                     'env': None,
                                                     'env_from': None,
                                                     'image': 'busybox:1.28',
                                                     'image_pull_policy': 'IfNotPresent',
                                                     'lifecycle': None,
                                                     'liveness_probe': None,
                                                     'name': 'wait-on-cassandra',
                                                     'ports': None,
                                                     'readiness_probe': None,
                                                     'resources': {'limits': None,
                                                                   'requests': None},
                                                     'security_context': None,
                                                     'stdin': None,
                                                     'stdin_once': None,
                                                     'termination_message_path': '/dev/termination-log',
                                                     'termination_message_policy': 'File',
                                                     'tty': None,
                                                     'volume_devices': None,
                                                     'volume_mounts': None,
                                                     'working_dir': None}],
                                'node_name': None,
                                'node_selector': None,
                                'priority': None,
                                'priority_class_name': None,
                                'readiness_gates': None,
                                'restart_policy': 'Always',
                                'runtime_class_name': None,
                                'scheduler_name': 'default-scheduler',
                                'security_context': {'fs_group': None,
                                                     'run_as_group': None,
                                                     'run_as_non_root': None,
                                                     'run_as_user': None,
                                                     'se_linux_options': None,
                                                     'supplemental_groups': None,
                                                     'sysctls': None},
                                'service_account': None,
                                'service_account_name': None,
                                'share_process_namespace': None,
                                'subdomain': None,
                                'termination_grace_period_seconds': 120,
                                'tolerations': None,
                                'volumes': [{'aws_elastic_block_store': None,
                                             'azure_disk': None,
                                             'azure_file': None,
                                             'cephfs': None,
                                             'cinder': None,
                                             'config_map': None,
                                             'csi': None,
                                             'downward_api': None,
                                             'empty_dir': {'medium': None,
                                                           'size_limit': None},
                                             'fc': None,
                                             'flex_volume': None,
                                             'flocker': None,
                                             'gce_persistent_disk': None,
                                             'git_repo': None,
                                             'glusterfs': None,
                                             'host_path': None,
                                             'iscsi': None,
                                             'name': 'chronoslogs',
                                             'nfs': None,
                                             'persistent_volume_claim': None,
                                             'photon_persistent_disk': None,
                                             'portworx_volume': None,
                                             'projected': None,
                                             'quobyte': None,
                                             'rbd': None,
                                             'scale_io': None,
                                             'secret': None,
                                             'storageos': None,
                                             'vsphere_volume': None}]}}},
 'status': {'available_replicas': None,
            'collision_count': None,
            'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
                            'message': 'Deployment does not have minimum '
                                       'availability.',
                            'reason': 'MinimumReplicasUnavailable',
                            'status': 'False',
                            'type': 'Available'},
                           {'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
                            'message': 'ReplicaSet "chronos-687b9884c5" is '
                                       'progressing.',
                            'reason': 'ReplicaSetUpdated',
                            'status': 'True',
                            'type': 'Progressing'}],
            'observed_generation': 1,
            'ready_replicas': None,
            'replicas': 1,
            'unavailable_replicas': 1,
            'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'chronos', 'namespace': 'ims-h4q84', 'selfLink': '/apis/apps/v1/namespaces/ims-h4q84/deployments/chronos', 'uid': '0fc1b512-88a4-4734-8f1e-3c57dc26a77b', 'resourceVersion': '981092', 'generation': 1, 'creationTimestamp': '2020-08-19T03:59:40Z', 'labels': {'service': 'chronos'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'chronos'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'chronos'}}, 'spec': {'volumes': [{'name': 'chronoslogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'chronos', 'image': 'ollivier/clearwater-chronos:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7253, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'chronoslogs', 'mountPath': '/var/log/chronos'}], 'livenessProbe': {'tcpSocket': {'port': 7253}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 9}, 'readinessProbe': {'tcpSocket': {'port': 7253}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'lifecycle': {'preStop': {'exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}}}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/chronos/chronos_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'chronoslogs', 'mountPath': '/var/log/chronos'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 120, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-08-19T03:59:40Z', 'lastTransitionTime': '2020-08-19T03:59:40Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-19T03:59:40Z', 'lastTransitionTime': '2020-08-19T03:59:40Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "chronos-687b9884c5" is progressing.'}]}}}
2020-08-19 03:59:46,753 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1',
 'kind': 'Deployment',
 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'},
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 39, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': 1,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'astaire',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981053',
              'self_link': '/apis/apps/v1/namespaces/ims-h4q84/deployments/astaire',
              'uid': '70bf9edb-e201-4cbe-8cba-1b1ae3f80a33'},
 'spec': {'min_ready_seconds': None,
          'paused': None,
          'progress_deadline_seconds': 600,
          'replicas': 1,
          'revision_history_limit': 10,
          'selector': {'match_expressions': None,
                       'match_labels': {'service': 'astaire'}},
          'strategy': {'rolling_update': {'max_surge': '25%',
                                          'max_unavailable': '25%'},
                       'type': 'RollingUpdate'},
          'template': {'metadata': {'annotations': None,
                                    'cluster_name': None,
                                    'creation_timestamp': None,
                                    'deletion_grace_period_seconds': None,
                                    'deletion_timestamp': None,
                                    'finalizers': None,
                                    'generate_name': None,
                                    'generation': None,
                                    'initializers': None,
                                    'labels': {'service': 'astaire'},
                                    'managed_fields': None,
                                    'name': None,
                                    'namespace': None,
                                    'owner_references': None,
                                    'resource_version': None,
                                    'self_link': None,
                                    'uid': None},
                       'spec': {'active_deadline_seconds': None,
                                'affinity': None,
                                'automount_service_account_token': None,
                                'containers': [{'args': None,
                                                'command': None,
                                                'env': [{'name': 'MY_POD_IP',
                                                         'value': None,
                                                         'value_from': {'config_map_key_ref': None,
                                                                        'field_ref': {'api_version': 'v1',
                                                                                      'field_path': 'status.podIP'},
                                                                        'resource_field_ref': None,
                                                                        'secret_key_ref': None}}],
                                                'env_from': [{'config_map_ref': {'name': 'env-vars',
                                                                                 'optional': None},
                                                              'prefix': None,
                                                              'secret_ref': None}],
                                                'image': 'ollivier/clearwater-astaire:latest',
                                                'image_pull_policy': 'Always',
                                                'lifecycle': {'post_start': None,
                                                              'pre_stop': {'_exec': {'command': ['/bin/bash',
                                                                                                 '-c',
                                                                                                 '/usr/bin/pre-stop']},
                                                                           'http_get': None,
                                                                           'tcp_socket': None}},
                                                'liveness_probe': {'_exec': None,
                                                                   'failure_threshold': 9,
                                                                   'http_get': None,
                                                                   'initial_delay_seconds': None,
                                                                   'period_seconds': 10,
                                                                   'success_threshold': 1,
                                                                   'tcp_socket': {'host': None,
                                                                                  'port': 11311},
                                                                   'timeout_seconds': 1},
                                                'name': 'astaire',
                                                'ports': [{'container_port': 22,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'},
                                                          {'container_port': 11211,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'},
                                                          {'container_port': 11311,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'}],
                                                'readiness_probe': {'_exec': None,
                                                                    'failure_threshold': 3,
                                                                    'http_get': None,
                                                                    'initial_delay_seconds': None,
                                                                    'period_seconds': 10,
                                                                    'success_threshold': 1,
                                                                    'tcp_socket': {'host': None,
                                                                                   'port': 11311},
                                                                    'timeout_seconds': 1},
                                                'resources': {'limits': None,
                                                              'requests': None},
                                                'security_context': None,
                                                'stdin': None,
                                                'stdin_once': None,
                                                'termination_message_path': '/dev/termination-log',
                                                'termination_message_policy': 'File',
                                                'tty': None,
                                                'volume_devices': None,
                                                'volume_mounts': [{'mount_path': '/var/log/astaire',
                                                                   'mount_propagation': None,
                                                                   'name': 'astairelogs',
                                                                   'read_only': None,
                                                                   'sub_path': None,
                                                                   'sub_path_expr': None}],
                                                'working_dir': None},
                                               {'args': None,
                                                'command': ['tail',
                                                            '-F',
                                                            '/var/log/astaire/astaire_current.txt'],
                                                'env': None,
                                                'env_from': None,
                                                'image': 'busybox',
                                                'image_pull_policy': 'Always',
                                                'lifecycle': None,
                                                'liveness_probe': None,
                                                'name': 'tailer',
                                                'ports': None,
                                                'readiness_probe': None,
                                                'resources': {'limits': None,
                                                              'requests': None},
                                                'security_context': None,
                                                'stdin': None,
                                                'stdin_once': None,
                                                'termination_message_path': '/dev/termination-log',
                                                'termination_message_policy': 'File',
                                                'tty': None,
                                                'volume_devices': None,
                                                'volume_mounts': [{'mount_path': '/var/log/astaire',
                                                                   'mount_propagation': None,
                                                                   'name': 'astairelogs',
                                                                   'read_only': None,
                                                                   'sub_path': None,
                                                                   'sub_path_expr': None}],
                                                'working_dir': None}],
                                'dns_config': None,
                                'dns_policy': 'ClusterFirst',
                                'enable_service_links': None,
                                'host_aliases': None,
                                'host_ipc': None,
                                'host_network': None,
                                'host_pid': None,
                                'hostname': None,
                                'image_pull_secrets': [{'name': None}],
                                'init_containers': [{'args': None,
                                                     'command': ['sh',
                                                                 '-c',
                                                                 'until '
                                                                 'nslookup '
                                                                 'cassandra; '
                                                                 'do echo '
                                                                 'waiting for '
                                                                 'cassandra to '
                                                                 'start ...; '
                                                                 'sleep 2; '
                                                                 'done'],
                                                     'env': None,
                                                     'env_from': None,
                                                     'image': 'busybox:1.28',
                                                     'image_pull_policy': 'IfNotPresent',
                                                     'lifecycle': None,
                                                     'liveness_probe': None,
                                                     'name': 'wait-on-cassandra',
                                                     'ports': None,
                                                     'readiness_probe': None,
                                                     'resources': {'limits': None,
                                                                   'requests': None},
                                                     'security_context': None,
                                                     'stdin': None,
                                                     'stdin_once': None,
                                                     'termination_message_path': '/dev/termination-log',
                                                     'termination_message_policy': 'File',
                                                     'tty': None,
                                                     'volume_devices': None,
                                                     'volume_mounts': None,
                                                     'working_dir': None}],
                                'node_name': None,
                                'node_selector': None,
                                'priority': None,
                                'priority_class_name': None,
                                'readiness_gates': None,
                                'restart_policy': 'Always',
                                'runtime_class_name': None,
                                'scheduler_name': 'default-scheduler',
                                'security_context': {'fs_group': None,
                                                     'run_as_group': None,
                                                     'run_as_non_root': None,
                                                     'run_as_user': None,
                                                     'se_linux_options': None,
                                                     'supplemental_groups': None,
                                                     'sysctls': None},
                                'service_account': None,
                                'service_account_name': None,
                                'share_process_namespace': None,
                                'subdomain': None,
                                'termination_grace_period_seconds': 120,
                                'tolerations': None,
                                'volumes': [{'aws_elastic_block_store': None,
                                             'azure_disk': None,
                                             'azure_file': None,
                                             'cephfs': None,
                                             'cinder': None,
                                             'config_map': None,
                                             'csi': None,
                                             'downward_api': None,
                                             'empty_dir': {'medium': None,
                                                           'size_limit': None},
                                             'fc': None,
                                             'flex_volume': None,
                                             'flocker': None,
                                             'gce_persistent_disk': None,
                                             'git_repo': None,
                                             'glusterfs': None,
                                             'host_path': None,
                                             'iscsi': None,
                                             'name': 'astairelogs',
                                             'nfs': None,
                                             'persistent_volume_claim': None,
                                             'photon_persistent_disk': None,
                                             'portworx_volume': None,
                                             'projected': None,
                                             'quobyte': None,
                                             'rbd': None,
                                             'scale_io': None,
                                             'secret': None,
                                             'storageos': None,
                                             'vsphere_volume': None}]}}},
 'status': {'available_replicas': None,
            'collision_count': None,
            'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 39, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 3, 59, 39, tzinfo=tzlocal()),
                            'message': 'Deployment does not have minimum '
                                       'availability.',
                            'reason': 'MinimumReplicasUnavailable',
                            'status': 'False',
                            'type': 'Available'},
                           {'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 39, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 3, 59, 39, tzinfo=tzlocal()),
                            'message': 'ReplicaSet "astaire-5ddcdd6b7f" is '
                                       'progressing.',
                            'reason': 'ReplicaSetUpdated',
                            'status': 'True',
                            'type': 'Progressing'}],
            'observed_generation': 1,
            'ready_replicas': None,
            'replicas': 1,
            'unavailable_replicas': 1,
            'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'astaire', 'namespace': 'ims-h4q84', 'selfLink': '/apis/apps/v1/namespaces/ims-h4q84/deployments/astaire', 'uid': '70bf9edb-e201-4cbe-8cba-1b1ae3f80a33', 'resourceVersion': '981053', 'generation': 1, 'creationTimestamp': '2020-08-19T03:59:39Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'astaire'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'astaire'}}, 'spec': {'volumes': [{'name': 'astairelogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'astaire', 'image': 'ollivier/clearwater-astaire:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 11211, 'protocol': 'TCP'}, {'containerPort': 11311, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'astairelogs', 'mountPath': '/var/log/astaire'}], 'livenessProbe': {'tcpSocket': {'port': 11311}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 9}, 'readinessProbe': {'tcpSocket': {'port': 11311}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'lifecycle': {'preStop': {'exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}}}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/astaire/astaire_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'astairelogs', 'mountPath': '/var/log/astaire'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 120, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-08-19T03:59:39Z', 'lastTransitionTime': '2020-08-19T03:59:39Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-19T03:59:39Z', 'lastTransitionTime': '2020-08-19T03:59:39Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "astaire-5ddcdd6b7f" is progressing.'}]}}}
2020-08-19 03:59:47,104 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1',
 'kind': 'Deployment',
 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'},
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': 1,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'bono',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981066',
              'self_link': '/apis/apps/v1/namespaces/ims-h4q84/deployments/bono',
              'uid': '08f3c434-4caf-4735-8f74-93f1561b3c04'},
 'spec': {'min_ready_seconds': None,
          'paused': None,
          'progress_deadline_seconds': 600,
          'replicas': 1,
          'revision_history_limit': 10,
          'selector': {'match_expressions': None,
                       'match_labels': {'service': 'bono'}},
          'strategy': {'rolling_update': {'max_surge': '25%',
                                          'max_unavailable': '25%'},
                       'type': 'RollingUpdate'},
          'template': {'metadata': {'annotations': None,
                                    'cluster_name': None,
                                    'creation_timestamp': None,
                                    'deletion_grace_period_seconds': None,
                                    'deletion_timestamp': None,
                                    'finalizers': None,
                                    'generate_name': None,
                                    'generation': None,
                                    'initializers': None,
                                    'labels': {'service': 'bono',
                                               'snmp': 'enabled'},
                                    'managed_fields': None,
                                    'name': None,
                                    'namespace': None,
                                    'owner_references': None,
                                    'resource_version': None,
                                    'self_link': None,
                                    'uid': None},
                       'spec': {'active_deadline_seconds': None,
                                'affinity': None,
                                'automount_service_account_token': None,
                                'containers': [{'args': None,
                                                'command': None,
                                                'env': [{'name': 'MY_POD_IP',
                                                         'value': None,
                                                         'value_from': {'config_map_key_ref': None,
                                                                        'field_ref': {'api_version': 'v1',
                                                                                      'field_path': 'status.podIP'},
                                                                        'resource_field_ref': None,
                                                                        'secret_key_ref': None}}],
                                                'env_from': [{'config_map_ref': {'name': 'env-vars',
                                                                                 'optional': None},
                                                              'prefix': None,
                                                              'secret_ref': None}],
                                                'image': 'ollivier/clearwater-bono:latest',
                                                'image_pull_policy': 'Always',
                                                'lifecycle': None,
                                                'liveness_probe': {'_exec': {'command': ['/bin/bash',
                                                                                         '/usr/share/kubernetes/liveness.sh',
                                                                                         '3478 '
                                                                                         '5060 '
                                                                                         '5062']},
                                                                   'failure_threshold': 3,
                                                                   'http_get': None,
                                                                   'initial_delay_seconds': 30,
                                                                   'period_seconds': 10,
                                                                   'success_threshold': 1,
                                                                   'tcp_socket': None,
                                                                   'timeout_seconds': 1},
                                                'name': 'bono',
                                                'ports': [{'container_port': 22,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'},
                                                          {'container_port': 3478,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'},
                                                          {'container_port': 5060,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'},
                                                          {'container_port': 5062,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'},
                                                          {'container_port': 5060,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'UDP'},
                                                          {'container_port': 5062,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'UDP'}],
                                                'readiness_probe': {'_exec': {'command': ['/bin/bash',
                                                                                          '/usr/share/kubernetes/liveness.sh',
                                                                                          '3478 '
                                                                                          '5060 '
                                                                                          '5062']},
                                                                    'failure_threshold': 3,
                                                                    'http_get': None,
                                                                    'initial_delay_seconds': None,
                                                                    'period_seconds': 10,
                                                                    'success_threshold': 1,
                                                                    'tcp_socket': None,
                                                                    'timeout_seconds': 1},
                                                'resources': {'limits': None,
                                                              'requests': None},
                                                'security_context': None,
                                                'stdin': None,
                                                'stdin_once': None,
                                                'termination_message_path': '/dev/termination-log',
                                                'termination_message_policy': 'File',
                                                'tty': None,
                                                'volume_devices': None,
                                                'volume_mounts': [{'mount_path': '/var/log/bono',
                                                                   'mount_propagation': None,
                                                                   'name': 'bonologs',
                                                                   'read_only': None,
                                                                   'sub_path': None,
                                                                   'sub_path_expr': None}],
                                                'working_dir': None},
                                               {'args': None,
                                                'command': ['tail',
                                                            '-F',
                                                            '/var/log/bono/bono_current.txt'],
                                                'env': None,
                                                'env_from': None,
                                                'image': 'busybox',
                                                'image_pull_policy': 'Always',
                                                'lifecycle': None,
                                                'liveness_probe': None,
                                                'name': 'tailer',
                                                'ports': None,
                                                'readiness_probe': None,
                                                'resources': {'limits': None,
                                                              'requests': None},
                                                'security_context': None,
                                                'stdin': None,
                                                'stdin_once': None,
                                                'termination_message_path': '/dev/termination-log',
                                                'termination_message_policy': 'File',
                                                'tty': None,
                                                'volume_devices': None,
                                                'volume_mounts': [{'mount_path': '/var/log/bono',
                                                                   'mount_propagation': None,
                                                                   'name': 'bonologs',
                                                                   'read_only': None,
                                                                   'sub_path': None,
                                                                   'sub_path_expr': None}],
                                                'working_dir': None}],
                                'dns_config': None,
                                'dns_policy': 'ClusterFirst',
                                'enable_service_links': None,
                                'host_aliases': None,
                                'host_ipc': None,
                                'host_network': None,
                                'host_pid': None,
                                'hostname': None,
                                'image_pull_secrets': [{'name': None}],
                                'init_containers': [{'args': None,
                                                     'command': ['sh',
                                                                 '-c',
                                                                 'until '
                                                                 'nslookup '
                                                                 'sprout; do '
                                                                 'echo waiting '
                                                                 'for sprout '
                                                                 'to start '
                                                                 '...; sleep '
                                                                 '2; done'],
                                                     'env': None,
                                                     'env_from': None,
                                                     'image': 'busybox:1.28',
                                                     'image_pull_policy': 'IfNotPresent',
                                                     'lifecycle': None,
                                                     'liveness_probe': None,
                                                     'name': 'wait-on-sprout',
                                                     'ports': None,
                                                     'readiness_probe': None,
                                                     'resources': {'limits': None,
                                                                   'requests': None},
                                                     'security_context': None,
                                                     'stdin': None,
                                                     'stdin_once': None,
                                                     'termination_message_path': '/dev/termination-log',
                                                     'termination_message_policy': 'File',
                                                     'tty': None,
                                                     'volume_devices': None,
                                                     'volume_mounts': None,
                                                     'working_dir': None}],
                                'node_name': None,
                                'node_selector': None,
                                'priority': None,
                                'priority_class_name': None,
                                'readiness_gates': None,
                                'restart_policy': 'Always',
                                'runtime_class_name': None,
                                'scheduler_name': 'default-scheduler',
                                'security_context': {'fs_group': None,
                                                     'run_as_group': None,
                                                     'run_as_non_root': None,
                                                     'run_as_user': None,
                                                     'se_linux_options': None,
                                                     'supplemental_groups': None,
                                                     'sysctls': None},
                                'service_account': None,
                                'service_account_name': None,
                                'share_process_namespace': None,
                                'subdomain': None,
                                'termination_grace_period_seconds': 30,
                                'tolerations': None,
                                'volumes': [{'aws_elastic_block_store': None,
                                             'azure_disk': None,
                                             'azure_file': None,
                                             'cephfs': None,
                                             'cinder': None,
                                             'config_map': None,
                                             'csi': None,
                                             'downward_api': None,
                                             'empty_dir': {'medium': None,
                                                           'size_limit': None},
                                             'fc': None,
                                             'flex_volume': None,
                                             'flocker': None,
                                             'gce_persistent_disk': None,
                                             'git_repo': None,
                                             'glusterfs': None,
                                             'host_path': None,
                                             'iscsi': None,
                                             'name': 'bonologs',
                                             'nfs': None,
                                             'persistent_volume_claim': None,
                                             'photon_persistent_disk': None,
                                             'portworx_volume': None,
                                             'projected': None,
                                             'quobyte': None,
                                             'rbd': None,
                                             'scale_io': None,
                                             'secret': None,
                                             'storageos': None,
                                             'vsphere_volume': None}]}}},
 'status': {'available_replicas': None,
            'collision_count': None,
            'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
                            'message': 'Deployment does not have minimum '
                                       'availability.',
                            'reason': 'MinimumReplicasUnavailable',
                            'status': 'False',
                            'type': 'Available'},
                           {'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
                            'message': 'ReplicaSet "bono-5cdb7bfcdd" is '
                                       'progressing.',
                            'reason': 'ReplicaSetUpdated',
                            'status': 'True',
                            'type': 'Progressing'}],
            'observed_generation': 1,
            'ready_replicas': None,
            'replicas': 1,
            'unavailable_replicas': 1,
            'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'bono', 'namespace': 'ims-h4q84', 'selfLink': '/apis/apps/v1/namespaces/ims-h4q84/deployments/bono', 'uid': '08f3c434-4caf-4735-8f74-93f1561b3c04', 'resourceVersion': '981066', 'generation': 1, 'creationTimestamp': '2020-08-19T03:59:40Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'bono'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'bono', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'bonologs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'bono', 'image': 'ollivier/clearwater-bono:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 3478, 'protocol': 'TCP'}, {'containerPort': 5060, 'protocol': 'TCP'}, {'containerPort': 5062, 'protocol': 'TCP'}, {'containerPort': 5060, 'protocol': 'UDP'}, {'containerPort': 5062, 'protocol': 'UDP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'bonologs', 'mountPath': '/var/log/bono'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 5062']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 5062']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/bono/bono_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'bonologs', 'mountPath': '/var/log/bono'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-08-19T03:59:40Z', 'lastTransitionTime': '2020-08-19T03:59:40Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-19T03:59:40Z', 'lastTransitionTime': '2020-08-19T03:59:40Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "bono-5cdb7bfcdd" is progressing.'}]}}}
2020-08-19 03:59:47,399 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1',
 'kind': 'Deployment',
 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'},
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': 1,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'ellis',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981106',
              'self_link': '/apis/apps/v1/namespaces/ims-h4q84/deployments/ellis',
              'uid': '1489ad06-8c54-4f56-a6b8-5cfd2daffb39'},
 'spec': {'min_ready_seconds': None,
          'paused': None,
          'progress_deadline_seconds': 600,
          'replicas': 1,
          'revision_history_limit': 10,
          'selector': {'match_expressions': None,
                       'match_labels': {'service': 'ellis'}},
          'strategy': {'rolling_update': {'max_surge': '25%',
                                          'max_unavailable': '25%'},
                       'type': 'RollingUpdate'},
          'template': {'metadata': {'annotations': None,
                                    'cluster_name': None,
                                    'creation_timestamp': None,
                                    'deletion_grace_period_seconds': None,
                                    'deletion_timestamp': None,
                                    'finalizers': None,
                                    'generate_name': None,
                                    'generation': None,
                                    'initializers': None,
                                    'labels': {'service': 'ellis'},
                                    'managed_fields': None,
                                    'name': None,
                                    'namespace': None,
                                    'owner_references': None,
                                    'resource_version': None,
                                    'self_link': None,
                                    'uid': None},
                       'spec': {'active_deadline_seconds': None,
                                'affinity': None,
                                'automount_service_account_token': None,
                                'containers': [{'args': None,
                                                'command': None,
                                                'env': [{'name': 'MY_POD_IP',
                                                         'value': None,
                                                         'value_from': {'config_map_key_ref': None,
                                                                        'field_ref': {'api_version': 'v1',
                                                                                      'field_path': 'status.podIP'},
                                                                        'resource_field_ref': None,
                                                                        'secret_key_ref': None}}],
                                                'env_from': [{'config_map_ref': {'name': 'env-vars',
                                                                                 'optional': None},
                                                              'prefix': None,
                                                              'secret_ref': None}],
                                                'image': 'ollivier/clearwater-ellis:latest',
                                                'image_pull_policy': 'Always',
                                                'lifecycle': None,
                                                'liveness_probe': {'_exec': None,
                                                                   'failure_threshold': 3,
                                                                   'http_get': None,
                                                                   'initial_delay_seconds': 30,
                                                                   'period_seconds': 10,
                                                                   'success_threshold': 1,
                                                                   'tcp_socket': {'host': None,
                                                                                  'port': 80},
                                                                   'timeout_seconds': 1},
                                                'name': 'ellis',
                                                'ports': [{'container_port': 22,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'},
                                                          {'container_port': 80,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'}],
                                                'readiness_probe': {'_exec': None,
                                                                    'failure_threshold': 3,
                                                                    'http_get': None,
                                                                    'initial_delay_seconds': None,
                                                                    'period_seconds': 10,
                                                                    'success_threshold': 1,
                                                                    'tcp_socket': {'host': None,
                                                                                   'port': 80},
                                                                    'timeout_seconds': 1},
                                                'resources': {'limits': None,
                                                              'requests': None},
                                                'security_context': None,
                                                'stdin': None,
                                                'stdin_once': None,
                                                'termination_message_path': '/dev/termination-log',
                                                'termination_message_policy': 'File',
                                                'tty': None,
                                                'volume_devices': None,
                                                'volume_mounts': None,
                                                'working_dir': None}],
                                'dns_config': None,
                                'dns_policy': 'ClusterFirst',
                                'enable_service_links': None,
                                'host_aliases': None,
                                'host_ipc': None,
                                'host_network': None,
                                'host_pid': None,
                                'hostname': None,
                                'image_pull_secrets': [{'name': None}],
                                'init_containers': [{'args': None,
                                                     'command': ['sh',
                                                                 '-c',
                                                                 'until '
                                                                 'nslookup '
                                                                 'homestead-prov; '
                                                                 'do echo '
                                                                 'waiting for '
                                                                 'homestead-prov '
                                                                 'to start '
                                                                 '...; sleep '
                                                                 '2; done'],
                                                     'env': None,
                                                     'env_from': None,
                                                     'image': 'busybox:1.28',
                                                     'image_pull_policy': 'IfNotPresent',
                                                     'lifecycle': None,
                                                     'liveness_probe': None,
                                                     'name': 'wait-on-homestead-prov',
                                                     'ports': None,
                                                     'readiness_probe': None,
                                                     'resources': {'limits': None,
                                                                   'requests': None},
                                                     'security_context': None,
                                                     'stdin': None,
                                                     'stdin_once': None,
                                                     'termination_message_path': '/dev/termination-log',
                                                     'termination_message_policy': 'File',
                                                     'tty': None,
                                                     'volume_devices': None,
                                                     'volume_mounts': None,
                                                     'working_dir': None},
                                                    {'args': None,
                                                     'command': ['sh',
                                                                 '-c',
                                                                 'until '
                                                                 'nslookup '
                                                                 'sprout; do '
                                                                 'echo waiting '
                                                                 'for sprout '
                                                                 'to start '
                                                                 '...; sleep '
                                                                 '2; done'],
                                                     'env': None,
                                                     'env_from': None,
                                                     'image': 'busybox:1.28',
                                                     'image_pull_policy': 'IfNotPresent',
                                                     'lifecycle': None,
                                                     'liveness_probe': None,
                                                     'name': 'wait-on-sprout',
                                                     'ports': None,
                                                     'readiness_probe': None,
                                                     'resources': {'limits': None,
                                                                   'requests': None},
                                                     'security_context': None,
                                                     'stdin': None,
                                                     'stdin_once': None,
                                                     'termination_message_path': '/dev/termination-log',
                                                     'termination_message_policy': 'File',
                                                     'tty': None,
                                                     'volume_devices': None,
                                                     'volume_mounts': None,
                                                     'working_dir': None}],
                                'node_name': None,
                                'node_selector': None,
                                'priority': None,
                                'priority_class_name': None,
                                'readiness_gates': None,
                                'restart_policy': 'Always',
                                'runtime_class_name': None,
                                'scheduler_name': 'default-scheduler',
                                'security_context': {'fs_group': None,
                                                     'run_as_group': None,
                                                     'run_as_non_root': None,
                                                     'run_as_user': None,
                                                     'se_linux_options': None,
                                                     'supplemental_groups': None,
                                                     'sysctls': None},
                                'service_account': None,
                                'service_account_name': None,
                                'share_process_namespace': None,
                                'subdomain': None,
                                'termination_grace_period_seconds': 30,
                                'tolerations': None,
                                'volumes': None}}},
 'status': {'available_replicas': None,
            'collision_count': None,
            'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
                            'message': 'Deployment does not have minimum '
                                       'availability.',
                            'reason': 'MinimumReplicasUnavailable',
                            'status': 'False',
                            'type': 'Available'},
                           {'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
                            'message': 'ReplicaSet "ellis-57b84b6dd7" is '
                                       'progressing.',
                            'reason': 'ReplicaSetUpdated',
                            'status': 'True',
                            'type': 'Progressing'}],
            'observed_generation': 1,
            'ready_replicas': None,
            'replicas': 1,
            'unavailable_replicas': 1,
            'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'ellis', 'namespace': 'ims-h4q84', 'selfLink': '/apis/apps/v1/namespaces/ims-h4q84/deployments/ellis', 'uid': '1489ad06-8c54-4f56-a6b8-5cfd2daffb39', 'resourceVersion': '981106', 'generation': 1, 'creationTimestamp': '2020-08-19T03:59:40Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'ellis'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'ellis'}}, 'spec': {'initContainers': [{'name': 'wait-on-homestead-prov', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead-prov; do echo waiting for homestead-prov to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'ellis', 'image': 'ollivier/clearwater-ellis:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 80, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'tcpSocket': {'port': 80}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 80}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-08-19T03:59:40Z', 'lastTransitionTime': '2020-08-19T03:59:40Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-19T03:59:40Z', 'lastTransitionTime': '2020-08-19T03:59:40Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "ellis-57b84b6dd7" is progressing.'}]}}}
2020-08-19 03:59:47,632 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1',
 'kind': 'Deployment',
 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'},
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': 1,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'homestead',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981146',
              'self_link': '/apis/apps/v1/namespaces/ims-h4q84/deployments/homestead',
              'uid': '165d9c1c-79b2-4d12-9ff0-a0801d1c1839'},
 'spec': {'min_ready_seconds': None,
          'paused': None,
          'progress_deadline_seconds': 600,
          'replicas': 1,
          'revision_history_limit': 10,
          'selector': {'match_expressions': None,
                       'match_labels': {'service': 'homestead'}},
          'strategy': {'rolling_update': {'max_surge': '25%',
                                          'max_unavailable': '25%'},
                       'type': 'RollingUpdate'},
          'template': {'metadata': {'annotations': None,
                                    'cluster_name': None,
                                    'creation_timestamp': None,
                                    'deletion_grace_period_seconds': None,
                                    'deletion_timestamp': None,
                                    'finalizers': None,
                                    'generate_name': None,
                                    'generation': None,
                                    'initializers': None,
                                    'labels': {'service': 'homestead',
                                               'snmp': 'enabled'},
                                    'managed_fields': None,
                                    'name': None,
                                    'namespace': None,
                                    'owner_references': None,
                                    'resource_version': None,
                                    'self_link': None,
                                    'uid': None},
                       'spec': {'active_deadline_seconds': None,
                                'affinity': None,
                                'automount_service_account_token': None,
                                'containers': [{'args': None,
                                                'command': None,
                                                'env': [{'name': 'MY_POD_IP',
                                                         'value': None,
                                                         'value_from': {'config_map_key_ref': None,
                                                                        'field_ref': {'api_version': 'v1',
                                                                                      'field_path': 'status.podIP'},
                                                                        'resource_field_ref': None,
                                                                        'secret_key_ref': None}}],
                                                'env_from': [{'config_map_ref': {'name': 'env-vars',
                                                                                 'optional': None},
                                                              'prefix': None,
                                                              'secret_ref': None}],
                                                'image': 'ollivier/clearwater-homestead:latest',
                                                'image_pull_policy': 'Always',
                                                'lifecycle': None,
                                                'liveness_probe': {'_exec': {'command': ['/bin/bash',
                                                                                         '/usr/share/kubernetes/liveness.sh',
                                                                                         '8888']},
                                                                   'failure_threshold': 3,
                                                                   'http_get': None,
                                                                   'initial_delay_seconds': 60,
                                                                   'period_seconds': 10,
                                                                   'success_threshold': 1,
                                                                   'tcp_socket': None,
                                                                   'timeout_seconds': 1},
                                                'name': 'homestead',
                                                'ports': [{'container_port': 22,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'},
                                                          {'container_port': 8888,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'}],
                                                'readiness_probe': {'_exec': {'command': ['/bin/bash',
                                                                                          '/usr/share/kubernetes/liveness.sh',
                                                                                          '8888']},
                                                                    'failure_threshold': 3,
                                                                    'http_get': None,
                                                                    'initial_delay_seconds': None,
                                                                    'period_seconds': 10,
                                                                    'success_threshold': 1,
                                                                    'tcp_socket': None,
                                                                    'timeout_seconds': 1},
                                                'resources': {'limits': None,
                                                              'requests': None},
                                                'security_context': None,
                                                'stdin': None,
                                                'stdin_once': None,
                                                'termination_message_path': '/dev/termination-log',
                                                'termination_message_policy': 'File',
                                                'tty': None,
                                                'volume_devices': None,
                                                'volume_mounts': [{'mount_path': '/var/log/homestead',
                                                                   'mount_propagation': None,
                                                                   'name': 'homesteadlogs',
                                                                   'read_only': None,
                                                                   'sub_path': None,
                                                                   'sub_path_expr': None}],
                                                'working_dir': None},
                                               {'args': None,
                                                'command': ['tail',
                                                            '-F',
                                                            '/var/log/homestead/homestead_current.txt'],
                                                'env': None,
                                                'env_from': None,
                                                'image': 'busybox',
                                                'image_pull_policy': 'Always',
                                                'lifecycle': None,
                                                'liveness_probe': None,
                                                'name': 'tailer',
                                                'ports': None,
                                                'readiness_probe': None,
                                                'resources': {'limits': None,
                                                              'requests': None},
                                                'security_context': None,
                                                'stdin': None,
                                                'stdin_once': None,
                                                'termination_message_path': '/dev/termination-log',
                                                'termination_message_policy': 'File',
                                                'tty': None,
                                                'volume_devices': None,
                                                'volume_mounts': [{'mount_path': '/var/log/homestead',
                                                                   'mount_propagation': None,
                                                                   'name': 'homesteadlogs',
                                                                   'read_only': None,
                                                                   'sub_path': None,
                                                                   'sub_path_expr': None}],
                                                'working_dir': None}],
                                'dns_config': None,
                                'dns_policy': 'ClusterFirst',
                                'enable_service_links': None,
                                'host_aliases': None,
                                'host_ipc': None,
                                'host_network': None,
                                'host_pid': None,
                                'hostname': None,
                                'image_pull_secrets': [{'name': None}],
                                'init_containers': [{'args': None,
                                                     'command': ['sh',
                                                                 '-c',
                                                                 'until '
                                                                 'nslookup '
                                                                 'cassandra; '
                                                                 'do echo '
                                                                 'waiting for '
                                                                 'cassandra to '
                                                                 'start ...; '
                                                                 'sleep 2; '
                                                                 'done'],
                                                     'env': None,
                                                     'env_from': None,
                                                     'image': 'busybox:1.28',
                                                     'image_pull_policy': 'IfNotPresent',
                                                     'lifecycle': None,
                                                     'liveness_probe': None,
                                                     'name': 'wait-on-cassandra',
                                                     'ports': None,
                                                     'readiness_probe': None,
                                                     'resources': {'limits': None,
                                                                   'requests': None},
                                                     'security_context': None,
                                                     'stdin': None,
                                                     'stdin_once': None,
                                                     'termination_message_path': '/dev/termination-log',
                                                     'termination_message_policy': 'File',
                                                     'tty': None,
                                                     'volume_devices': None,
                                                     'volume_mounts': None,
                                                     'working_dir': None},
                                                    {'args': None,
                                                     'command': ['sh',
                                                                 '-c',
                                                                 'until '
                                                                 'nslookup '
                                                                 'astaire; do '
                                                                 'echo waiting '
                                                                 'for astaire '
                                                                 'to start '
                                                                 '...; sleep '
                                                                 '2; done'],
                                                     'env': None,
                                                     'env_from': None,
                                                     'image': 'busybox:1.28',
                                                     'image_pull_policy': 'IfNotPresent',
                                                     'lifecycle': None,
                                                     'liveness_probe': None,
                                                     'name': 'wait-on-astaire',
                                                     'ports': None,
                                                     'readiness_probe': None,
                                                     'resources': {'limits': None,
                                                                   'requests': None},
                                                     'security_context': None,
                                                     'stdin': None,
                                                     'stdin_once': None,
                                                     'termination_message_path': '/dev/termination-log',
                                                     'termination_message_policy': 'File',
                                                     'tty': None,
                                                     'volume_devices': None,
                                                     'volume_mounts': None,
                                                     'working_dir': None}],
                                'node_name': None,
                                'node_selector': None,
                                'priority': None,
                                'priority_class_name': None,
                                'readiness_gates': None,
                                'restart_policy': 'Always',
                                'runtime_class_name': None,
                                'scheduler_name': 'default-scheduler',
                                'security_context': {'fs_group': None,
                                                     'run_as_group': None,
                                                     'run_as_non_root': None,
                                                     'run_as_user': None,
                                                     'se_linux_options': None,
                                                     'supplemental_groups': None,
                                                     'sysctls': None},
                                'service_account': None,
                                'service_account_name': None,
                                'share_process_namespace': None,
                                'subdomain': None,
                                'termination_grace_period_seconds': 30,
                                'tolerations': None,
                                'volumes': [{'aws_elastic_block_store': None,
                                             'azure_disk': None,
                                             'azure_file': None,
                                             'cephfs': None,
                                             'cinder': None,
                                             'config_map': None,
                                             'csi': None,
                                             'downward_api': None,
                                             'empty_dir': {'medium': None,
                                                           'size_limit': None},
                                             'fc': None,
                                             'flex_volume': None,
                                             'flocker': None,
                                             'gce_persistent_disk': None,
                                             'git_repo': None,
                                             'glusterfs': None,
                                             'host_path': None,
                                             'iscsi': None,
                                             'name': 'homesteadlogs',
                                             'nfs': None,
                                             'persistent_volume_claim': None,
                                             'photon_persistent_disk': None,
                                             'portworx_volume': None,
                                             'projected': None,
                                             'quobyte': None,
                                             'rbd': None,
                                             'scale_io': None,
                                             'secret': None,
                                             'storageos': None,
                                             'vsphere_volume': None}]}}},
 'status': {'available_replicas': None,
            'collision_count': None,
            'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
                            'message': 'Deployment does not have minimum '
                                       'availability.',
                            'reason': 'MinimumReplicasUnavailable',
                            'status': 'False',
                            'type': 'Available'},
                           {'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
                            'message': 'ReplicaSet "homestead-57586d6cdc" is '
                                       'progressing.',
                            'reason': 'ReplicaSetUpdated',
                            'status': 'True',
                            'type': 'Progressing'}],
            'observed_generation': 1,
            'ready_replicas': None,
            'replicas': 1,
            'unavailable_replicas': 1,
            'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homestead', 'namespace': 'ims-h4q84', 'selfLink': '/apis/apps/v1/namespaces/ims-h4q84/deployments/homestead', 'uid': '165d9c1c-79b2-4d12-9ff0-a0801d1c1839', 'resourceVersion': '981146', 'generation': 1, 'creationTimestamp': '2020-08-19T03:59:41Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homestead'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homestead', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'homesteadlogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-astaire', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup astaire; do echo waiting for astaire to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead', 'image': 'ollivier/clearwater-homestead:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'homesteadlogs', 'mountPath': '/var/log/homestead'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/homestead/homestead_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'homesteadlogs', 'mountPath': '/var/log/homestead'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-08-19T03:59:41Z', 'lastTransitionTime': '2020-08-19T03:59:41Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-19T03:59:41Z', 'lastTransitionTime': '2020-08-19T03:59:41Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "homestead-57586d6cdc" is progressing.'}]}}}
2020-08-19 03:59:47,915 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1',
 'kind': 'Deployment',
 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'},
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': 1,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'ralf',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981173',
              'self_link': '/apis/apps/v1/namespaces/ims-h4q84/deployments/ralf',
              'uid': '23b67868-499b-47be-94c2-817ef8fb0c04'},
 'spec': {'min_ready_seconds': None,
          'paused': None,
          'progress_deadline_seconds': 600,
          'replicas': 1,
          'revision_history_limit': 10,
          'selector': {'match_expressions': None,
                       'match_labels': {'service': 'ralf'}},
          'strategy': {'rolling_update': {'max_surge': '25%',
                                          'max_unavailable': '25%'},
                       'type': 'RollingUpdate'},
          'template': {'metadata': {'annotations': None,
                                    'cluster_name': None,
                                    'creation_timestamp': None,
                                    'deletion_grace_period_seconds': None,
                                    'deletion_timestamp': None,
                                    'finalizers': None,
                                    'generate_name': None,
                                    'generation': None,
                                    'initializers': None,
                                    'labels': {'service': 'ralf',
                                               'snmp': 'enabled'},
                                    'managed_fields': None,
                                    'name': None,
                                    'namespace': None,
                                    'owner_references': None,
                                    'resource_version': None,
                                    'self_link': None,
                                    'uid': None},
                       'spec': {'active_deadline_seconds': None,
                                'affinity': None,
                                'automount_service_account_token': None,
                                'containers': [{'args': None,
                                                'command': None,
                                                'env': [{'name': 'MY_POD_IP',
                                                         'value': None,
                                                         'value_from': {'config_map_key_ref': None,
                                                                        'field_ref': {'api_version': 'v1',
                                                                                      'field_path': 'status.podIP'},
                                                                        'resource_field_ref': None,
                                                                        'secret_key_ref': None}}],
                                                'env_from': [{'config_map_ref': {'name': 'env-vars',
                                                                                 'optional': None},
                                                              'prefix': None,
                                                              'secret_ref': None}],
                                                'image': 'ollivier/clearwater-ralf:latest',
                                                'image_pull_policy': 'Always',
                                                'lifecycle': None,
                                                'liveness_probe': {'_exec': None,
                                                                   'failure_threshold': 3,
                                                                   'http_get': None,
                                                                   'initial_delay_seconds': 30,
                                                                   'period_seconds': 10,
                                                                   'success_threshold': 1,
                                                                   'tcp_socket': {'host': None,
                                                                                  'port': 10888},
                                                                   'timeout_seconds': 1},
                                                'name': 'ralf',
                                                'ports': [{'container_port': 22,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'},
                                                          {'container_port': 10888,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'}],
                                                'readiness_probe': {'_exec': None,
                                                                    'failure_threshold': 3,
                                                                    'http_get': None,
                                                                    'initial_delay_seconds': None,
                                                                    'period_seconds': 10,
                                                                    'success_threshold': 1,
                                                                    'tcp_socket': {'host': None,
                                                                                   'port': 10888},
                                                                    'timeout_seconds': 1},
                                                'resources': {'limits': None,
                                                              'requests': None},
                                                'security_context': None,
                                                'stdin': None,
                                                'stdin_once': None,
                                                'termination_message_path': '/dev/termination-log',
                                                'termination_message_policy': 'File',
                                                'tty': None,
                                                'volume_devices': None,
                                                'volume_mounts': [{'mount_path': '/var/log/ralf',
                                                                   'mount_propagation': None,
                                                                   'name': 'ralflogs',
                                                                   'read_only': None,
                                                                   'sub_path': None,
                                                                   'sub_path_expr': None}],
                                                'working_dir': None},
                                               {'args': None,
                                                'command': ['tail',
                                                            '-F',
                                                            '/var/log/ralf/ralf_current.txt'],
                                                'env': None,
                                                'env_from': None,
                                                'image': 'busybox',
                                                'image_pull_policy': 'Always',
                                                'lifecycle': None,
                                                'liveness_probe': None,
                                                'name': 'tailer',
                                                'ports': None,
                                                'readiness_probe': None,
                                                'resources': {'limits': None,
                                                              'requests': None},
                                                'security_context': None,
                                                'stdin': None,
                                                'stdin_once': None,
                                                'termination_message_path': '/dev/termination-log',
                                                'termination_message_policy': 'File',
                                                'tty': None,
                                                'volume_devices': None,
                                                'volume_mounts': [{'mount_path': '/var/log/ralf',
                                                                   'mount_propagation': None,
                                                                   'name': 'ralflogs',
                                                                   'read_only': None,
                                                                   'sub_path': None,
                                                                   'sub_path_expr': None}],
                                                'working_dir': None}],
                                'dns_config': None,
                                'dns_policy': 'ClusterFirst',
                                'enable_service_links': None,
                                'host_aliases': None,
                                'host_ipc': None,
                                'host_network': None,
                                'host_pid': None,
                                'hostname': None,
                                'image_pull_secrets': [{'name': None}],
                                'init_containers': [{'args': None,
                                                     'command': ['sh',
                                                                 '-c',
                                                                 'until '
                                                                 'nslookup '
                                                                 'cassandra; '
                                                                 'do echo '
                                                                 'waiting for '
                                                                 'cassandra to '
                                                                 'start ...; '
                                                                 'sleep 2; '
                                                                 'done'],
                                                     'env': None,
                                                     'env_from': None,
                                                     'image': 'busybox:1.28',
                                                     'image_pull_policy': 'IfNotPresent',
                                                     'lifecycle': None,
                                                     'liveness_probe': None,
                                                     'name': 'wait-on-cassandra',
                                                     'ports': None,
                                                     'readiness_probe': None,
                                                     'resources': {'limits': None,
                                                                   'requests': None},
                                                     'security_context': None,
                                                     'stdin': None,
                                                     'stdin_once': None,
                                                     'termination_message_path': '/dev/termination-log',
                                                     'termination_message_policy': 'File',
                                                     'tty': None,
                                                     'volume_devices': None,
                                                     'volume_mounts': None,
                                                     'working_dir': None}],
                                'node_name': None,
                                'node_selector': None,
                                'priority': None,
                                'priority_class_name': None,
                                'readiness_gates': None,
                                'restart_policy': 'Always',
                                'runtime_class_name': None,
                                'scheduler_name': 'default-scheduler',
                                'security_context': {'fs_group': None,
                                                     'run_as_group': None,
                                                     'run_as_non_root': None,
                                                     'run_as_user': None,
                                                     'se_linux_options': None,
                                                     'supplemental_groups': None,
                                                     'sysctls': None},
                                'service_account': None,
                                'service_account_name': None,
                                'share_process_namespace': None,
                                'subdomain': None,
                                'termination_grace_period_seconds': 30,
                                'tolerations': None,
                                'volumes': [{'aws_elastic_block_store': None,
                                             'azure_disk': None,
                                             'azure_file': None,
                                             'cephfs': None,
                                             'cinder': None,
                                             'config_map': None,
                                             'csi': None,
                                             'downward_api': None,
                                             'empty_dir': {'medium': None,
                                                           'size_limit': None},
                                             'fc': None,
                                             'flex_volume': None,
                                             'flocker': None,
                                             'gce_persistent_disk': None,
                                             'git_repo': None,
                                             'glusterfs': None,
                                             'host_path': None,
                                             'iscsi': None,
                                             'name': 'ralflogs',
                                             'nfs': None,
                                             'persistent_volume_claim': None,
                                             'photon_persistent_disk': None,
                                             'portworx_volume': None,
                                             'projected': None,
                                             'quobyte': None,
                                             'rbd': None,
                                             'scale_io': None,
                                             'secret': None,
                                             'storageos': None,
                                             'vsphere_volume': None}]}}},
 'status': {'available_replicas': None,
            'collision_count': None,
            'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
                            'message': 'Deployment does not have minimum '
                                       'availability.',
                            'reason': 'MinimumReplicasUnavailable',
                            'status': 'False',
                            'type': 'Available'},
                           {'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
                            'message': 'ReplicaSet "ralf-57c4654cb8" is '
                                       'progressing.',
                            'reason': 'ReplicaSetUpdated',
                            'status': 'True',
                            'type': 'Progressing'}],
            'observed_generation': 1,
            'ready_replicas': None,
            'replicas': 1,
            'unavailable_replicas': 1,
            'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'ralf', 'namespace': 'ims-h4q84', 'selfLink': '/apis/apps/v1/namespaces/ims-h4q84/deployments/ralf', 'uid': '23b67868-499b-47be-94c2-817ef8fb0c04', 'resourceVersion': '981173', 'generation': 1, 'creationTimestamp': '2020-08-19T03:59:41Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'ralf'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'ralf', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'ralflogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'ralf', 'image': 'ollivier/clearwater-ralf:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 10888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}], 'livenessProbe': {'tcpSocket': {'port': 10888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 10888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-08-19T03:59:41Z', 'lastTransitionTime': '2020-08-19T03:59:41Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-19T03:59:41Z', 'lastTransitionTime': '2020-08-19T03:59:41Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "ralf-57c4654cb8" is progressing.'}]}}}
2020-08-19 03:59:48,162 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1',
 'kind': 'Deployment',
 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'},
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 42, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': 1,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'sprout',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981191',
              'self_link': '/apis/apps/v1/namespaces/ims-h4q84/deployments/sprout',
              'uid': '3a87fa02-60fb-44d1-aade-be3745d8c918'},
 'spec': {'min_ready_seconds': None,
          'paused': None,
          'progress_deadline_seconds': 600,
          'replicas': 1,
          'revision_history_limit': 10,
          'selector': {'match_expressions': None,
                       'match_labels': {'service': 'sprout'}},
          'strategy': {'rolling_update': {'max_surge': '25%',
                                          'max_unavailable': '25%'},
                       'type': 'RollingUpdate'},
          'template': {'metadata': {'annotations': None,
                                    'cluster_name': None,
                                    'creation_timestamp': None,
                                    'deletion_grace_period_seconds': None,
                                    'deletion_timestamp': None,
                                    'finalizers': None,
                                    'generate_name': None,
                                    'generation': None,
                                    'initializers': None,
                                    'labels': {'service': 'sprout',
                                               'snmp': 'enabled'},
                                    'managed_fields': None,
                                    'name': None,
                                    'namespace': None,
                                    'owner_references': None,
                                    'resource_version': None,
                                    'self_link': None,
                                    'uid': None},
                       'spec': {'active_deadline_seconds': None,
                                'affinity': None,
                                'automount_service_account_token': None,
                                'containers': [{'args': None,
                                                'command': None,
                                                'env': [{'name': 'MY_POD_IP',
                                                         'value': None,
                                                         'value_from': {'config_map_key_ref': None,
                                                                        'field_ref': {'api_version': 'v1',
                                                                                      'field_path': 'status.podIP'},
                                                                        'resource_field_ref': None,
                                                                        'secret_key_ref': None}}],
                                                'env_from': [{'config_map_ref': {'name': 'env-vars',
                                                                                 'optional': None},
                                                              'prefix': None,
                                                              'secret_ref': None}],
                                                'image': 'ollivier/clearwater-sprout:latest',
                                                'image_pull_policy': 'Always',
                                                'lifecycle': None,
                                                'liveness_probe': {'_exec': {'command': ['/bin/bash',
                                                                                         '/usr/share/kubernetes/liveness.sh',
                                                                                         '5052 '
                                                                                         '5054']},
                                                                   'failure_threshold': 3,
                                                                   'http_get': None,
                                                                   'initial_delay_seconds': 30,
                                                                   'period_seconds': 3,
                                                                   'success_threshold': 1,
                                                                   'tcp_socket': None,
                                                                   'timeout_seconds': 1},
                                                'name': 'sprout',
                                                'ports': [{'container_port': 22,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'}],
                                                'readiness_probe': {'_exec': {'command': ['/bin/bash',
                                                                                          '/usr/share/kubernetes/liveness.sh',
                                                                                          '5052 '
                                                                                          '5054']},
                                                                    'failure_threshold': 3,
                                                                    'http_get': None,
                                                                    'initial_delay_seconds': None,
                                                                    'period_seconds': 10,
                                                                    'success_threshold': 1,
                                                                    'tcp_socket': None,
                                                                    'timeout_seconds': 1},
                                                'resources': {'limits': None,
                                                              'requests': None},
                                                'security_context': None,
                                                'stdin': None,
                                                'stdin_once': None,
                                                'termination_message_path': '/dev/termination-log',
                                                'termination_message_policy': 'File',
                                                'tty': None,
                                                'volume_devices': None,
                                                'volume_mounts': [{'mount_path': '/var/log/sprout',
                                                                   'mount_propagation': None,
                                                                   'name': 'sproutlogs',
                                                                   'read_only': None,
                                                                   'sub_path': None,
                                                                   'sub_path_expr': None}],
                                                'working_dir': None},
                                               {'args': None,
                                                'command': ['tail',
                                                            '-F',
                                                            '/var/log/sprout/sprout_current.txt'],
                                                'env': None,
                                                'env_from': None,
                                                'image': 'busybox',
                                                'image_pull_policy': 'Always',
                                                'lifecycle': None,
                                                'liveness_probe': None,
                                                'name': 'tailer',
                                                'ports': None,
                                                'readiness_probe': None,
                                                'resources': {'limits': None,
                                                              'requests': None},
                                                'security_context': None,
                                                'stdin': None,
                                                'stdin_once': None,
                                                'termination_message_path': '/dev/termination-log',
                                                'termination_message_policy': 'File',
                                                'tty': None,
                                                'volume_devices': None,
                                                'volume_mounts': [{'mount_path': '/var/log/sprout',
                                                                   'mount_propagation': None,
                                                                   'name': 'sproutlogs',
                                                                   'read_only': None,
                                                                   'sub_path': None,
                                                                   'sub_path_expr': None}],
                                                'working_dir': None}],
                                'dns_config': None,
                                'dns_policy': 'ClusterFirst',
                                'enable_service_links': None,
                                'host_aliases': None,
                                'host_ipc': None,
                                'host_network': None,
                                'host_pid': None,
                                'hostname': None,
                                'image_pull_secrets': [{'name': None}],
                                'init_containers': [{'args': None,
                                                     'command': ['sh',
                                                                 '-c',
                                                                 'until '
                                                                 'nslookup '
                                                                 'ralf; do '
                                                                 'echo waiting '
                                                                 'for ralf to '
                                                                 'start ...; '
                                                                 'sleep 2; '
                                                                 'done'],
                                                     'env': None,
                                                     'env_from': None,
                                                     'image': 'busybox:1.28',
                                                     'image_pull_policy': 'IfNotPresent',
                                                     'lifecycle': None,
                                                     'liveness_probe': None,
                                                     'name': 'wait-on-ralf',
                                                     'ports': None,
                                                     'readiness_probe': None,
                                                     'resources': {'limits': None,
                                                                   'requests': None},
                                                     'security_context': None,
                                                     'stdin': None,
                                                     'stdin_once': None,
                                                     'termination_message_path': '/dev/termination-log',
                                                     'termination_message_policy': 'File',
                                                     'tty': None,
                                                     'volume_devices': None,
                                                     'volume_mounts': None,
                                                     'working_dir': None},
                                                    {'args': None,
                                                     'command': ['sh',
                                                                 '-c',
                                                                 'until '
                                                                 'nslookup '
                                                                 'chronos; do '
                                                                 'echo waiting '
                                                                 'for chronos '
                                                                 'to start '
                                                                 '...; sleep '
                                                                 '2; done'],
                                                     'env': None,
                                                     'env_from': None,
                                                     'image': 'busybox:1.28',
                                                     'image_pull_policy': 'IfNotPresent',
                                                     'lifecycle': None,
                                                     'liveness_probe': None,
                                                     'name': 'wait-on-chronos',
                                                     'ports': None,
                                                     'readiness_probe': None,
                                                     'resources': {'limits': None,
                                                                   'requests': None},
                                                     'security_context': None,
                                                     'stdin': None,
                                                     'stdin_once': None,
                                                     'termination_message_path': '/dev/termination-log',
                                                     'termination_message_policy': 'File',
                                                     'tty': None,
                                                     'volume_devices': None,
                                                     'volume_mounts': None,
                                                     'working_dir': None},
                                                    {'args': None,
                                                     'command': ['sh',
                                                                 '-c',
                                                                 'until '
                                                                 'nslookup '
                                                                 'homestead; '
                                                                 'do echo '
                                                                 'waiting for '
                                                                 'homestead to '
                                                                 'start ...; '
                                                                 'sleep 2; '
                                                                 'done'],
                                                     'env': None,
                                                     'env_from': None,
                                                     'image': 'busybox:1.28',
                                                     'image_pull_policy': 'IfNotPresent',
                                                     'lifecycle': None,
                                                     'liveness_probe': None,
                                                     'name': 'wait-on-homestead',
                                                     'ports': None,
                                                     'readiness_probe': None,
                                                     'resources': {'limits': None,
                                                                   'requests': None},
                                                     'security_context': None,
                                                     'stdin': None,
                                                     'stdin_once': None,
                                                     'termination_message_path': '/dev/termination-log',
                                                     'termination_message_policy': 'File',
                                                     'tty': None,
                                                     'volume_devices': None,
                                                     'volume_mounts': None,
                                                     'working_dir': None}],
                                'node_name': None,
                                'node_selector': None,
                                'priority': None,
                                'priority_class_name': None,
                                'readiness_gates': None,
                                'restart_policy': 'Always',
                                'runtime_class_name': None,
                                'scheduler_name': 'default-scheduler',
                                'security_context': {'fs_group': None,
                                                     'run_as_group': None,
                                                     'run_as_non_root': None,
                                                     'run_as_user': None,
                                                     'se_linux_options': None,
                                                     'supplemental_groups': None,
                                                     'sysctls': None},
                                'service_account': None,
                                'service_account_name': None,
                                'share_process_namespace': None,
                                'subdomain': None,
                                'termination_grace_period_seconds': 30,
                                'tolerations': None,
                                'volumes': [{'aws_elastic_block_store': None,
                                             'azure_disk': None,
                                             'azure_file': None,
                                             'cephfs': None,
                                             'cinder': None,
                                             'config_map': None,
                                             'csi': None,
                                             'downward_api': None,
                                             'empty_dir': {'medium': None,
                                                           'size_limit': None},
                                             'fc': None,
                                             'flex_volume': None,
                                             'flocker': None,
                                             'gce_persistent_disk': None,
                                             'git_repo': None,
                                             'glusterfs': None,
                                             'host_path': None,
                                             'iscsi': None,
                                             'name': 'sproutlogs',
                                             'nfs': None,
                                             'persistent_volume_claim': None,
                                             'photon_persistent_disk': None,
                                             'portworx_volume': None,
                                             'projected': None,
                                             'quobyte': None,
                                             'rbd': None,
                                             'scale_io': None,
                                             'secret': None,
                                             'storageos': None,
                                             'vsphere_volume': None}]}}},
 'status': {'available_replicas': None,
            'collision_count': None,
            'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 42, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 3, 59, 42, tzinfo=tzlocal()),
                            'message': 'Deployment does not have minimum '
                                       'availability.',
                            'reason': 'MinimumReplicasUnavailable',
                            'status': 'False',
                            'type': 'Available'},
                           {'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 42, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 3, 59, 42, tzinfo=tzlocal()),
                            'message': 'ReplicaSet "sprout-686cc64cfb" is '
                                       'progressing.',
                            'reason': 'ReplicaSetUpdated',
                            'status': 'True',
                            'type': 'Progressing'}],
            'observed_generation': 1,
            'ready_replicas': None,
            'replicas': 1,
            'unavailable_replicas': 1,
            'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'sprout', 'namespace': 'ims-h4q84', 'selfLink': '/apis/apps/v1/namespaces/ims-h4q84/deployments/sprout', 'uid': '3a87fa02-60fb-44d1-aade-be3745d8c918', 'resourceVersion': '981191', 'generation': 1, 'creationTimestamp': '2020-08-19T03:59:42Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'sprout'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'sprout', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'sproutlogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-ralf', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup ralf; do echo waiting for ralf to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-chronos', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup chronos; do echo waiting for chronos to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-homestead', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'sprout', 'image': 'ollivier/clearwater-sprout:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 3, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-08-19T03:59:42Z', 'lastTransitionTime': '2020-08-19T03:59:42Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-19T03:59:42Z', 'lastTransitionTime': '2020-08-19T03:59:42Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "sprout-686cc64cfb" is progressing.'}]}}}
2020-08-19 04:00:01,339 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1',
 'kind': 'Deployment',
 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'},
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': 1,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'etcd',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981301',
              'self_link': '/apis/apps/v1/namespaces/ims-h4q84/deployments/etcd',
              'uid': 'ec404eeb-f1f4-4c19-abd5-a7605d350dd1'},
 'spec': {'min_ready_seconds': None,
          'paused': None,
          'progress_deadline_seconds': 600,
          'replicas': 1,
          'revision_history_limit': 10,
          'selector': {'match_expressions': None,
                       'match_labels': {'instance-type': 'etcd-pod'}},
          'strategy': {'rolling_update': {'max_surge': '25%',
                                          'max_unavailable': '25%'},
                       'type': 'RollingUpdate'},
          'template': {'metadata': {'annotations': None,
                                    'cluster_name': None,
                                    'creation_timestamp': None,
                                    'deletion_grace_period_seconds': None,
                                    'deletion_timestamp': None,
                                    'finalizers': None,
                                    'generate_name': None,
                                    'generation': None,
                                    'initializers': None,
                                    'labels': {'instance-type': 'etcd-pod'},
                                    'managed_fields': None,
                                    'name': None,
                                    'namespace': None,
                                    'owner_references': None,
                                    'resource_version': None,
                                    'self_link': None,
                                    'uid': None},
                       'spec': {'active_deadline_seconds': None,
                                'affinity': None,
                                'automount_service_account_token': None,
                                'containers': [{'args': ['--name',
                                                         '$(MY_POD_NAME)',
                                                         '--advertise-client-urls',
                                                         'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001',
                                                         '--listen-client-urls',
                                                         'http://0.0.0.0:2379,http://0.0.0.0:4001',
                                                         '--initial-advertise-peer-urls',
                                                         'http://$(MY_POD_IP):2380',
                                                         '--listen-peer-urls',
                                                         'http://0.0.0.0:2380',
                                                         '--initial-cluster',
                                                         '$(MY_POD_NAME)=http://$(MY_POD_IP):2380',
                                                         '--initial-cluster-state',
                                                         'new'],
                                                'command': None,
                                                'env': [{'name': 'MY_POD_IP',
                                                         'value': None,
                                                         'value_from': {'config_map_key_ref': None,
                                                                        'field_ref': {'api_version': 'v1',
                                                                                      'field_path': 'status.podIP'},
                                                                        'resource_field_ref': None,
                                                                        'secret_key_ref': None}},
                                                        {'name': 'MY_POD_NAME',
                                                         'value': None,
                                                         'value_from': {'config_map_key_ref': None,
                                                                        'field_ref': {'api_version': 'v1',
                                                                                      'field_path': 'metadata.name'},
                                                                        'resource_field_ref': None,
                                                                        'secret_key_ref': None}}],
                                                'env_from': None,
                                                'image': 'quay.io/coreos/etcd:v2.2.5',
                                                'image_pull_policy': 'IfNotPresent',
                                                'lifecycle': None,
                                                'liveness_probe': {'_exec': None,
                                                                   'failure_threshold': 3,
                                                                   'http_get': None,
                                                                   'initial_delay_seconds': 300,
                                                                   'period_seconds': 10,
                                                                   'success_threshold': 1,
                                                                   'tcp_socket': {'host': None,
                                                                                  'port': 4001},
                                                                   'timeout_seconds': 1},
                                                'name': 'etcd',
                                                'ports': [{'container_port': 2379,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'},
                                                          {'container_port': 2380,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'},
                                                          {'container_port': 4001,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'}],
                                                'readiness_probe': {'_exec': None,
                                                                    'failure_threshold': 3,
                                                                    'http_get': None,
                                                                    'initial_delay_seconds': None,
                                                                    'period_seconds': 10,
                                                                    'success_threshold': 1,
                                                                    'tcp_socket': {'host': None,
                                                                                   'port': 4001},
                                                                    'timeout_seconds': 1},
                                                'resources': {'limits': None,
                                                              'requests': None},
                                                'security_context': None,
                                                'stdin': None,
                                                'stdin_once': None,
                                                'termination_message_path': '/dev/termination-log',
                                                'termination_message_policy': 'File',
                                                'tty': None,
                                                'volume_devices': None,
                                                'volume_mounts': None,
                                                'working_dir': None}],
                                'dns_config': None,
                                'dns_policy': 'ClusterFirst',
                                'enable_service_links': None,
                                'host_aliases': None,
                                'host_ipc': None,
                                'host_network': None,
                                'host_pid': None,
                                'hostname': None,
                                'image_pull_secrets': [{'name': None}],
                                'init_containers': None,
                                'node_name': None,
                                'node_selector': None,
                                'priority': None,
                                'priority_class_name': None,
                                'readiness_gates': None,
                                'restart_policy': 'Always',
                                'runtime_class_name': None,
                                'scheduler_name': 'default-scheduler',
                                'security_context': {'fs_group': None,
                                                     'run_as_group': None,
                                                     'run_as_non_root': None,
                                                     'run_as_user': None,
                                                     'se_linux_options': None,
                                                     'supplemental_groups': None,
                                                     'sysctls': None},
                                'service_account': None,
                                'service_account_name': None,
                                'share_process_namespace': None,
                                'subdomain': None,
                                'termination_grace_period_seconds': 30,
                                'tolerations': None,
                                'volumes': None}}},
 'status': {'available_replicas': 1,
            'collision_count': None,
            'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 19, 4, 0, 1, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 4, 0, 1, tzinfo=tzlocal()),
                            'message': 'Deployment has minimum availability.',
                            'reason': 'MinimumReplicasAvailable',
                            'status': 'True',
                            'type': 'Available'},
                           {'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 4, 0, 1, tzinfo=tzlocal()),
                            'message': 'ReplicaSet "etcd-5cbf55c8c" has '
                                       'successfully progressed.',
                            'reason': 'NewReplicaSetAvailable',
                            'status': 'True',
                            'type': 'Progressing'}],
            'observed_generation': 1,
            'ready_replicas': 1,
            'replicas': 1,
            'unavailable_replicas': None,
            'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'etcd', 'namespace': 'ims-h4q84', 'selfLink': '/apis/apps/v1/namespaces/ims-h4q84/deployments/etcd', 'uid': 'ec404eeb-f1f4-4c19-abd5-a7605d350dd1', 'resourceVersion': '981301', 'generation': 1, 'creationTimestamp': '2020-08-19T03:59:40Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'instance-type': 'etcd-pod'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'instance-type': 'etcd-pod'}}, 'spec': {'containers': [{'name': 'etcd', 'image': 'quay.io/coreos/etcd:v2.2.5', 'args': ['--name', '$(MY_POD_NAME)', '--advertise-client-urls', 'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', '--listen-client-urls', 'http://0.0.0.0:2379,http://0.0.0.0:4001', '--initial-advertise-peer-urls', 'http://$(MY_POD_IP):2380', '--listen-peer-urls', 'http://0.0.0.0:2380', '--initial-cluster', '$(MY_POD_NAME)=http://$(MY_POD_IP):2380', '--initial-cluster-state', 'new'], 'ports': [{'containerPort': 2379, 'protocol': 'TCP'}, {'containerPort': 2380, 'protocol': 'TCP'}, {'containerPort': 4001, 'protocol': 'TCP'}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}, {'name': 'MY_POD_NAME', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'metadata.name'}}}], 'resources': {}, 'livenessProbe': {'tcpSocket': {'port': 4001}, 'initialDelaySeconds': 300, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 4001}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-08-19T04:00:01Z', 'lastTransitionTime': '2020-08-19T04:00:01Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-19T04:00:01Z', 'lastTransitionTime': '2020-08-19T03:59:41Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "etcd-5cbf55c8c" has successfully progressed.'}]}}}
2020-08-19 04:00:01,519 - functest_kubernetes.ims.ims - INFO - etcd started in 22.23 sec
2020-08-19 04:01:31,966 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1',
 'kind': 'Deployment',
 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'},
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': 1,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'cassandra',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981493',
              'self_link': '/apis/apps/v1/namespaces/ims-h4q84/deployments/cassandra',
              'uid': '2450d20d-764f-48c7-bd78-68a4bcdc93c2'},
 'spec': {'min_ready_seconds': None,
          'paused': None,
          'progress_deadline_seconds': 600,
          'replicas': 1,
          'revision_history_limit': 10,
          'selector': {'match_expressions': None,
                       'match_labels': {'service': 'cassandra'}},
          'strategy': {'rolling_update': {'max_surge': '25%',
                                          'max_unavailable': '25%'},
                       'type': 'RollingUpdate'},
          'template': {'metadata': {'annotations': None,
                                    'cluster_name': None,
                                    'creation_timestamp': None,
                                    'deletion_grace_period_seconds': None,
                                    'deletion_timestamp': None,
                                    'finalizers': None,
                                    'generate_name': None,
                                    'generation': None,
                                    'initializers': None,
                                    'labels': {'service': 'cassandra'},
                                    'managed_fields': None,
                                    'name': None,
                                    'namespace': None,
                                    'owner_references': None,
                                    'resource_version': None,
                                    'self_link': None,
                                    'uid': None},
                       'spec': {'active_deadline_seconds': None,
                                'affinity': None,
                                'automount_service_account_token': None,
                                'containers': [{'args': None,
                                                'command': None,
                                                'env': [{'name': 'MY_POD_IP',
                                                         'value': None,
                                                         'value_from': {'config_map_key_ref': None,
                                                                        'field_ref': {'api_version': 'v1',
                                                                                      'field_path': 'status.podIP'},
                                                                        'resource_field_ref': None,
                                                                        'secret_key_ref': None}}],
                                                'env_from': [{'config_map_ref': {'name': 'env-vars',
                                                                                 'optional': None},
                                                              'prefix': None,
                                                              'secret_ref': None}],
                                                'image': 'ollivier/clearwater-cassandra:latest',
                                                'image_pull_policy': 'Always',
                                                'lifecycle': None,
                                                'liveness_probe': {'_exec': {'command': ['/bin/bash',
                                                                                         '/usr/share/kubernetes/liveness.sh',
                                                                                         '7000 '
                                                                                         '9042 '
                                                                                         '9160']},
                                                                   'failure_threshold': 3,
                                                                   'http_get': None,
                                                                   'initial_delay_seconds': 600,
                                                                   'period_seconds': 10,
                                                                   'success_threshold': 1,
                                                                   'tcp_socket': None,
                                                                   'timeout_seconds': 1},
                                                'name': 'cassandra',
                                                'ports': [{'container_port': 22,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'},
                                                          {'container_port': 7001,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'},
                                                          {'container_port': 9042,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'},
                                                          {'container_port': 9160,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'}],
                                                'readiness_probe': {'_exec': {'command': ['/bin/bash',
                                                                                          '/usr/share/kubernetes/liveness.sh',
                                                                                          '7000 '
                                                                                          '9042 '
                                                                                          '9160']},
                                                                    'failure_threshold': 3,
                                                                    'http_get': None,
                                                                    'initial_delay_seconds': None,
                                                                    'period_seconds': 10,
                                                                    'success_threshold': 1,
                                                                    'tcp_socket': None,
                                                                    'timeout_seconds': 1},
                                                'resources': {'limits': None,
                                                              'requests': None},
                                                'security_context': None,
                                                'stdin': None,
                                                'stdin_once': None,
                                                'termination_message_path': '/dev/termination-log',
                                                'termination_message_policy': 'File',
                                                'tty': None,
                                                'volume_devices': None,
                                                'volume_mounts': None,
                                                'working_dir': None}],
                                'dns_config': None,
                                'dns_policy': 'ClusterFirst',
                                'enable_service_links': None,
                                'host_aliases': None,
                                'host_ipc': None,
                                'host_network': None,
                                'host_pid': None,
                                'hostname': None,
                                'image_pull_secrets': [{'name': None}],
                                'init_containers': [{'args': None,
                                                     'command': ['sh',
                                                                 '-c',
                                                                 'until '
                                                                 'nslookup '
                                                                 'etcd; do '
                                                                 'echo waiting '
                                                                 'for etcd to '
                                                                 'start ...; '
                                                                 'sleep 2; '
                                                                 'done'],
                                                     'env': None,
                                                     'env_from': None,
                                                     'image': 'busybox:1.28',
                                                     'image_pull_policy': 'IfNotPresent',
                                                     'lifecycle': None,
                                                     'liveness_probe': None,
                                                     'name': 'wait-on-etcd',
                                                     'ports': None,
                                                     'readiness_probe': None,
                                                     'resources': {'limits': None,
                                                                   'requests': None},
                                                     'security_context': None,
                                                     'stdin': None,
                                                     'stdin_once': None,
                                                     'termination_message_path': '/dev/termination-log',
                                                     'termination_message_policy': 'File',
                                                     'tty': None,
                                                     'volume_devices': None,
                                                     'volume_mounts': None,
                                                     'working_dir': None}],
                                'node_name': None,
                                'node_selector': None,
                                'priority': None,
                                'priority_class_name': None,
                                'readiness_gates': None,
                                'restart_policy': 'Always',
                                'runtime_class_name': None,
                                'scheduler_name': 'default-scheduler',
                                'security_context': {'fs_group': None,
                                                     'run_as_group': None,
                                                     'run_as_non_root': None,
                                                     'run_as_user': None,
                                                     'se_linux_options': None,
                                                     'supplemental_groups': None,
                                                     'sysctls': None},
                                'service_account': None,
                                'service_account_name': None,
                                'share_process_namespace': None,
                                'subdomain': None,
                                'termination_grace_period_seconds': 30,
                                'tolerations': None,
                                'volumes': None}}},
 'status': {'available_replicas': 1,
            'collision_count': None,
            'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 19, 4, 1, 31, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 4, 1, 31, tzinfo=tzlocal()),
                            'message': 'Deployment has minimum availability.',
                            'reason': 'MinimumReplicasAvailable',
                            'status': 'True',
                            'type': 'Available'},
                           {'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 4, 1, 31, tzinfo=tzlocal()),
                            'message': 'ReplicaSet "cassandra-76f5c4d86c" has '
                                       'successfully progressed.',
                            'reason': 'NewReplicaSetAvailable',
                            'status': 'True',
                            'type': 'Progressing'}],
            'observed_generation': 1,
            'ready_replicas': 1,
            'replicas': 1,
            'unavailable_replicas': None,
            'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'cassandra', 'namespace': 'ims-h4q84', 'selfLink': '/apis/apps/v1/namespaces/ims-h4q84/deployments/cassandra', 'uid': '2450d20d-764f-48c7-bd78-68a4bcdc93c2', 'resourceVersion': '981493', 'generation': 1, 'creationTimestamp': '2020-08-19T03:59:40Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'cassandra'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'cassandra'}}, 'spec': {'initContainers': [{'name': 'wait-on-etcd', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup etcd; do echo waiting for etcd to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'cassandra', 'image': 'ollivier/clearwater-cassandra:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7001, 'protocol': 'TCP'}, {'containerPort': 9042, 'protocol': 'TCP'}, {'containerPort': 9160, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 9160']}, 'initialDelaySeconds': 600, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 9160']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-08-19T04:01:31Z', 'lastTransitionTime': '2020-08-19T04:01:31Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-19T04:01:31Z', 'lastTransitionTime': '2020-08-19T03:59:40Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "cassandra-76f5c4d86c" has successfully progressed.'}]}}}
2020-08-19 04:01:32,161 - functest_kubernetes.ims.ims - INFO - cassandra started in 112.88 sec
2020-08-19 04:02:10,180 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1',
 'kind': 'Deployment',
 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'},
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': 1,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'ralf',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981615',
              'self_link': '/apis/apps/v1/namespaces/ims-h4q84/deployments/ralf',
              'uid': '23b67868-499b-47be-94c2-817ef8fb0c04'},
 'spec': {'min_ready_seconds': None,
          'paused': None,
          'progress_deadline_seconds': 600,
          'replicas': 1,
          'revision_history_limit': 10,
          'selector': {'match_expressions': None,
                       'match_labels': {'service': 'ralf'}},
          'strategy': {'rolling_update': {'max_surge': '25%',
                                          'max_unavailable': '25%'},
                       'type': 'RollingUpdate'},
          'template': {'metadata': {'annotations': None,
                                    'cluster_name': None,
                                    'creation_timestamp': None,
                                    'deletion_grace_period_seconds': None,
                                    'deletion_timestamp': None,
                                    'finalizers': None,
                                    'generate_name': None,
                                    'generation': None,
                                    'initializers': None,
                                    'labels': {'service': 'ralf',
                                               'snmp': 'enabled'},
                                    'managed_fields': None,
                                    'name': None,
                                    'namespace': None,
                                    'owner_references': None,
                                    'resource_version': None,
                                    'self_link': None,
                                    'uid': None},
                       'spec': {'active_deadline_seconds': None,
                                'affinity': None,
                                'automount_service_account_token': None,
                                'containers': [{'args': None,
                                                'command': None,
                                                'env': [{'name': 'MY_POD_IP',
                                                         'value': None,
                                                         'value_from': {'config_map_key_ref': None,
                                                                        'field_ref': {'api_version': 'v1',
                                                                                      'field_path': 'status.podIP'},
                                                                        'resource_field_ref': None,
                                                                        'secret_key_ref': None}}],
                                                'env_from': [{'config_map_ref': {'name': 'env-vars',
                                                                                 'optional': None},
                                                              'prefix': None,
                                                              'secret_ref': None}],
                                                'image': 'ollivier/clearwater-ralf:latest',
                                                'image_pull_policy': 'Always',
                                                'lifecycle': None,
                                                'liveness_probe': {'_exec': None,
                                                                   'failure_threshold': 3,
                                                                   'http_get': None,
                                                                   'initial_delay_seconds': 30,
                                                                   'period_seconds': 10,
                                                                   'success_threshold': 1,
                                                                   'tcp_socket': {'host': None,
                                                                                  'port': 10888},
                                                                   'timeout_seconds': 1},
                                                'name': 'ralf',
                                                'ports': [{'container_port': 22,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'},
                                                          {'container_port': 10888,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'}],
                                                'readiness_probe': {'_exec': None,
                                                                    'failure_threshold': 3,
                                                                    'http_get': None,
                                                                    'initial_delay_seconds': None,
                                                                    'period_seconds': 10,
                                                                    'success_threshold': 1,
                                                                    'tcp_socket': {'host': None,
                                                                                   'port': 10888},
                                                                    'timeout_seconds': 1},
                                                'resources': {'limits': None,
                                                              'requests': None},
                                                'security_context': None,
                                                'stdin': None,
                                                'stdin_once': None,
                                                'termination_message_path': '/dev/termination-log',
                                                'termination_message_policy': 'File',
                                                'tty': None,
                                                'volume_devices': None,
                                                'volume_mounts': [{'mount_path': '/var/log/ralf',
                                                                   'mount_propagation': None,
                                                                   'name': 'ralflogs',
                                                                   'read_only': None,
                                                                   'sub_path': None,
                                                                   'sub_path_expr': None}],
                                                'working_dir': None},
                                               {'args': None,
                                                'command': ['tail',
                                                            '-F',
                                                            '/var/log/ralf/ralf_current.txt'],
                                                'env': None,
                                                'env_from': None,
                                                'image': 'busybox',
                                                'image_pull_policy': 'Always',
                                                'lifecycle': None,
                                                'liveness_probe': None,
                                                'name': 'tailer',
                                                'ports': None,
                                                'readiness_probe': None,
                                                'resources': {'limits': None,
                                                              'requests': None},
                                                'security_context': None,
                                                'stdin': None,
                                                'stdin_once': None,
                                                'termination_message_path': '/dev/termination-log',
                                                'termination_message_policy': 'File',
                                                'tty': None,
                                                'volume_devices': None,
                                                'volume_mounts': [{'mount_path': '/var/log/ralf',
                                                                   'mount_propagation': None,
                                                                   'name': 'ralflogs',
                                                                   'read_only': None,
                                                                   'sub_path': None,
                                                                   'sub_path_expr': None}],
                                                'working_dir': None}],
                                'dns_config': None,
                                'dns_policy': 'ClusterFirst',
                                'enable_service_links': None,
                                'host_aliases': None,
                                'host_ipc': None,
                                'host_network': None,
                                'host_pid': None,
                                'hostname': None,
                                'image_pull_secrets': [{'name': None}],
                                'init_containers': [{'args': None,
                                                     'command': ['sh',
                                                                 '-c',
                                                                 'until '
                                                                 'nslookup '
                                                                 'cassandra; '
                                                                 'do echo '
                                                                 'waiting for '
                                                                 'cassandra to '
                                                                 'start ...; '
                                                                 'sleep 2; '
                                                                 'done'],
                                                     'env': None,
                                                     'env_from': None,
                                                     'image': 'busybox:1.28',
                                                     'image_pull_policy': 'IfNotPresent',
                                                     'lifecycle': None,
                                                     'liveness_probe': None,
                                                     'name': 'wait-on-cassandra',
                                                     'ports': None,
                                                     'readiness_probe': None,
                                                     'resources': {'limits': None,
                                                                   'requests': None},
                                                     'security_context': None,
                                                     'stdin': None,
                                                     'stdin_once': None,
                                                     'termination_message_path': '/dev/termination-log',
                                                     'termination_message_policy': 'File',
                                                     'tty': None,
                                                     'volume_devices': None,
                                                     'volume_mounts': None,
                                                     'working_dir': None}],
                                'node_name': None,
                                'node_selector': None,
                                'priority': None,
                                'priority_class_name': None,
                                'readiness_gates': None,
                                'restart_policy': 'Always',
                                'runtime_class_name': None,
                                'scheduler_name': 'default-scheduler',
                                'security_context': {'fs_group': None,
                                                     'run_as_group': None,
                                                     'run_as_non_root': None,
                                                     'run_as_user': None,
                                                     'se_linux_options': None,
                                                     'supplemental_groups': None,
                                                     'sysctls': None},
                                'service_account': None,
                                'service_account_name': None,
                                'share_process_namespace': None,
                                'subdomain': None,
                                'termination_grace_period_seconds': 30,
                                'tolerations': None,
                                'volumes': [{'aws_elastic_block_store': None,
                                             'azure_disk': None,
                                             'azure_file': None,
                                             'cephfs': None,
                                             'cinder': None,
                                             'config_map': None,
                                             'csi': None,
                                             'downward_api': None,
                                             'empty_dir': {'medium': None,
                                                           'size_limit': None},
                                             'fc': None,
                                             'flex_volume': None,
                                             'flocker': None,
                                             'gce_persistent_disk': None,
                                             'git_repo': None,
                                             'glusterfs': None,
                                             'host_path': None,
                                             'iscsi': None,
                                             'name': 'ralflogs',
                                             'nfs': None,
                                             'persistent_volume_claim': None,
                                             'photon_persistent_disk': None,
                                             'portworx_volume': None,
                                             'projected': None,
                                             'quobyte': None,
                                             'rbd': None,
                                             'scale_io': None,
                                             'secret': None,
                                             'storageos': None,
                                             'vsphere_volume': None}]}}},
 'status': {'available_replicas': 1,
            'collision_count': None,
            'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 19, 4, 2, 10, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 4, 2, 10, tzinfo=tzlocal()),
                            'message': 'Deployment has minimum availability.',
                            'reason': 'MinimumReplicasAvailable',
                            'status': 'True',
                            'type': 'Available'},
                           {'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 4, 2, 10, tzinfo=tzlocal()),
                            'message': 'ReplicaSet "ralf-57c4654cb8" has '
                                       'successfully progressed.',
                            'reason': 'NewReplicaSetAvailable',
                            'status': 'True',
                            'type': 'Progressing'}],
            'observed_generation': 1,
            'ready_replicas': 1,
            'replicas': 1,
            'unavailable_replicas': None,
            'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'ralf', 'namespace': 'ims-h4q84', 'selfLink': '/apis/apps/v1/namespaces/ims-h4q84/deployments/ralf', 'uid': '23b67868-499b-47be-94c2-817ef8fb0c04', 'resourceVersion': '981615', 'generation': 1, 'creationTimestamp': '2020-08-19T03:59:41Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'ralf'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'ralf', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'ralflogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'ralf', 'image': 'ollivier/clearwater-ralf:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 10888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}], 'livenessProbe': {'tcpSocket': {'port': 10888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 10888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-08-19T04:02:10Z', 'lastTransitionTime': '2020-08-19T04:02:10Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-19T04:02:10Z', 'lastTransitionTime': '2020-08-19T03:59:41Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "ralf-57c4654cb8" has successfully progressed.'}]}}}
2020-08-19 04:02:10,432 - functest_kubernetes.ims.ims - INFO - ralf started in 151.15 sec
2020-08-19 04:02:13,552 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1',
 'kind': 'Deployment',
 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'},
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': 1,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'homer',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981625',
              'self_link': '/apis/apps/v1/namespaces/ims-h4q84/deployments/homer',
              'uid': '75f3b2f0-529c-4fd0-8647-466ea1b655bc'},
 'spec': {'min_ready_seconds': None,
          'paused': None,
          'progress_deadline_seconds': 600,
          'replicas': 1,
          'revision_history_limit': 10,
          'selector': {'match_expressions': None,
                       'match_labels': {'service': 'homer'}},
          'strategy': {'rolling_update': {'max_surge': '25%',
                                          'max_unavailable': '25%'},
                       'type': 'RollingUpdate'},
          'template': {'metadata': {'annotations': None,
                                    'cluster_name': None,
                                    'creation_timestamp': None,
                                    'deletion_grace_period_seconds': None,
                                    'deletion_timestamp': None,
                                    'finalizers': None,
                                    'generate_name': None,
                                    'generation': None,
                                    'initializers': None,
                                    'labels': {'service': 'homer'},
                                    'managed_fields': None,
                                    'name': None,
                                    'namespace': None,
                                    'owner_references': None,
                                    'resource_version': None,
                                    'self_link': None,
                                    'uid': None},
                       'spec': {'active_deadline_seconds': None,
                                'affinity': None,
                                'automount_service_account_token': None,
                                'containers': [{'args': None,
                                                'command': None,
                                                'env': [{'name': 'MY_POD_IP',
                                                         'value': None,
                                                         'value_from': {'config_map_key_ref': None,
                                                                        'field_ref': {'api_version': 'v1',
                                                                                      'field_path': 'status.podIP'},
                                                                        'resource_field_ref': None,
                                                                        'secret_key_ref': None}}],
                                                'env_from': [{'config_map_ref': {'name': 'env-vars',
                                                                                 'optional': None},
                                                              'prefix': None,
                                                              'secret_ref': None}],
                                                'image': 'ollivier/clearwater-homer:latest',
                                                'image_pull_policy': 'Always',
                                                'lifecycle': None,
                                                'liveness_probe': {'_exec': None,
                                                                   'failure_threshold': 3,
                                                                   'http_get': None,
                                                                   'initial_delay_seconds': 30,
                                                                   'period_seconds': 10,
                                                                   'success_threshold': 1,
                                                                   'tcp_socket': {'host': None,
                                                                                  'port': 7888},
                                                                   'timeout_seconds': 1},
                                                'name': 'homer',
                                                'ports': [{'container_port': 22,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'},
                                                          {'container_port': 7888,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'}],
                                                'readiness_probe': {'_exec': None,
                                                                    'failure_threshold': 3,
                                                                    'http_get': None,
                                                                    'initial_delay_seconds': None,
                                                                    'period_seconds': 10,
                                                                    'success_threshold': 1,
                                                                    'tcp_socket': {'host': None,
                                                                                   'port': 7888},
                                                                    'timeout_seconds': 1},
                                                'resources': {'limits': None,
                                                              'requests': None},
                                                'security_context': None,
                                                'stdin': None,
                                                'stdin_once': None,
                                                'termination_message_path': '/dev/termination-log',
                                                'termination_message_policy': 'File',
                                                'tty': None,
                                                'volume_devices': None,
                                                'volume_mounts': None,
                                                'working_dir': None}],
                                'dns_config': None,
                                'dns_policy': 'ClusterFirst',
                                'enable_service_links': None,
                                'host_aliases': None,
                                'host_ipc': None,
                                'host_network': None,
                                'host_pid': None,
                                'hostname': None,
                                'image_pull_secrets': [{'name': None}],
                                'init_containers': [{'args': None,
                                                     'command': ['sh',
                                                                 '-c',
                                                                 'until '
                                                                 'nslookup '
                                                                 'cassandra; '
                                                                 'do echo '
                                                                 'waiting for '
                                                                 'cassandra to '
                                                                 'start ...; '
                                                                 'sleep 2; '
                                                                 'done'],
                                                     'env': None,
                                                     'env_from': None,
                                                     'image': 'busybox:1.28',
                                                     'image_pull_policy': 'IfNotPresent',
                                                     'lifecycle': None,
                                                     'liveness_probe': None,
                                                     'name': 'wait-on-cassandra',
                                                     'ports': None,
                                                     'readiness_probe': None,
                                                     'resources': {'limits': None,
                                                                   'requests': None},
                                                     'security_context': None,
                                                     'stdin': None,
                                                     'stdin_once': None,
                                                     'termination_message_path': '/dev/termination-log',
                                                     'termination_message_policy': 'File',
                                                     'tty': None,
                                                     'volume_devices': None,
                                                     'volume_mounts': None,
                                                     'working_dir': None}],
                                'node_name': None,
                                'node_selector': None,
                                'priority': None,
                                'priority_class_name': None,
                                'readiness_gates': None,
                                'restart_policy': 'Always',
                                'runtime_class_name': None,
                                'scheduler_name': 'default-scheduler',
                                'security_context': {'fs_group': None,
                                                     'run_as_group': None,
                                                     'run_as_non_root': None,
                                                     'run_as_user': None,
                                                     'se_linux_options': None,
                                                     'supplemental_groups': None,
                                                     'sysctls': None},
                                'service_account': None,
                                'service_account_name': None,
                                'share_process_namespace': None,
                                'subdomain': None,
                                'termination_grace_period_seconds': 30,
                                'tolerations': None,
                                'volumes': None}}},
 'status': {'available_replicas': 1,
            'collision_count': None,
            'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 19, 4, 2, 13, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 4, 2, 13, tzinfo=tzlocal()),
                            'message': 'Deployment has minimum availability.',
                            'reason': 'MinimumReplicasAvailable',
                            'status': 'True',
                            'type': 'Available'},
                           {'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 4, 2, 13, tzinfo=tzlocal()),
                            'message': 'ReplicaSet "homer-74dd4556d9" has '
                                       'successfully progressed.',
                            'reason': 'NewReplicaSetAvailable',
                            'status': 'True',
                            'type': 'Progressing'}],
            'observed_generation': 1,
            'ready_replicas': 1,
            'replicas': 1,
            'unavailable_replicas': None,
            'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homer', 'namespace': 'ims-h4q84', 'selfLink': '/apis/apps/v1/namespaces/ims-h4q84/deployments/homer', 'uid': '75f3b2f0-529c-4fd0-8647-466ea1b655bc', 'resourceVersion': '981625', 'generation': 1, 'creationTimestamp': '2020-08-19T03:59:41Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homer'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homer'}}, 'spec': {'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homer', 'image': 'ollivier/clearwater-homer:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'tcpSocket': {'port': 7888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 7888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-08-19T04:02:13Z', 'lastTransitionTime': '2020-08-19T04:02:13Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-19T04:02:13Z', 'lastTransitionTime': '2020-08-19T03:59:41Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "homer-74dd4556d9" has successfully progressed.'}]}}}
2020-08-19 04:02:13,734 - functest_kubernetes.ims.ims - INFO - homer started in 154.45 sec
2020-08-19 04:02:13,961 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1',
 'kind': 'Deployment',
 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'},
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': 1,
              'initializers': None,
              'labels': {'service': 'chronos'},
              'managed_fields': None,
              'name': 'chronos',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981630',
              'self_link': '/apis/apps/v1/namespaces/ims-h4q84/deployments/chronos',
              'uid': '0fc1b512-88a4-4734-8f1e-3c57dc26a77b'},
 'spec': {'min_ready_seconds': None,
          'paused': None,
          'progress_deadline_seconds': 600,
          'replicas': 1,
          'revision_history_limit': 10,
          'selector': {'match_expressions': None,
                       'match_labels': {'service': 'chronos'}},
          'strategy': {'rolling_update': {'max_surge': '25%',
                                          'max_unavailable': '25%'},
                       'type': 'RollingUpdate'},
          'template': {'metadata': {'annotations': None,
                                    'cluster_name': None,
                                    'creation_timestamp': None,
                                    'deletion_grace_period_seconds': None,
                                    'deletion_timestamp': None,
                                    'finalizers': None,
                                    'generate_name': None,
                                    'generation': None,
                                    'initializers': None,
                                    'labels': {'service': 'chronos'},
                                    'managed_fields': None,
                                    'name': None,
                                    'namespace': None,
                                    'owner_references': None,
                                    'resource_version': None,
                                    'self_link': None,
                                    'uid': None},
                       'spec': {'active_deadline_seconds': None,
                                'affinity': None,
                                'automount_service_account_token': None,
                                'containers': [{'args': None,
                                                'command': None,
                                                'env': [{'name': 'MY_POD_IP',
                                                         'value': None,
                                                         'value_from': {'config_map_key_ref': None,
                                                                        'field_ref': {'api_version': 'v1',
                                                                                      'field_path': 'status.podIP'},
                                                                        'resource_field_ref': None,
                                                                        'secret_key_ref': None}}],
                                                'env_from': [{'config_map_ref': {'name': 'env-vars',
                                                                                 'optional': None},
                                                              'prefix': None,
                                                              'secret_ref': None}],
                                                'image': 'ollivier/clearwater-chronos:latest',
                                                'image_pull_policy': 'Always',
                                                'lifecycle': {'post_start': None,
                                                              'pre_stop': {'_exec': {'command': ['/bin/bash',
                                                                                                 '-c',
                                                                                                 '/usr/bin/pre-stop']},
                                                                           'http_get': None,
                                                                           'tcp_socket': None}},
                                                'liveness_probe': {'_exec': None,
                                                                   'failure_threshold': 9,
                                                                   'http_get': None,
                                                                   'initial_delay_seconds': None,
                                                                   'period_seconds': 10,
                                                                   'success_threshold': 1,
                                                                   'tcp_socket': {'host': None,
                                                                                  'port': 7253},
                                                                   'timeout_seconds': 1},
                                                'name': 'chronos',
                                                'ports': [{'container_port': 22,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'},
                                                          {'container_port': 7253,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'}],
                                                'readiness_probe': {'_exec': None,
                                                                    'failure_threshold': 3,
                                                                    'http_get': None,
                                                                    'initial_delay_seconds': None,
                                                                    'period_seconds': 10,
                                                                    'success_threshold': 1,
                                                                    'tcp_socket': {'host': None,
                                                                                   'port': 7253},
                                                                    'timeout_seconds': 1},
                                                'resources': {'limits': None,
                                                              'requests': None},
                                                'security_context': None,
                                                'stdin': None,
                                                'stdin_once': None,
                                                'termination_message_path': '/dev/termination-log',
                                                'termination_message_policy': 'File',
                                                'tty': None,
                                                'volume_devices': None,
                                                'volume_mounts': [{'mount_path': '/var/log/chronos',
                                                                   'mount_propagation': None,
                                                                   'name': 'chronoslogs',
                                                                   'read_only': None,
                                                                   'sub_path': None,
                                                                   'sub_path_expr': None}],
                                                'working_dir': None},
                                               {'args': None,
                                                'command': ['tail',
                                                            '-F',
                                                            '/var/log/chronos/chronos_current.txt'],
                                                'env': None,
                                                'env_from': None,
                                                'image': 'busybox',
                                                'image_pull_policy': 'Always',
                                                'lifecycle': None,
                                                'liveness_probe': None,
                                                'name': 'tailer',
                                                'ports': None,
                                                'readiness_probe': None,
                                                'resources': {'limits': None,
                                                              'requests': None},
                                                'security_context': None,
                                                'stdin': None,
                                                'stdin_once': None,
                                                'termination_message_path': '/dev/termination-log',
                                                'termination_message_policy': 'File',
                                                'tty': None,
                                                'volume_devices': None,
                                                'volume_mounts': [{'mount_path': '/var/log/chronos',
                                                                   'mount_propagation': None,
                                                                   'name': 'chronoslogs',
                                                                   'read_only': None,
                                                                   'sub_path': None,
                                                                   'sub_path_expr': None}],
                                                'working_dir': None}],
                                'dns_config': None,
                                'dns_policy': 'ClusterFirst',
                                'enable_service_links': None,
                                'host_aliases': None,
                                'host_ipc': None,
                                'host_network': None,
                                'host_pid': None,
                                'hostname': None,
                                'image_pull_secrets': [{'name': None}],
                                'init_containers': [{'args': None,
                                                     'command': ['sh',
                                                                 '-c',
                                                                 'until '
                                                                 'nslookup '
                                                                 'cassandra; '
                                                                 'do echo '
                                                                 'waiting for '
                                                                 'cassandra to '
                                                                 'start ...; '
                                                                 'sleep 2; '
                                                                 'done'],
                                                     'env': None,
                                                     'env_from': None,
                                                     'image': 'busybox:1.28',
                                                     'image_pull_policy': 'IfNotPresent',
                                                     'lifecycle': None,
                                                     'liveness_probe': None,
                                                     'name': 'wait-on-cassandra',
                                                     'ports': None,
                                                     'readiness_probe': None,
                                                     'resources': {'limits': None,
                                                                   'requests': None},
                                                     'security_context': None,
                                                     'stdin': None,
                                                     'stdin_once': None,
                                                     'termination_message_path': '/dev/termination-log',
                                                     'termination_message_policy': 'File',
                                                     'tty': None,
                                                     'volume_devices': None,
                                                     'volume_mounts': None,
                                                     'working_dir': None}],
                                'node_name': None,
                                'node_selector': None,
                                'priority': None,
                                'priority_class_name': None,
                                'readiness_gates': None,
                                'restart_policy': 'Always',
                                'runtime_class_name': None,
                                'scheduler_name': 'default-scheduler',
                                'security_context': {'fs_group': None,
                                                     'run_as_group': None,
                                                     'run_as_non_root': None,
                                                     'run_as_user': None,
                                                     'se_linux_options': None,
                                                     'supplemental_groups': None,
                                                     'sysctls': None},
                                'service_account': None,
                                'service_account_name': None,
                                'share_process_namespace': None,
                                'subdomain': None,
                                'termination_grace_period_seconds': 120,
                                'tolerations': None,
                                'volumes': [{'aws_elastic_block_store': None,
                                             'azure_disk': None,
                                             'azure_file': None,
                                             'cephfs': None,
                                             'cinder': None,
                                             'config_map': None,
                                             'csi': None,
                                             'downward_api': None,
                                             'empty_dir': {'medium': None,
                                                           'size_limit': None},
                                             'fc': None,
                                             'flex_volume': None,
                                             'flocker': None,
                                             'gce_persistent_disk': None,
                                             'git_repo': None,
                                             'glusterfs': None,
                                             'host_path': None,
                                             'iscsi': None,
                                             'name': 'chronoslogs',
                                             'nfs': None,
                                             'persistent_volume_claim': None,
                                             'photon_persistent_disk': None,
                                             'portworx_volume': None,
                                             'projected': None,
                                             'quobyte': None,
                                             'rbd': None,
                                             'scale_io': None,
                                             'secret': None,
                                             'storageos': None,
                                             'vsphere_volume': None}]}}},
 'status': {'available_replicas': 1,
            'collision_count': None,
            'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 19, 4, 2, 13, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 4, 2, 13, tzinfo=tzlocal()),
                            'message': 'Deployment has minimum availability.',
                            'reason': 'MinimumReplicasAvailable',
                            'status': 'True',
                            'type': 'Available'},
                           {'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 4, 2, 13, tzinfo=tzlocal()),
                            'message': 'ReplicaSet "chronos-687b9884c5" has '
                                       'successfully progressed.',
                            'reason': 'NewReplicaSetAvailable',
                            'status': 'True',
                            'type': 'Progressing'}],
            'observed_generation': 1,
            'ready_replicas': 1,
            'replicas': 1,
            'unavailable_replicas': None,
            'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'chronos', 'namespace': 'ims-h4q84', 'selfLink': '/apis/apps/v1/namespaces/ims-h4q84/deployments/chronos', 'uid': '0fc1b512-88a4-4734-8f1e-3c57dc26a77b', 'resourceVersion': '981630', 'generation': 1, 'creationTimestamp': '2020-08-19T03:59:40Z', 'labels': {'service': 'chronos'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'chronos'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'chronos'}}, 'spec': {'volumes': [{'name': 'chronoslogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'chronos', 'image': 'ollivier/clearwater-chronos:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7253, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'chronoslogs', 'mountPath': '/var/log/chronos'}], 'livenessProbe': {'tcpSocket': {'port': 7253}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 9}, 'readinessProbe': {'tcpSocket': {'port': 7253}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'lifecycle': {'preStop': {'exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}}}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/chronos/chronos_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'chronoslogs', 'mountPath': '/var/log/chronos'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 120, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-08-19T04:02:13Z', 'lastTransitionTime': '2020-08-19T04:02:13Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-19T04:02:13Z', 'lastTransitionTime': '2020-08-19T03:59:40Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "chronos-687b9884c5" has successfully progressed.'}]}}}
2020-08-19 04:02:14,220 - functest_kubernetes.ims.ims - INFO - chronos started in 154.94 sec
2020-08-19 04:02:57,167 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1',
 'kind': 'Deployment',
 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'},
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 39, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': 1,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'astaire',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981733',
              'self_link': '/apis/apps/v1/namespaces/ims-h4q84/deployments/astaire',
              'uid': '70bf9edb-e201-4cbe-8cba-1b1ae3f80a33'},
 'spec': {'min_ready_seconds': None,
          'paused': None,
          'progress_deadline_seconds': 600,
          'replicas': 1,
          'revision_history_limit': 10,
          'selector': {'match_expressions': None,
                       'match_labels': {'service': 'astaire'}},
          'strategy': {'rolling_update': {'max_surge': '25%',
                                          'max_unavailable': '25%'},
                       'type': 'RollingUpdate'},
          'template': {'metadata': {'annotations': None,
                                    'cluster_name': None,
                                    'creation_timestamp': None,
                                    'deletion_grace_period_seconds': None,
                                    'deletion_timestamp': None,
                                    'finalizers': None,
                                    'generate_name': None,
                                    'generation': None,
                                    'initializers': None,
                                    'labels': {'service': 'astaire'},
                                    'managed_fields': None,
                                    'name': None,
                                    'namespace': None,
                                    'owner_references': None,
                                    'resource_version': None,
                                    'self_link': None,
                                    'uid': None},
                       'spec': {'active_deadline_seconds': None,
                                'affinity': None,
                                'automount_service_account_token': None,
                                'containers': [{'args': None,
                                                'command': None,
                                                'env': [{'name': 'MY_POD_IP',
                                                         'value': None,
                                                         'value_from': {'config_map_key_ref': None,
                                                                        'field_ref': {'api_version': 'v1',
                                                                                      'field_path': 'status.podIP'},
                                                                        'resource_field_ref': None,
                                                                        'secret_key_ref': None}}],
                                                'env_from': [{'config_map_ref': {'name': 'env-vars',
                                                                                 'optional': None},
                                                              'prefix': None,
                                                              'secret_ref': None}],
                                                'image': 'ollivier/clearwater-astaire:latest',
                                                'image_pull_policy': 'Always',
                                                'lifecycle': {'post_start': None,
                                                              'pre_stop': {'_exec': {'command': ['/bin/bash',
                                                                                                 '-c',
                                                                                                 '/usr/bin/pre-stop']},
                                                                           'http_get': None,
                                                                           'tcp_socket': None}},
                                                'liveness_probe': {'_exec': None,
                                                                   'failure_threshold': 9,
                                                                   'http_get': None,
                                                                   'initial_delay_seconds': None,
                                                                   'period_seconds': 10,
                                                                   'success_threshold': 1,
                                                                   'tcp_socket': {'host': None,
                                                                                  'port': 11311},
                                                                   'timeout_seconds': 1},
                                                'name': 'astaire',
                                                'ports': [{'container_port': 22,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'},
                                                          {'container_port': 11211,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'},
                                                          {'container_port': 11311,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'}],
                                                'readiness_probe': {'_exec': None,
                                                                    'failure_threshold': 3,
                                                                    'http_get': None,
                                                                    'initial_delay_seconds': None,
                                                                    'period_seconds': 10,
                                                                    'success_threshold': 1,
                                                                    'tcp_socket': {'host': None,
                                                                                   'port': 11311},
                                                                    'timeout_seconds': 1},
                                                'resources': {'limits': None,
                                                              'requests': None},
                                                'security_context': None,
                                                'stdin': None,
                                                'stdin_once': None,
                                                'termination_message_path': '/dev/termination-log',
                                                'termination_message_policy': 'File',
                                                'tty': None,
                                                'volume_devices': None,
                                                'volume_mounts': [{'mount_path': '/var/log/astaire',
                                                                   'mount_propagation': None,
                                                                   'name': 'astairelogs',
                                                                   'read_only': None,
                                                                   'sub_path': None,
                                                                   'sub_path_expr': None}],
                                                'working_dir': None},
                                               {'args': None,
                                                'command': ['tail',
                                                            '-F',
                                                            '/var/log/astaire/astaire_current.txt'],
                                                'env': None,
                                                'env_from': None,
                                                'image': 'busybox',
                                                'image_pull_policy': 'Always',
                                                'lifecycle': None,
                                                'liveness_probe': None,
                                                'name': 'tailer',
                                                'ports': None,
                                                'readiness_probe': None,
                                                'resources': {'limits': None,
                                                              'requests': None},
                                                'security_context': None,
                                                'stdin': None,
                                                'stdin_once': None,
                                                'termination_message_path': '/dev/termination-log',
                                                'termination_message_policy': 'File',
                                                'tty': None,
                                                'volume_devices': None,
                                                'volume_mounts': [{'mount_path': '/var/log/astaire',
                                                                   'mount_propagation': None,
                                                                   'name': 'astairelogs',
                                                                   'read_only': None,
                                                                   'sub_path': None,
                                                                   'sub_path_expr': None}],
                                                'working_dir': None}],
                                'dns_config': None,
                                'dns_policy': 'ClusterFirst',
                                'enable_service_links': None,
                                'host_aliases': None,
                                'host_ipc': None,
                                'host_network': None,
                                'host_pid': None,
                                'hostname': None,
                                'image_pull_secrets': [{'name': None}],
                                'init_containers': [{'args': None,
                                                     'command': ['sh',
                                                                 '-c',
                                                                 'until '
                                                                 'nslookup '
                                                                 'cassandra; '
                                                                 'do echo '
                                                                 'waiting for '
                                                                 'cassandra to '
                                                                 'start ...; '
                                                                 'sleep 2; '
                                                                 'done'],
                                                     'env': None,
                                                     'env_from': None,
                                                     'image': 'busybox:1.28',
                                                     'image_pull_policy': 'IfNotPresent',
                                                     'lifecycle': None,
                                                     'liveness_probe': None,
                                                     'name': 'wait-on-cassandra',
                                                     'ports': None,
                                                     'readiness_probe': None,
                                                     'resources': {'limits': None,
                                                                   'requests': None},
                                                     'security_context': None,
                                                     'stdin': None,
                                                     'stdin_once': None,
                                                     'termination_message_path': '/dev/termination-log',
                                                     'termination_message_policy': 'File',
                                                     'tty': None,
                                                     'volume_devices': None,
                                                     'volume_mounts': None,
                                                     'working_dir': None}],
                                'node_name': None,
                                'node_selector': None,
                                'priority': None,
                                'priority_class_name': None,
                                'readiness_gates': None,
                                'restart_policy': 'Always',
                                'runtime_class_name': None,
                                'scheduler_name': 'default-scheduler',
                                'security_context': {'fs_group': None,
                                                     'run_as_group': None,
                                                     'run_as_non_root': None,
                                                     'run_as_user': None,
                                                     'se_linux_options': None,
                                                     'supplemental_groups': None,
                                                     'sysctls': None},
                                'service_account': None,
                                'service_account_name': None,
                                'share_process_namespace': None,
                                'subdomain': None,
                                'termination_grace_period_seconds': 120,
                                'tolerations': None,
                                'volumes': [{'aws_elastic_block_store': None,
                                             'azure_disk': None,
                                             'azure_file': None,
                                             'cephfs': None,
                                             'cinder': None,
                                             'config_map': None,
                                             'csi': None,
                                             'downward_api': None,
                                             'empty_dir': {'medium': None,
                                                           'size_limit': None},
                                             'fc': None,
                                             'flex_volume': None,
                                             'flocker': None,
                                             'gce_persistent_disk': None,
                                             'git_repo': None,
                                             'glusterfs': None,
                                             'host_path': None,
                                             'iscsi': None,
                                             'name': 'astairelogs',
                                             'nfs': None,
                                             'persistent_volume_claim': None,
                                             'photon_persistent_disk': None,
                                             'portworx_volume': None,
                                             'projected': None,
                                             'quobyte': None,
                                             'rbd': None,
                                             'scale_io': None,
                                             'secret': None,
                                             'storageos': None,
                                             'vsphere_volume': None}]}}},
 'status': {'available_replicas': 1,
            'collision_count': None,
            'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 19, 4, 2, 57, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 4, 2, 57, tzinfo=tzlocal()),
                            'message': 'Deployment has minimum availability.',
                            'reason': 'MinimumReplicasAvailable',
                            'status': 'True',
                            'type': 'Available'},
                           {'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 39, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 4, 2, 57, tzinfo=tzlocal()),
                            'message': 'ReplicaSet "astaire-5ddcdd6b7f" has '
                                       'successfully progressed.',
                            'reason': 'NewReplicaSetAvailable',
                            'status': 'True',
                            'type': 'Progressing'}],
            'observed_generation': 1,
            'ready_replicas': 1,
            'replicas': 1,
            'unavailable_replicas': None,
            'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'astaire', 'namespace': 'ims-h4q84', 'selfLink': '/apis/apps/v1/namespaces/ims-h4q84/deployments/astaire', 'uid': '70bf9edb-e201-4cbe-8cba-1b1ae3f80a33', 'resourceVersion': '981733', 'generation': 1, 'creationTimestamp': '2020-08-19T03:59:39Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'astaire'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'astaire'}}, 'spec': {'volumes': [{'name': 'astairelogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'astaire', 'image': 'ollivier/clearwater-astaire:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 11211, 'protocol': 'TCP'}, {'containerPort': 11311, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'astairelogs', 'mountPath': '/var/log/astaire'}], 'livenessProbe': {'tcpSocket': {'port': 11311}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 9}, 'readinessProbe': {'tcpSocket': {'port': 11311}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'lifecycle': {'preStop': {'exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}}}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/astaire/astaire_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'astairelogs', 'mountPath': '/var/log/astaire'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 120, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-08-19T04:02:57Z', 'lastTransitionTime': '2020-08-19T04:02:57Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-19T04:02:57Z', 'lastTransitionTime': '2020-08-19T03:59:39Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "astaire-5ddcdd6b7f" has successfully progressed.'}]}}}
2020-08-19 04:02:57,427 - functest_kubernetes.ims.ims - INFO - astaire started in 198.14 sec
2020-08-19 04:03:38,807 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1',
 'kind': 'Deployment',
 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'},
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': 1,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'homestead',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981829',
              'self_link': '/apis/apps/v1/namespaces/ims-h4q84/deployments/homestead',
              'uid': '165d9c1c-79b2-4d12-9ff0-a0801d1c1839'},
 'spec': {'min_ready_seconds': None,
          'paused': None,
          'progress_deadline_seconds': 600,
          'replicas': 1,
          'revision_history_limit': 10,
          'selector': {'match_expressions': None,
                       'match_labels': {'service': 'homestead'}},
          'strategy': {'rolling_update': {'max_surge': '25%',
                                          'max_unavailable': '25%'},
                       'type': 'RollingUpdate'},
          'template': {'metadata': {'annotations': None,
                                    'cluster_name': None,
                                    'creation_timestamp': None,
                                    'deletion_grace_period_seconds': None,
                                    'deletion_timestamp': None,
                                    'finalizers': None,
                                    'generate_name': None,
                                    'generation': None,
                                    'initializers': None,
                                    'labels': {'service': 'homestead',
                                               'snmp': 'enabled'},
                                    'managed_fields': None,
                                    'name': None,
                                    'namespace': None,
                                    'owner_references': None,
                                    'resource_version': None,
                                    'self_link': None,
                                    'uid': None},
                       'spec': {'active_deadline_seconds': None,
                                'affinity': None,
                                'automount_service_account_token': None,
                                'containers': [{'args': None,
                                                'command': None,
                                                'env': [{'name': 'MY_POD_IP',
                                                         'value': None,
                                                         'value_from': {'config_map_key_ref': None,
                                                                        'field_ref': {'api_version': 'v1',
                                                                                      'field_path': 'status.podIP'},
                                                                        'resource_field_ref': None,
                                                                        'secret_key_ref': None}}],
                                                'env_from': [{'config_map_ref': {'name': 'env-vars',
                                                                                 'optional': None},
                                                              'prefix': None,
                                                              'secret_ref': None}],
                                                'image': 'ollivier/clearwater-homestead:latest',
                                                'image_pull_policy': 'Always',
                                                'lifecycle': None,
                                                'liveness_probe': {'_exec': {'command': ['/bin/bash',
                                                                                         '/usr/share/kubernetes/liveness.sh',
                                                                                         '8888']},
                                                                   'failure_threshold': 3,
                                                                   'http_get': None,
                                                                   'initial_delay_seconds': 60,
                                                                   'period_seconds': 10,
                                                                   'success_threshold': 1,
                                                                   'tcp_socket': None,
                                                                   'timeout_seconds': 1},
                                                'name': 'homestead',
                                                'ports': [{'container_port': 22,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'},
                                                          {'container_port': 8888,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'}],
                                                'readiness_probe': {'_exec': {'command': ['/bin/bash',
                                                                                          '/usr/share/kubernetes/liveness.sh',
                                                                                          '8888']},
                                                                    'failure_threshold': 3,
                                                                    'http_get': None,
                                                                    'initial_delay_seconds': None,
                                                                    'period_seconds': 10,
                                                                    'success_threshold': 1,
                                                                    'tcp_socket': None,
                                                                    'timeout_seconds': 1},
                                                'resources': {'limits': None,
                                                              'requests': None},
                                                'security_context': None,
                                                'stdin': None,
                                                'stdin_once': None,
                                                'termination_message_path': '/dev/termination-log',
                                                'termination_message_policy': 'File',
                                                'tty': None,
                                                'volume_devices': None,
                                                'volume_mounts': [{'mount_path': '/var/log/homestead',
                                                                   'mount_propagation': None,
                                                                   'name': 'homesteadlogs',
                                                                   'read_only': None,
                                                                   'sub_path': None,
                                                                   'sub_path_expr': None}],
                                                'working_dir': None},
                                               {'args': None,
                                                'command': ['tail',
                                                            '-F',
                                                            '/var/log/homestead/homestead_current.txt'],
                                                'env': None,
                                                'env_from': None,
                                                'image': 'busybox',
                                                'image_pull_policy': 'Always',
                                                'lifecycle': None,
                                                'liveness_probe': None,
                                                'name': 'tailer',
                                                'ports': None,
                                                'readiness_probe': None,
                                                'resources': {'limits': None,
                                                              'requests': None},
                                                'security_context': None,
                                                'stdin': None,
                                                'stdin_once': None,
                                                'termination_message_path': '/dev/termination-log',
                                                'termination_message_policy': 'File',
                                                'tty': None,
                                                'volume_devices': None,
                                                'volume_mounts': [{'mount_path': '/var/log/homestead',
                                                                   'mount_propagation': None,
                                                                   'name': 'homesteadlogs',
                                                                   'read_only': None,
                                                                   'sub_path': None,
                                                                   'sub_path_expr': None}],
                                                'working_dir': None}],
                                'dns_config': None,
                                'dns_policy': 'ClusterFirst',
                                'enable_service_links': None,
                                'host_aliases': None,
                                'host_ipc': None,
                                'host_network': None,
                                'host_pid': None,
                                'hostname': None,
                                'image_pull_secrets': [{'name': None}],
                                'init_containers': [{'args': None,
                                                     'command': ['sh',
                                                                 '-c',
                                                                 'until '
                                                                 'nslookup '
                                                                 'cassandra; '
                                                                 'do echo '
                                                                 'waiting for '
                                                                 'cassandra to '
                                                                 'start ...; '
                                                                 'sleep 2; '
                                                                 'done'],
                                                     'env': None,
                                                     'env_from': None,
                                                     'image': 'busybox:1.28',
                                                     'image_pull_policy': 'IfNotPresent',
                                                     'lifecycle': None,
                                                     'liveness_probe': None,
                                                     'name': 'wait-on-cassandra',
                                                     'ports': None,
                                                     'readiness_probe': None,
                                                     'resources': {'limits': None,
                                                                   'requests': None},
                                                     'security_context': None,
                                                     'stdin': None,
                                                     'stdin_once': None,
                                                     'termination_message_path': '/dev/termination-log',
                                                     'termination_message_policy': 'File',
                                                     'tty': None,
                                                     'volume_devices': None,
                                                     'volume_mounts': None,
                                                     'working_dir': None},
                                                    {'args': None,
                                                     'command': ['sh',
                                                                 '-c',
                                                                 'until '
                                                                 'nslookup '
                                                                 'astaire; do '
                                                                 'echo waiting '
                                                                 'for astaire '
                                                                 'to start '
                                                                 '...; sleep '
                                                                 '2; done'],
                                                     'env': None,
                                                     'env_from': None,
                                                     'image': 'busybox:1.28',
                                                     'image_pull_policy': 'IfNotPresent',
                                                     'lifecycle': None,
                                                     'liveness_probe': None,
                                                     'name': 'wait-on-astaire',
                                                     'ports': None,
                                                     'readiness_probe': None,
                                                     'resources': {'limits': None,
                                                                   'requests': None},
                                                     'security_context': None,
                                                     'stdin': None,
                                                     'stdin_once': None,
                                                     'termination_message_path': '/dev/termination-log',
                                                     'termination_message_policy': 'File',
                                                     'tty': None,
                                                     'volume_devices': None,
                                                     'volume_mounts': None,
                                                     'working_dir': None}],
                                'node_name': None,
                                'node_selector': None,
                                'priority': None,
                                'priority_class_name': None,
                                'readiness_gates': None,
                                'restart_policy': 'Always',
                                'runtime_class_name': None,
                                'scheduler_name': 'default-scheduler',
                                'security_context': {'fs_group': None,
                                                     'run_as_group': None,
                                                     'run_as_non_root': None,
                                                     'run_as_user': None,
                                                     'se_linux_options': None,
                                                     'supplemental_groups': None,
                                                     'sysctls': None},
                                'service_account': None,
                                'service_account_name': None,
                                'share_process_namespace': None,
                                'subdomain': None,
                                'termination_grace_period_seconds': 30,
                                'tolerations': None,
                                'volumes': [{'aws_elastic_block_store': None,
                                             'azure_disk': None,
                                             'azure_file': None,
                                             'cephfs': None,
                                             'cinder': None,
                                             'config_map': None,
                                             'csi': None,
                                             'downward_api': None,
                                             'empty_dir': {'medium': None,
                                                           'size_limit': None},
                                             'fc': None,
                                             'flex_volume': None,
                                             'flocker': None,
                                             'gce_persistent_disk': None,
                                             'git_repo': None,
                                             'glusterfs': None,
                                             'host_path': None,
                                             'iscsi': None,
                                             'name': 'homesteadlogs',
                                             'nfs': None,
                                             'persistent_volume_claim': None,
                                             'photon_persistent_disk': None,
                                             'portworx_volume': None,
                                             'projected': None,
                                             'quobyte': None,
                                             'rbd': None,
                                             'scale_io': None,
                                             'secret': None,
                                             'storageos': None,
                                             'vsphere_volume': None}]}}},
 'status': {'available_replicas': 1,
            'collision_count': None,
            'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 19, 4, 3, 38, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 4, 3, 38, tzinfo=tzlocal()),
                            'message': 'Deployment has minimum availability.',
                            'reason': 'MinimumReplicasAvailable',
                            'status': 'True',
                            'type': 'Available'},
                           {'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 4, 3, 38, tzinfo=tzlocal()),
                            'message': 'ReplicaSet "homestead-57586d6cdc" has '
                                       'successfully progressed.',
                            'reason': 'NewReplicaSetAvailable',
                            'status': 'True',
                            'type': 'Progressing'}],
            'observed_generation': 1,
            'ready_replicas': 1,
            'replicas': 1,
            'unavailable_replicas': None,
            'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homestead', 'namespace': 'ims-h4q84', 'selfLink': '/apis/apps/v1/namespaces/ims-h4q84/deployments/homestead', 'uid': '165d9c1c-79b2-4d12-9ff0-a0801d1c1839', 'resourceVersion': '981829', 'generation': 1, 'creationTimestamp': '2020-08-19T03:59:41Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homestead'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homestead', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'homesteadlogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-astaire', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup astaire; do echo waiting for astaire to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead', 'image': 'ollivier/clearwater-homestead:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'homesteadlogs', 'mountPath': '/var/log/homestead'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/homestead/homestead_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'homesteadlogs', 'mountPath': '/var/log/homestead'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-08-19T04:03:38Z', 'lastTransitionTime': '2020-08-19T04:03:38Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-19T04:03:38Z', 'lastTransitionTime': '2020-08-19T03:59:41Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "homestead-57586d6cdc" has successfully progressed.'}]}}}
2020-08-19 04:03:39,085 - functest_kubernetes.ims.ims - INFO - homestead started in 239.80 sec
2020-08-19 04:03:59,358 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1',
 'kind': 'Deployment',
 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'},
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 42, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': 1,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'sprout',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981891',
              'self_link': '/apis/apps/v1/namespaces/ims-h4q84/deployments/sprout',
              'uid': '3a87fa02-60fb-44d1-aade-be3745d8c918'},
 'spec': {'min_ready_seconds': None,
          'paused': None,
          'progress_deadline_seconds': 600,
          'replicas': 1,
          'revision_history_limit': 10,
          'selector': {'match_expressions': None,
                       'match_labels': {'service': 'sprout'}},
          'strategy': {'rolling_update': {'max_surge': '25%',
                                          'max_unavailable': '25%'},
                       'type': 'RollingUpdate'},
          'template': {'metadata': {'annotations': None,
                                    'cluster_name': None,
                                    'creation_timestamp': None,
                                    'deletion_grace_period_seconds': None,
                                    'deletion_timestamp': None,
                                    'finalizers': None,
                                    'generate_name': None,
                                    'generation': None,
                                    'initializers': None,
                                    'labels': {'service': 'sprout',
                                               'snmp': 'enabled'},
                                    'managed_fields': None,
                                    'name': None,
                                    'namespace': None,
                                    'owner_references': None,
                                    'resource_version': None,
                                    'self_link': None,
                                    'uid': None},
                       'spec': {'active_deadline_seconds': None,
                                'affinity': None,
                                'automount_service_account_token': None,
                                'containers': [{'args': None,
                                                'command': None,
                                                'env': [{'name': 'MY_POD_IP',
                                                         'value': None,
                                                         'value_from': {'config_map_key_ref': None,
                                                                        'field_ref': {'api_version': 'v1',
                                                                                      'field_path': 'status.podIP'},
                                                                        'resource_field_ref': None,
                                                                        'secret_key_ref': None}}],
                                                'env_from': [{'config_map_ref': {'name': 'env-vars',
                                                                                 'optional': None},
                                                              'prefix': None,
                                                              'secret_ref': None}],
                                                'image': 'ollivier/clearwater-sprout:latest',
                                                'image_pull_policy': 'Always',
                                                'lifecycle': None,
                                                'liveness_probe': {'_exec': {'command': ['/bin/bash',
                                                                                         '/usr/share/kubernetes/liveness.sh',
                                                                                         '5052 '
                                                                                         '5054']},
                                                                   'failure_threshold': 3,
                                                                   'http_get': None,
                                                                   'initial_delay_seconds': 30,
                                                                   'period_seconds': 3,
                                                                   'success_threshold': 1,
                                                                   'tcp_socket': None,
                                                                   'timeout_seconds': 1},
                                                'name': 'sprout',
                                                'ports': [{'container_port': 22,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'}],
                                                'readiness_probe': {'_exec': {'command': ['/bin/bash',
                                                                                          '/usr/share/kubernetes/liveness.sh',
                                                                                          '5052 '
                                                                                          '5054']},
                                                                    'failure_threshold': 3,
                                                                    'http_get': None,
                                                                    'initial_delay_seconds': None,
                                                                    'period_seconds': 10,
                                                                    'success_threshold': 1,
                                                                    'tcp_socket': None,
                                                                    'timeout_seconds': 1},
                                                'resources': {'limits': None,
                                                              'requests': None},
                                                'security_context': None,
                                                'stdin': None,
                                                'stdin_once': None,
                                                'termination_message_path': '/dev/termination-log',
                                                'termination_message_policy': 'File',
                                                'tty': None,
                                                'volume_devices': None,
                                                'volume_mounts': [{'mount_path': '/var/log/sprout',
                                                                   'mount_propagation': None,
                                                                   'name': 'sproutlogs',
                                                                   'read_only': None,
                                                                   'sub_path': None,
                                                                   'sub_path_expr': None}],
                                                'working_dir': None},
                                               {'args': None,
                                                'command': ['tail',
                                                            '-F',
                                                            '/var/log/sprout/sprout_current.txt'],
                                                'env': None,
                                                'env_from': None,
                                                'image': 'busybox',
                                                'image_pull_policy': 'Always',
                                                'lifecycle': None,
                                                'liveness_probe': None,
                                                'name': 'tailer',
                                                'ports': None,
                                                'readiness_probe': None,
                                                'resources': {'limits': None,
                                                              'requests': None},
                                                'security_context': None,
                                                'stdin': None,
                                                'stdin_once': None,
                                                'termination_message_path': '/dev/termination-log',
                                                'termination_message_policy': 'File',
                                                'tty': None,
                                                'volume_devices': None,
                                                'volume_mounts': [{'mount_path': '/var/log/sprout',
                                                                   'mount_propagation': None,
                                                                   'name': 'sproutlogs',
                                                                   'read_only': None,
                                                                   'sub_path': None,
                                                                   'sub_path_expr': None}],
                                                'working_dir': None}],
                                'dns_config': None,
                                'dns_policy': 'ClusterFirst',
                                'enable_service_links': None,
                                'host_aliases': None,
                                'host_ipc': None,
                                'host_network': None,
                                'host_pid': None,
                                'hostname': None,
                                'image_pull_secrets': [{'name': None}],
                                'init_containers': [{'args': None,
                                                     'command': ['sh',
                                                                 '-c',
                                                                 'until '
                                                                 'nslookup '
                                                                 'ralf; do '
                                                                 'echo waiting '
                                                                 'for ralf to '
                                                                 'start ...; '
                                                                 'sleep 2; '
                                                                 'done'],
                                                     'env': None,
                                                     'env_from': None,
                                                     'image': 'busybox:1.28',
                                                     'image_pull_policy': 'IfNotPresent',
                                                     'lifecycle': None,
                                                     'liveness_probe': None,
                                                     'name': 'wait-on-ralf',
                                                     'ports': None,
                                                     'readiness_probe': None,
                                                     'resources': {'limits': None,
                                                                   'requests': None},
                                                     'security_context': None,
                                                     'stdin': None,
                                                     'stdin_once': None,
                                                     'termination_message_path': '/dev/termination-log',
                                                     'termination_message_policy': 'File',
                                                     'tty': None,
                                                     'volume_devices': None,
                                                     'volume_mounts': None,
                                                     'working_dir': None},
                                                    {'args': None,
                                                     'command': ['sh',
                                                                 '-c',
                                                                 'until '
                                                                 'nslookup '
                                                                 'chronos; do '
                                                                 'echo waiting '
                                                                 'for chronos '
                                                                 'to start '
                                                                 '...; sleep '
                                                                 '2; done'],
                                                     'env': None,
                                                     'env_from': None,
                                                     'image': 'busybox:1.28',
                                                     'image_pull_policy': 'IfNotPresent',
                                                     'lifecycle': None,
                                                     'liveness_probe': None,
                                                     'name': 'wait-on-chronos',
                                                     'ports': None,
                                                     'readiness_probe': None,
                                                     'resources': {'limits': None,
                                                                   'requests': None},
                                                     'security_context': None,
                                                     'stdin': None,
                                                     'stdin_once': None,
                                                     'termination_message_path': '/dev/termination-log',
                                                     'termination_message_policy': 'File',
                                                     'tty': None,
                                                     'volume_devices': None,
                                                     'volume_mounts': None,
                                                     'working_dir': None},
                                                    {'args': None,
                                                     'command': ['sh',
                                                                 '-c',
                                                                 'until '
                                                                 'nslookup '
                                                                 'homestead; '
                                                                 'do echo '
                                                                 'waiting for '
                                                                 'homestead to '
                                                                 'start ...; '
                                                                 'sleep 2; '
                                                                 'done'],
                                                     'env': None,
                                                     'env_from': None,
                                                     'image': 'busybox:1.28',
                                                     'image_pull_policy': 'IfNotPresent',
                                                     'lifecycle': None,
                                                     'liveness_probe': None,
                                                     'name': 'wait-on-homestead',
                                                     'ports': None,
                                                     'readiness_probe': None,
                                                     'resources': {'limits': None,
                                                                   'requests': None},
                                                     'security_context': None,
                                                     'stdin': None,
                                                     'stdin_once': None,
                                                     'termination_message_path': '/dev/termination-log',
                                                     'termination_message_policy': 'File',
                                                     'tty': None,
                                                     'volume_devices': None,
                                                     'volume_mounts': None,
                                                     'working_dir': None}],
                                'node_name': None,
                                'node_selector': None,
                                'priority': None,
                                'priority_class_name': None,
                                'readiness_gates': None,
                                'restart_policy': 'Always',
                                'runtime_class_name': None,
                                'scheduler_name': 'default-scheduler',
                                'security_context': {'fs_group': None,
                                                     'run_as_group': None,
                                                     'run_as_non_root': None,
                                                     'run_as_user': None,
                                                     'se_linux_options': None,
                                                     'supplemental_groups': None,
                                                     'sysctls': None},
                                'service_account': None,
                                'service_account_name': None,
                                'share_process_namespace': None,
                                'subdomain': None,
                                'termination_grace_period_seconds': 30,
                                'tolerations': None,
                                'volumes': [{'aws_elastic_block_store': None,
                                             'azure_disk': None,
                                             'azure_file': None,
                                             'cephfs': None,
                                             'cinder': None,
                                             'config_map': None,
                                             'csi': None,
                                             'downward_api': None,
                                             'empty_dir': {'medium': None,
                                                           'size_limit': None},
                                             'fc': None,
                                             'flex_volume': None,
                                             'flocker': None,
                                             'gce_persistent_disk': None,
                                             'git_repo': None,
                                             'glusterfs': None,
                                             'host_path': None,
                                             'iscsi': None,
                                             'name': 'sproutlogs',
                                             'nfs': None,
                                             'persistent_volume_claim': None,
                                             'photon_persistent_disk': None,
                                             'portworx_volume': None,
                                             'projected': None,
                                             'quobyte': None,
                                             'rbd': None,
                                             'scale_io': None,
                                             'secret': None,
                                             'storageos': None,
                                             'vsphere_volume': None}]}}},
 'status': {'available_replicas': 1,
            'collision_count': None,
            'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 19, 4, 3, 59, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 4, 3, 59, tzinfo=tzlocal()),
                            'message': 'Deployment has minimum availability.',
                            'reason': 'MinimumReplicasAvailable',
                            'status': 'True',
                            'type': 'Available'},
                           {'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 42, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 4, 3, 59, tzinfo=tzlocal()),
                            'message': 'ReplicaSet "sprout-686cc64cfb" has '
                                       'successfully progressed.',
                            'reason': 'NewReplicaSetAvailable',
                            'status': 'True',
                            'type': 'Progressing'}],
            'observed_generation': 1,
            'ready_replicas': 1,
            'replicas': 1,
            'unavailable_replicas': None,
            'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'sprout', 'namespace': 'ims-h4q84', 'selfLink': '/apis/apps/v1/namespaces/ims-h4q84/deployments/sprout', 'uid': '3a87fa02-60fb-44d1-aade-be3745d8c918', 'resourceVersion': '981891', 'generation': 1, 'creationTimestamp': '2020-08-19T03:59:42Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'sprout'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'sprout', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'sproutlogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-ralf', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup ralf; do echo waiting for ralf to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-chronos', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup chronos; do echo waiting for chronos to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-homestead', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'sprout', 'image': 'ollivier/clearwater-sprout:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 3, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-08-19T04:03:59Z', 'lastTransitionTime': '2020-08-19T04:03:59Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-19T04:03:59Z', 'lastTransitionTime': '2020-08-19T03:59:42Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "sprout-686cc64cfb" has successfully progressed.'}]}}}
2020-08-19 04:03:59,668 - functest_kubernetes.ims.ims - INFO - sprout started in 260.38 sec
2020-08-19 04:04:25,438 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1',
 'kind': 'Deployment',
 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'},
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': 1,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'bono',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '981959',
              'self_link': '/apis/apps/v1/namespaces/ims-h4q84/deployments/bono',
              'uid': '08f3c434-4caf-4735-8f74-93f1561b3c04'},
 'spec': {'min_ready_seconds': None,
          'paused': None,
          'progress_deadline_seconds': 600,
          'replicas': 1,
          'revision_history_limit': 10,
          'selector': {'match_expressions': None,
                       'match_labels': {'service': 'bono'}},
          'strategy': {'rolling_update': {'max_surge': '25%',
                                          'max_unavailable': '25%'},
                       'type': 'RollingUpdate'},
          'template': {'metadata': {'annotations': None,
                                    'cluster_name': None,
                                    'creation_timestamp': None,
                                    'deletion_grace_period_seconds': None,
                                    'deletion_timestamp': None,
                                    'finalizers': None,
                                    'generate_name': None,
                                    'generation': None,
                                    'initializers': None,
                                    'labels': {'service': 'bono',
                                               'snmp': 'enabled'},
                                    'managed_fields': None,
                                    'name': None,
                                    'namespace': None,
                                    'owner_references': None,
                                    'resource_version': None,
                                    'self_link': None,
                                    'uid': None},
                       'spec': {'active_deadline_seconds': None,
                                'affinity': None,
                                'automount_service_account_token': None,
                                'containers': [{'args': None,
                                                'command': None,
                                                'env': [{'name': 'MY_POD_IP',
                                                         'value': None,
                                                         'value_from': {'config_map_key_ref': None,
                                                                        'field_ref': {'api_version': 'v1',
                                                                                      'field_path': 'status.podIP'},
                                                                        'resource_field_ref': None,
                                                                        'secret_key_ref': None}}],
                                                'env_from': [{'config_map_ref': {'name': 'env-vars',
                                                                                 'optional': None},
                                                              'prefix': None,
                                                              'secret_ref': None}],
                                                'image': 'ollivier/clearwater-bono:latest',
                                                'image_pull_policy': 'Always',
                                                'lifecycle': None,
                                                'liveness_probe': {'_exec': {'command': ['/bin/bash',
                                                                                         '/usr/share/kubernetes/liveness.sh',
                                                                                         '3478 '
                                                                                         '5060 '
                                                                                         '5062']},
                                                                   'failure_threshold': 3,
                                                                   'http_get': None,
                                                                   'initial_delay_seconds': 30,
                                                                   'period_seconds': 10,
                                                                   'success_threshold': 1,
                                                                   'tcp_socket': None,
                                                                   'timeout_seconds': 1},
                                                'name': 'bono',
                                                'ports': [{'container_port': 22,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'},
                                                          {'container_port': 3478,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'},
                                                          {'container_port': 5060,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'},
                                                          {'container_port': 5062,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'},
                                                          {'container_port': 5060,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'UDP'},
                                                          {'container_port': 5062,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'UDP'}],
                                                'readiness_probe': {'_exec': {'command': ['/bin/bash',
                                                                                          '/usr/share/kubernetes/liveness.sh',
                                                                                          '3478 '
                                                                                          '5060 '
                                                                                          '5062']},
                                                                    'failure_threshold': 3,
                                                                    'http_get': None,
                                                                    'initial_delay_seconds': None,
                                                                    'period_seconds': 10,
                                                                    'success_threshold': 1,
                                                                    'tcp_socket': None,
                                                                    'timeout_seconds': 1},
                                                'resources': {'limits': None,
                                                              'requests': None},
                                                'security_context': None,
                                                'stdin': None,
                                                'stdin_once': None,
                                                'termination_message_path': '/dev/termination-log',
                                                'termination_message_policy': 'File',
                                                'tty': None,
                                                'volume_devices': None,
                                                'volume_mounts': [{'mount_path': '/var/log/bono',
                                                                   'mount_propagation': None,
                                                                   'name': 'bonologs',
                                                                   'read_only': None,
                                                                   'sub_path': None,
                                                                   'sub_path_expr': None}],
                                                'working_dir': None},
                                               {'args': None,
                                                'command': ['tail',
                                                            '-F',
                                                            '/var/log/bono/bono_current.txt'],
                                                'env': None,
                                                'env_from': None,
                                                'image': 'busybox',
                                                'image_pull_policy': 'Always',
                                                'lifecycle': None,
                                                'liveness_probe': None,
                                                'name': 'tailer',
                                                'ports': None,
                                                'readiness_probe': None,
                                                'resources': {'limits': None,
                                                              'requests': None},
                                                'security_context': None,
                                                'stdin': None,
                                                'stdin_once': None,
                                                'termination_message_path': '/dev/termination-log',
                                                'termination_message_policy': 'File',
                                                'tty': None,
                                                'volume_devices': None,
                                                'volume_mounts': [{'mount_path': '/var/log/bono',
                                                                   'mount_propagation': None,
                                                                   'name': 'bonologs',
                                                                   'read_only': None,
                                                                   'sub_path': None,
                                                                   'sub_path_expr': None}],
                                                'working_dir': None}],
                                'dns_config': None,
                                'dns_policy': 'ClusterFirst',
                                'enable_service_links': None,
                                'host_aliases': None,
                                'host_ipc': None,
                                'host_network': None,
                                'host_pid': None,
                                'hostname': None,
                                'image_pull_secrets': [{'name': None}],
                                'init_containers': [{'args': None,
                                                     'command': ['sh',
                                                                 '-c',
                                                                 'until '
                                                                 'nslookup '
                                                                 'sprout; do '
                                                                 'echo waiting '
                                                                 'for sprout '
                                                                 'to start '
                                                                 '...; sleep '
                                                                 '2; done'],
                                                     'env': None,
                                                     'env_from': None,
                                                     'image': 'busybox:1.28',
                                                     'image_pull_policy': 'IfNotPresent',
                                                     'lifecycle': None,
                                                     'liveness_probe': None,
                                                     'name': 'wait-on-sprout',
                                                     'ports': None,
                                                     'readiness_probe': None,
                                                     'resources': {'limits': None,
                                                                   'requests': None},
                                                     'security_context': None,
                                                     'stdin': None,
                                                     'stdin_once': None,
                                                     'termination_message_path': '/dev/termination-log',
                                                     'termination_message_policy': 'File',
                                                     'tty': None,
                                                     'volume_devices': None,
                                                     'volume_mounts': None,
                                                     'working_dir': None}],
                                'node_name': None,
                                'node_selector': None,
                                'priority': None,
                                'priority_class_name': None,
                                'readiness_gates': None,
                                'restart_policy': 'Always',
                                'runtime_class_name': None,
                                'scheduler_name': 'default-scheduler',
                                'security_context': {'fs_group': None,
                                                     'run_as_group': None,
                                                     'run_as_non_root': None,
                                                     'run_as_user': None,
                                                     'se_linux_options': None,
                                                     'supplemental_groups': None,
                                                     'sysctls': None},
                                'service_account': None,
                                'service_account_name': None,
                                'share_process_namespace': None,
                                'subdomain': None,
                                'termination_grace_period_seconds': 30,
                                'tolerations': None,
                                'volumes': [{'aws_elastic_block_store': None,
                                             'azure_disk': None,
                                             'azure_file': None,
                                             'cephfs': None,
                                             'cinder': None,
                                             'config_map': None,
                                             'csi': None,
                                             'downward_api': None,
                                             'empty_dir': {'medium': None,
                                                           'size_limit': None},
                                             'fc': None,
                                             'flex_volume': None,
                                             'flocker': None,
                                             'gce_persistent_disk': None,
                                             'git_repo': None,
                                             'glusterfs': None,
                                             'host_path': None,
                                             'iscsi': None,
                                             'name': 'bonologs',
                                             'nfs': None,
                                             'persistent_volume_claim': None,
                                             'photon_persistent_disk': None,
                                             'portworx_volume': None,
                                             'projected': None,
                                             'quobyte': None,
                                             'rbd': None,
                                             'scale_io': None,
                                             'secret': None,
                                             'storageos': None,
                                             'vsphere_volume': None}]}}},
 'status': {'available_replicas': 1,
            'collision_count': None,
            'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 19, 4, 4, 25, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 4, 4, 25, tzinfo=tzlocal()),
                            'message': 'Deployment has minimum availability.',
                            'reason': 'MinimumReplicasAvailable',
                            'status': 'True',
                            'type': 'Available'},
                           {'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 4, 4, 25, tzinfo=tzlocal()),
                            'message': 'ReplicaSet "bono-5cdb7bfcdd" has '
                                       'successfully progressed.',
                            'reason': 'NewReplicaSetAvailable',
                            'status': 'True',
                            'type': 'Progressing'}],
            'observed_generation': 1,
            'ready_replicas': 1,
            'replicas': 1,
            'unavailable_replicas': None,
            'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'bono', 'namespace': 'ims-h4q84', 'selfLink': '/apis/apps/v1/namespaces/ims-h4q84/deployments/bono', 'uid': '08f3c434-4caf-4735-8f74-93f1561b3c04', 'resourceVersion': '981959', 'generation': 1, 'creationTimestamp': '2020-08-19T03:59:40Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'bono'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'bono', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'bonologs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'bono', 'image': 'ollivier/clearwater-bono:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 3478, 'protocol': 'TCP'}, {'containerPort': 5060, 'protocol': 'TCP'}, {'containerPort': 5062, 'protocol': 'TCP'}, {'containerPort': 5060, 'protocol': 'UDP'}, {'containerPort': 5062, 'protocol': 'UDP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'bonologs', 'mountPath': '/var/log/bono'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 5062']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 5062']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/bono/bono_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'bonologs', 'mountPath': '/var/log/bono'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-08-19T04:04:25Z', 'lastTransitionTime': '2020-08-19T04:04:25Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-19T04:04:25Z', 'lastTransitionTime': '2020-08-19T03:59:40Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "bono-5cdb7bfcdd" has successfully progressed.'}]}}}
2020-08-19 04:04:25,733 - functest_kubernetes.ims.ims - INFO - bono started in 286.45 sec
2020-08-19 04:07:05,571 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1',
 'kind': 'Deployment',
 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'},
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': 1,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'homestead-prov',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '982290',
              'self_link': '/apis/apps/v1/namespaces/ims-h4q84/deployments/homestead-prov',
              'uid': '74868f80-4d95-45cd-823a-a73146cb3109'},
 'spec': {'min_ready_seconds': None,
          'paused': None,
          'progress_deadline_seconds': 600,
          'replicas': 1,
          'revision_history_limit': 10,
          'selector': {'match_expressions': None,
                       'match_labels': {'service': 'homestead-prov'}},
          'strategy': {'rolling_update': {'max_surge': '25%',
                                          'max_unavailable': '25%'},
                       'type': 'RollingUpdate'},
          'template': {'metadata': {'annotations': None,
                                    'cluster_name': None,
                                    'creation_timestamp': None,
                                    'deletion_grace_period_seconds': None,
                                    'deletion_timestamp': None,
                                    'finalizers': None,
                                    'generate_name': None,
                                    'generation': None,
                                    'initializers': None,
                                    'labels': {'service': 'homestead-prov',
                                               'snmp': 'enabled'},
                                    'managed_fields': None,
                                    'name': None,
                                    'namespace': None,
                                    'owner_references': None,
                                    'resource_version': None,
                                    'self_link': None,
                                    'uid': None},
                       'spec': {'active_deadline_seconds': None,
                                'affinity': None,
                                'automount_service_account_token': None,
                                'containers': [{'args': None,
                                                'command': None,
                                                'env': [{'name': 'MY_POD_IP',
                                                         'value': None,
                                                         'value_from': {'config_map_key_ref': None,
                                                                        'field_ref': {'api_version': 'v1',
                                                                                      'field_path': 'status.podIP'},
                                                                        'resource_field_ref': None,
                                                                        'secret_key_ref': None}}],
                                                'env_from': [{'config_map_ref': {'name': 'env-vars',
                                                                                 'optional': None},
                                                              'prefix': None,
                                                              'secret_ref': None}],
                                                'image': 'ollivier/clearwater-homestead-prov:latest',
                                                'image_pull_policy': 'Always',
                                                'lifecycle': None,
                                                'liveness_probe': {'_exec': {'command': ['/bin/bash',
                                                                                         '/usr/share/clearwater/bin/poll_homestead-prov.sh']},
                                                                   'failure_threshold': 3,
                                                                   'http_get': None,
                                                                   'initial_delay_seconds': 60,
                                                                   'period_seconds': 10,
                                                                   'success_threshold': 1,
                                                                   'tcp_socket': None,
                                                                   'timeout_seconds': 1},
                                                'name': 'homestead-prov',
                                                'ports': [{'container_port': 22,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'},
                                                          {'container_port': 8889,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'}],
                                                'readiness_probe': {'_exec': {'command': ['/bin/bash',
                                                                                          '/usr/share/clearwater/bin/poll_homestead-prov.sh']},
                                                                    'failure_threshold': 3,
                                                                    'http_get': None,
                                                                    'initial_delay_seconds': None,
                                                                    'period_seconds': 10,
                                                                    'success_threshold': 1,
                                                                    'tcp_socket': None,
                                                                    'timeout_seconds': 1},
                                                'resources': {'limits': None,
                                                              'requests': None},
                                                'security_context': None,
                                                'stdin': None,
                                                'stdin_once': None,
                                                'termination_message_path': '/dev/termination-log',
                                                'termination_message_policy': 'File',
                                                'tty': None,
                                                'volume_devices': None,
                                                'volume_mounts': None,
                                                'working_dir': None}],
                                'dns_config': None,
                                'dns_policy': 'ClusterFirst',
                                'enable_service_links': None,
                                'host_aliases': None,
                                'host_ipc': None,
                                'host_network': None,
                                'host_pid': None,
                                'hostname': None,
                                'image_pull_secrets': [{'name': None}],
                                'init_containers': [{'args': None,
                                                     'command': ['sh',
                                                                 '-c',
                                                                 'until '
                                                                 'nslookup '
                                                                 'homestead; '
                                                                 'do echo '
                                                                 'waiting for '
                                                                 'homestead to '
                                                                 'start ...; '
                                                                 'sleep 2; '
                                                                 'done'],
                                                     'env': None,
                                                     'env_from': None,
                                                     'image': 'busybox:1.28',
                                                     'image_pull_policy': 'IfNotPresent',
                                                     'lifecycle': None,
                                                     'liveness_probe': None,
                                                     'name': 'wait-on-homestead',
                                                     'ports': None,
                                                     'readiness_probe': None,
                                                     'resources': {'limits': None,
                                                                   'requests': None},
                                                     'security_context': None,
                                                     'stdin': None,
                                                     'stdin_once': None,
                                                     'termination_message_path': '/dev/termination-log',
                                                     'termination_message_policy': 'File',
                                                     'tty': None,
                                                     'volume_devices': None,
                                                     'volume_mounts': None,
                                                     'working_dir': None}],
                                'node_name': None,
                                'node_selector': None,
                                'priority': None,
                                'priority_class_name': None,
                                'readiness_gates': None,
                                'restart_policy': 'Always',
                                'runtime_class_name': None,
                                'scheduler_name': 'default-scheduler',
                                'security_context': {'fs_group': None,
                                                     'run_as_group': None,
                                                     'run_as_non_root': None,
                                                     'run_as_user': None,
                                                     'se_linux_options': None,
                                                     'supplemental_groups': None,
                                                     'sysctls': None},
                                'service_account': None,
                                'service_account_name': None,
                                'share_process_namespace': None,
                                'subdomain': None,
                                'termination_grace_period_seconds': 30,
                                'tolerations': None,
                                'volumes': None}}},
 'status': {'available_replicas': 1,
            'collision_count': None,
            'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 19, 4, 7, 5, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 4, 7, 5, tzinfo=tzlocal()),
                            'message': 'Deployment has minimum availability.',
                            'reason': 'MinimumReplicasAvailable',
                            'status': 'True',
                            'type': 'Available'},
                           {'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 4, 7, 5, tzinfo=tzlocal()),
                            'message': 'ReplicaSet "homestead-prov-756c8bff5d" '
                                       'has successfully progressed.',
                            'reason': 'NewReplicaSetAvailable',
                            'status': 'True',
                            'type': 'Progressing'}],
            'observed_generation': 1,
            'ready_replicas': 1,
            'replicas': 1,
            'unavailable_replicas': None,
            'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homestead-prov', 'namespace': 'ims-h4q84', 'selfLink': '/apis/apps/v1/namespaces/ims-h4q84/deployments/homestead-prov', 'uid': '74868f80-4d95-45cd-823a-a73146cb3109', 'resourceVersion': '982290', 'generation': 1, 'creationTimestamp': '2020-08-19T03:59:41Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homestead-prov'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homestead-prov', 'snmp': 'enabled'}}, 'spec': {'initContainers': [{'name': 'wait-on-homestead', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead-prov', 'image': 'ollivier/clearwater-homestead-prov:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8889, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-08-19T04:07:05Z', 'lastTransitionTime': '2020-08-19T04:07:05Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-19T04:07:05Z', 'lastTransitionTime': '2020-08-19T03:59:41Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "homestead-prov-756c8bff5d" has successfully progressed.'}]}}}
2020-08-19 04:07:05,750 - functest_kubernetes.ims.ims - INFO - homestead-prov started in 446.46 sec
2020-08-19 04:07:28,438 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1',
 'kind': 'Deployment',
 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'},
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': 1,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'ellis',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '982348',
              'self_link': '/apis/apps/v1/namespaces/ims-h4q84/deployments/ellis',
              'uid': '1489ad06-8c54-4f56-a6b8-5cfd2daffb39'},
 'spec': {'min_ready_seconds': None,
          'paused': None,
          'progress_deadline_seconds': 600,
          'replicas': 1,
          'revision_history_limit': 10,
          'selector': {'match_expressions': None,
                       'match_labels': {'service': 'ellis'}},
          'strategy': {'rolling_update': {'max_surge': '25%',
                                          'max_unavailable': '25%'},
                       'type': 'RollingUpdate'},
          'template': {'metadata': {'annotations': None,
                                    'cluster_name': None,
                                    'creation_timestamp': None,
                                    'deletion_grace_period_seconds': None,
                                    'deletion_timestamp': None,
                                    'finalizers': None,
                                    'generate_name': None,
                                    'generation': None,
                                    'initializers': None,
                                    'labels': {'service': 'ellis'},
                                    'managed_fields': None,
                                    'name': None,
                                    'namespace': None,
                                    'owner_references': None,
                                    'resource_version': None,
                                    'self_link': None,
                                    'uid': None},
                       'spec': {'active_deadline_seconds': None,
                                'affinity': None,
                                'automount_service_account_token': None,
                                'containers': [{'args': None,
                                                'command': None,
                                                'env': [{'name': 'MY_POD_IP',
                                                         'value': None,
                                                         'value_from': {'config_map_key_ref': None,
                                                                        'field_ref': {'api_version': 'v1',
                                                                                      'field_path': 'status.podIP'},
                                                                        'resource_field_ref': None,
                                                                        'secret_key_ref': None}}],
                                                'env_from': [{'config_map_ref': {'name': 'env-vars',
                                                                                 'optional': None},
                                                              'prefix': None,
                                                              'secret_ref': None}],
                                                'image': 'ollivier/clearwater-ellis:latest',
                                                'image_pull_policy': 'Always',
                                                'lifecycle': None,
                                                'liveness_probe': {'_exec': None,
                                                                   'failure_threshold': 3,
                                                                   'http_get': None,
                                                                   'initial_delay_seconds': 30,
                                                                   'period_seconds': 10,
                                                                   'success_threshold': 1,
                                                                   'tcp_socket': {'host': None,
                                                                                  'port': 80},
                                                                   'timeout_seconds': 1},
                                                'name': 'ellis',
                                                'ports': [{'container_port': 22,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'},
                                                          {'container_port': 80,
                                                           'host_ip': None,
                                                           'host_port': None,
                                                           'name': None,
                                                           'protocol': 'TCP'}],
                                                'readiness_probe': {'_exec': None,
                                                                    'failure_threshold': 3,
                                                                    'http_get': None,
                                                                    'initial_delay_seconds': None,
                                                                    'period_seconds': 10,
                                                                    'success_threshold': 1,
                                                                    'tcp_socket': {'host': None,
                                                                                   'port': 80},
                                                                    'timeout_seconds': 1},
                                                'resources': {'limits': None,
                                                              'requests': None},
                                                'security_context': None,
                                                'stdin': None,
                                                'stdin_once': None,
                                                'termination_message_path': '/dev/termination-log',
                                                'termination_message_policy': 'File',
                                                'tty': None,
                                                'volume_devices': None,
                                                'volume_mounts': None,
                                                'working_dir': None}],
                                'dns_config': None,
                                'dns_policy': 'ClusterFirst',
                                'enable_service_links': None,
                                'host_aliases': None,
                                'host_ipc': None,
                                'host_network': None,
                                'host_pid': None,
                                'hostname': None,
                                'image_pull_secrets': [{'name': None}],
                                'init_containers': [{'args': None,
                                                     'command': ['sh',
                                                                 '-c',
                                                                 'until '
                                                                 'nslookup '
                                                                 'homestead-prov; '
                                                                 'do echo '
                                                                 'waiting for '
                                                                 'homestead-prov '
                                                                 'to start '
                                                                 '...; sleep '
                                                                 '2; done'],
                                                     'env': None,
                                                     'env_from': None,
                                                     'image': 'busybox:1.28',
                                                     'image_pull_policy': 'IfNotPresent',
                                                     'lifecycle': None,
                                                     'liveness_probe': None,
                                                     'name': 'wait-on-homestead-prov',
                                                     'ports': None,
                                                     'readiness_probe': None,
                                                     'resources': {'limits': None,
                                                                   'requests': None},
                                                     'security_context': None,
                                                     'stdin': None,
                                                     'stdin_once': None,
                                                     'termination_message_path': '/dev/termination-log',
                                                     'termination_message_policy': 'File',
                                                     'tty': None,
                                                     'volume_devices': None,
                                                     'volume_mounts': None,
                                                     'working_dir': None},
                                                    {'args': None,
                                                     'command': ['sh',
                                                                 '-c',
                                                                 'until '
                                                                 'nslookup '
                                                                 'sprout; do '
                                                                 'echo waiting '
                                                                 'for sprout '
                                                                 'to start '
                                                                 '...; sleep '
                                                                 '2; done'],
                                                     'env': None,
                                                     'env_from': None,
                                                     'image': 'busybox:1.28',
                                                     'image_pull_policy': 'IfNotPresent',
                                                     'lifecycle': None,
                                                     'liveness_probe': None,
                                                     'name': 'wait-on-sprout',
                                                     'ports': None,
                                                     'readiness_probe': None,
                                                     'resources': {'limits': None,
                                                                   'requests': None},
                                                     'security_context': None,
                                                     'stdin': None,
                                                     'stdin_once': None,
                                                     'termination_message_path': '/dev/termination-log',
                                                     'termination_message_policy': 'File',
                                                     'tty': None,
                                                     'volume_devices': None,
                                                     'volume_mounts': None,
                                                     'working_dir': None}],
                                'node_name': None,
                                'node_selector': None,
                                'priority': None,
                                'priority_class_name': None,
                                'readiness_gates': None,
                                'restart_policy': 'Always',
                                'runtime_class_name': None,
                                'scheduler_name': 'default-scheduler',
                                'security_context': {'fs_group': None,
                                                     'run_as_group': None,
                                                     'run_as_non_root': None,
                                                     'run_as_user': None,
                                                     'se_linux_options': None,
                                                     'supplemental_groups': None,
                                                     'sysctls': None},
                                'service_account': None,
                                'service_account_name': None,
                                'share_process_namespace': None,
                                'subdomain': None,
                                'termination_grace_period_seconds': 30,
                                'tolerations': None,
                                'volumes': None}}},
 'status': {'available_replicas': 1,
            'collision_count': None,
            'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 19, 4, 7, 28, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 4, 7, 28, tzinfo=tzlocal()),
                            'message': 'Deployment has minimum availability.',
                            'reason': 'MinimumReplicasAvailable',
                            'status': 'True',
                            'type': 'Available'},
                           {'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
                            'last_update_time': datetime.datetime(2020, 8, 19, 4, 7, 28, tzinfo=tzlocal()),
                            'message': 'ReplicaSet "ellis-57b84b6dd7" has '
                                       'successfully progressed.',
                            'reason': 'NewReplicaSetAvailable',
                            'status': 'True',
                            'type': 'Progressing'}],
            'observed_generation': 1,
            'ready_replicas': 1,
            'replicas': 1,
            'unavailable_replicas': None,
            'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'ellis', 'namespace': 'ims-h4q84', 'selfLink': '/apis/apps/v1/namespaces/ims-h4q84/deployments/ellis', 'uid': '1489ad06-8c54-4f56-a6b8-5cfd2daffb39', 'resourceVersion': '982348', 'generation': 1, 'creationTimestamp': '2020-08-19T03:59:40Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'ellis'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'ellis'}}, 'spec': {'initContainers': [{'name': 'wait-on-homestead-prov', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead-prov; do echo waiting for homestead-prov to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'ellis', 'image': 'ollivier/clearwater-ellis:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 80, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'tcpSocket': {'port': 80}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 80}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-08-19T04:07:28Z', 'lastTransitionTime': '2020-08-19T04:07:28Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-19T04:07:28Z', 'lastTransitionTime': '2020-08-19T03:59:40Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "ellis-57b84b6dd7" has successfully progressed.'}]}}}
2020-08-19 04:07:28,645 - functest_kubernetes.ims.ims - INFO - ellis started in 469.36 sec
2020-08-19 04:08:28,730 - kubernetes.client.rest - DEBUG - response body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"live-test","namespace":"ims-h4q84","selfLink":"/api/v1/namespaces/ims-h4q84/pods/live-test","uid":"487f89c4-432e-4517-95a8-5cd68e775399","resourceVersion":"982467","creationTimestamp":"2020-08-19T04:08:28Z"},"spec":{"volumes":[{"name":"default-token-8x245","secret":{"secretName":"default-token-8x245","defaultMode":420}}],"containers":[{"name":"live-test","image":"ollivier/clearwater-live-test:latest","command":["rake","test[ims-h4q84.svc.cluster.local]","PROXY=bono.ims-h4q84.svc.cluster.local","ELLIS=ellis.ims-h4q84.svc.cluster.local","SIGNUP_CODE=secret","--trace"],"resources":{},"volumeMounts":[{"name":"default-token-8x245","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"restartPolicy":"Never","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Pending","qosClass":"BestEffort"}}

2020-08-19 04:08:28,789 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1',
 'kind': 'Pod',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 39, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': 'astaire-5ddcdd6b7f-',
              'generation': None,
              'initializers': None,
              'labels': {'pod-template-hash': '5ddcdd6b7f',
                         'service': 'astaire'},
              'managed_fields': None,
              'name': 'astaire-5ddcdd6b7f-kqrvm',
              'namespace': 'ims-h4q84',
              'owner_references': [{'api_version': 'apps/v1',
                                    'block_owner_deletion': True,
                                    'controller': True,
                                    'kind': 'ReplicaSet',
                                    'name': 'astaire-5ddcdd6b7f',
                                    'uid': 'e60e6664-b4a8-47c2-9fba-5a5b0107e21e'}],
              'resource_version': '981730',
              'self_link': '/api/v1/namespaces/ims-h4q84/pods/astaire-5ddcdd6b7f-kqrvm',
              'uid': 'a76db44f-c161-4cba-ac9e-14d6fd32c28f'},
 'spec': {'active_deadline_seconds': None,
          'affinity': None,
          'automount_service_account_token': None,
          'containers': [{'args': None,
                          'command': None,
                          'env': [{'name': 'MY_POD_IP',
                                   'value': None,
                                   'value_from': {'config_map_key_ref': None,
                                                  'field_ref': {'api_version': 'v1',
                                                                'field_path': 'status.podIP'},
                                                  'resource_field_ref': None,
                                                  'secret_key_ref': None}}],
                          'env_from': [{'config_map_ref': {'name': 'env-vars',
                                                           'optional': None},
                                        'prefix': None,
                                        'secret_ref': None}],
                          'image': 'ollivier/clearwater-astaire:latest',
                          'image_pull_policy': 'Always',
                          'lifecycle': {'post_start': None,
                                        'pre_stop': {'_exec': {'command': ['/bin/bash',
                                                                           '-c',
                                                                           '/usr/bin/pre-stop']},
                                                     'http_get': None,
                                                     'tcp_socket': None}},
                          'liveness_probe': {'_exec': None,
                                             'failure_threshold': 9,
                                             'http_get': None,
                                             'initial_delay_seconds': None,
                                             'period_seconds': 10,
                                             'success_threshold': 1,
                                             'tcp_socket': {'host': None,
                                                            'port': 11311},
                                             'timeout_seconds': 1},
                          'name': 'astaire',
                          'ports': [{'container_port': 22,
                                     'host_ip': None,
                                     'host_port': None,
                                     'name': None,
                                     'protocol': 'TCP'},
                                    {'container_port': 11211,
                                     'host_ip': None,
                                     'host_port': None,
                                     'name': None,
                                     'protocol': 'TCP'},
                                    {'container_port': 11311,
                                     'host_ip': None,
                                     'host_port': None,
                                     'name': None,
                                     'protocol': 'TCP'}],
                          'readiness_probe': {'_exec': None,
                                              'failure_threshold': 3,
                                              'http_get': None,
                                              'initial_delay_seconds': None,
                                              'period_seconds': 10,
                                              'success_threshold': 1,
                                              'tcp_socket': {'host': None,
                                                             'port': 11311},
                                              'timeout_seconds': 1},
                          'resources': {'limits': None, 'requests': None},
                          'security_context': None,
                          'stdin': None,
                          'stdin_once': None,
                          'termination_message_path': '/dev/termination-log',
                          'termination_message_policy': 'File',
                          'tty': None,
                          'volume_devices': None,
                          'volume_mounts': [{'mount_path': '/var/log/astaire',
                                             'mount_propagation': None,
                                             'name': 'astairelogs',
                                             'read_only': None,
                                             'sub_path': None,
                                             'sub_path_expr': None},
                                            {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
                                             'mount_propagation': None,
                                             'name': 'default-token-8x245',
                                             'read_only': True,
                                             'sub_path': None,
                                             'sub_path_expr': None}],
                          'working_dir': None},
                         {'args': None,
                          'command': ['tail',
                                      '-F',
                                      '/var/log/astaire/astaire_current.txt'],
                          'env': None,
                          'env_from': None,
                          'image': 'busybox',
                          'image_pull_policy': 'Always',
                          'lifecycle': None,
                          'liveness_probe': None,
                          'name': 'tailer',
                          'ports': None,
                          'readiness_probe': None,
                          'resources': {'limits': None, 'requests': None},
                          'security_context': None,
                          'stdin': None,
                          'stdin_once': None,
                          'termination_message_path': '/dev/termination-log',
                          'termination_message_policy': 'File',
                          'tty': None,
                          'volume_devices': None,
                          'volume_mounts': [{'mount_path': '/var/log/astaire',
                                             'mount_propagation': None,
                                             'name': 'astairelogs',
                                             'read_only': None,
                                             'sub_path': None,
                                             'sub_path_expr': None},
                                            {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
                                             'mount_propagation': None,
                                             'name': 'default-token-8x245',
                                             'read_only': True,
                                             'sub_path': None,
                                             'sub_path_expr': None}],
                          'working_dir': None}],
          'dns_config': None,
          'dns_policy': 'ClusterFirst',
          'enable_service_links': True,
          'host_aliases': None,
          'host_ipc': None,
          'host_network': None,
          'host_pid': None,
          'hostname': None,
          'image_pull_secrets': [{'name': None}],
          'init_containers': [{'args': None,
                               'command': ['sh',
                                           '-c',
                                           'until nslookup cassandra; do echo '
                                           'waiting for cassandra to start '
                                           '...; sleep 2; done'],
                               'env': None,
                               'env_from': None,
                               'image': 'busybox:1.28',
                               'image_pull_policy': 'IfNotPresent',
                               'lifecycle': None,
                               'liveness_probe': None,
                               'name': 'wait-on-cassandra',
                               'ports': None,
                               'readiness_probe': None,
                               'resources': {'limits': None, 'requests': None},
                               'security_context': None,
                               'stdin': None,
                               'stdin_once': None,
                               'termination_message_path': '/dev/termination-log',
                               'termination_message_policy': 'File',
                               'tty': None,
                               'volume_devices': None,
                               'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
                                                  'mount_propagation': None,
                                                  'name': 'default-token-8x245',
                                                  'read_only': True,
                                                  'sub_path': None,
                                                  'sub_path_expr': None}],
                               'working_dir': None}],
          'node_name': 'iruya-worker',
          'node_selector': None,
          'priority': 0,
          'priority_class_name': None,
          'readiness_gates': None,
          'restart_policy': 'Always',
          'runtime_class_name': None,
          'scheduler_name': 'default-scheduler',
          'security_context': {'fs_group': None,
                               'run_as_group': None,
                               'run_as_non_root': None,
                               'run_as_user': None,
                               'se_linux_options': None,
                               'supplemental_groups': None,
                               'sysctls': None},
          'service_account': 'default',
          'service_account_name': 'default',
          'share_process_namespace': None,
          'subdomain': None,
          'termination_grace_period_seconds': 120,
          'tolerations': [{'effect': 'NoExecute',
                           'key': 'node.kubernetes.io/not-ready',
                           'operator': 'Exists',
                           'toleration_seconds': 300,
                           'value': None},
                          {'effect': 'NoExecute',
                           'key': 'node.kubernetes.io/unreachable',
                           'operator': 'Exists',
                           'toleration_seconds': 300,
                           'value': None}],
          'volumes': [{'aws_elastic_block_store': None,
                       'azure_disk': None,
                       'azure_file': None,
                       'cephfs': None,
                       'cinder': None,
                       'config_map': None,
                       'csi': None,
                       'downward_api': None,
                       'empty_dir': {'medium': None, 'size_limit': None},
                       'fc': None,
                       'flex_volume': None,
                       'flocker': None,
                       'gce_persistent_disk': None,
                       'git_repo': None,
                       'glusterfs': None,
                       'host_path': None,
                       'iscsi': None,
                       'name': 'astairelogs',
                       'nfs': None,
                       'persistent_volume_claim': None,
                       'photon_persistent_disk': None,
                       'portworx_volume': None,
                       'projected': None,
                       'quobyte': None,
                       'rbd': None,
                       'scale_io': None,
                       'secret': None,
                       'storageos': None,
                       'vsphere_volume': None},
                      {'aws_elastic_block_store': None,
                       'azure_disk': None,
                       'azure_file': None,
                       'cephfs': None,
                       'cinder': None,
                       'config_map': None,
                       'csi': None,
                       'downward_api': None,
                       'empty_dir': None,
                       'fc': None,
                       'flex_volume': None,
                       'flocker': None,
                       'gce_persistent_disk': None,
                       'git_repo': None,
                       'glusterfs': None,
                       'host_path': None,
                       'iscsi': None,
                       'name': 'default-token-8x245',
                       'nfs': None,
                       'persistent_volume_claim': None,
                       'photon_persistent_disk': None,
                       'portworx_volume': None,
                       'projected': None,
                       'quobyte': None,
                       'rbd': None,
                       'scale_io': None,
                       'secret': {'default_mode': 420,
                                  'items': None,
                                  'optional': None,
                                  'secret_name': 'default-token-8x245'},
                       'storageos': None,
                       'vsphere_volume': None}]},
 'status': {'conditions': [{'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 1, 54, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'Initialized'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 2, 56, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'Ready'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 2, 56, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'ContainersReady'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 39, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'PodScheduled'}],
            'container_statuses': [{'container_id': 'containerd://b854210963f6287bdeea2164dc336d3be888f3ec93cc9b67aced637423c64419',
                                    'image': 'docker.io/ollivier/clearwater-astaire:latest',
                                    'image_id': 'docker.io/ollivier/clearwater-astaire@sha256:eb85c150a60609d7b22b70b99d6a1a7a1c035fd64e30cca203a8b8d167bb7938',
                                    'last_state': {'running': None,
                                                   'terminated': None,
                                                   'waiting': None},
                                    'name': 'astaire',
                                    'ready': True,
                                    'restart_count': 0,
                                    'state': {'running': {'started_at': datetime.datetime(2020, 8, 19, 4, 2, 4, tzinfo=tzlocal())},
                                              'terminated': None,
                                              'waiting': None}},
                                   {'container_id': 'containerd://ad620e118b6d8d37bb7dfa9eb230c3b6b6e36653345732694f22e5f0d183564e',
                                    'image': 'docker.io/library/busybox:latest',
                                    'image_id': 'docker.io/library/busybox@sha256:4f47c01fa91355af2865ac10fef5bf6ec9c7f42ad2321377c21e844427972977',
                                    'last_state': {'running': None,
                                                   'terminated': None,
                                                   'waiting': None},
                                    'name': 'tailer',
                                    'ready': True,
                                    'restart_count': 0,
                                    'state': {'running': {'started_at': datetime.datetime(2020, 8, 19, 4, 2, 8, tzinfo=tzlocal())},
                                              'terminated': None,
                                              'waiting': None}}],
            'host_ip': '172.18.0.9',
            'init_container_statuses': [{'container_id': 'containerd://294b3ffba804d9be462d7d1378f4af69559e7c263446ca286100223c305ee43a',
                                         'image': 'docker.io/library/busybox:1.28',
                                         'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47',
                                         'last_state': {'running': None,
                                                        'terminated': None,
                                                        'waiting': None},
                                         'name': 'wait-on-cassandra',
                                         'ready': True,
                                         'restart_count': 0,
                                         'state': {'running': None,
                                                   'terminated': {'container_id': 'containerd://294b3ffba804d9be462d7d1378f4af69559e7c263446ca286100223c305ee43a',
                                                                  'exit_code': 0,
                                                                  'finished_at': datetime.datetime(2020, 8, 19, 4, 1, 53, tzinfo=tzlocal()),
                                                                  'message': None,
                                                                  'reason': 'Completed',
                                                                  'signal': None,
                                                                  'started_at': datetime.datetime(2020, 8, 19, 3, 59, 47, tzinfo=tzlocal())},
                                                   'waiting': None}}],
            'message': None,
            'nominated_node_name': None,
            'phase': 'Running',
            'pod_ip': '10.244.1.124',
            'qos_class': 'BestEffort',
            'reason': None,
            'start_time': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'astaire-5ddcdd6b7f-kqrvm', 'generateName': 'astaire-5ddcdd6b7f-', 'namespace': 'ims-h4q84', 'selfLink': '/api/v1/namespaces/ims-h4q84/pods/astaire-5ddcdd6b7f-kqrvm', 'uid': 'a76db44f-c161-4cba-ac9e-14d6fd32c28f', 'resourceVersion': '981730', 'creationTimestamp': '2020-08-19T03:59:39Z', 'labels': {'pod-template-hash': '5ddcdd6b7f', 'service': 'astaire'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'astaire-5ddcdd6b7f', 'uid': 'e60e6664-b4a8-47c2-9fba-5a5b0107e21e', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'astairelogs', 'emptyDir': {}}, {'name': 'default-token-8x245', 'secret': {'secretName': 'default-token-8x245', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-8x245', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'astaire', 'image': 'ollivier/clearwater-astaire:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 11211, 'protocol': 'TCP'}, {'containerPort': 11311, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'astairelogs', 'mountPath': '/var/log/astaire'}, {'name': 'default-token-8x245', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'tcpSocket': {'port': 11311}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 9}, 'readinessProbe': {'tcpSocket': {'port': 11311}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'lifecycle': {'preStop': {'exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}}}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/astaire/astaire_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'astairelogs', 'mountPath': '/var/log/astaire'}, {'name': 'default-token-8x245', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 120, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:01:54Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:02:56Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:02:56Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T03:59:39Z'}], 'hostIP': '172.18.0.9', 'podIP': '10.244.1.124', 'startTime': '2020-08-19T03:59:40Z', 'initContainerStatuses': [{'name': 'wait-on-cassandra', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-08-19T03:59:47Z', 'finishedAt': '2020-08-19T04:01:53Z', 'containerID': 'containerd://294b3ffba804d9be462d7d1378f4af69559e7c263446ca286100223c305ee43a'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://294b3ffba804d9be462d7d1378f4af69559e7c263446ca286100223c305ee43a'}], 'containerStatuses': [{'name': 'astaire', 'state': {'running': {'startedAt': '2020-08-19T04:02:04Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-astaire:latest', 'imageID': 'docker.io/ollivier/clearwater-astaire@sha256:eb85c150a60609d7b22b70b99d6a1a7a1c035fd64e30cca203a8b8d167bb7938', 'containerID': 'containerd://b854210963f6287bdeea2164dc336d3be888f3ec93cc9b67aced637423c64419'}, {'name': 'tailer', 'state': {'running': {'startedAt': '2020-08-19T04:02:08Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:latest', 'imageID': 'docker.io/library/busybox@sha256:4f47c01fa91355af2865ac10fef5bf6ec9c7f42ad2321377c21e844427972977', 'containerID': 'containerd://ad620e118b6d8d37bb7dfa9eb230c3b6b6e36653345732694f22e5f0d183564e'}], 'qosClass': 'BestEffort'}}}
2020-08-19 04:08:29,112 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1',
 'kind': 'Pod',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 4, 8, 28, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': None,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'live-test',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '982467',
              'self_link': '/api/v1/namespaces/ims-h4q84/pods/live-test',
              'uid': '487f89c4-432e-4517-95a8-5cd68e775399'},
 'spec': {'active_deadline_seconds': None,
          'affinity': None,
          'automount_service_account_token': None,
          'containers': [{'args': None,
                          'command': ['rake',
                                      'test[ims-h4q84.svc.cluster.local]',
                                      'PROXY=bono.ims-h4q84.svc.cluster.local',
                                      'ELLIS=ellis.ims-h4q84.svc.cluster.local',
                                      'SIGNUP_CODE=secret',
                                      '--trace'],
                          'env': None,
                          'env_from': None,
                          'image': 'ollivier/clearwater-live-test:latest',
                          'image_pull_policy': 'Always',
                          'lifecycle': None,
                          'liveness_probe': None,
                          'name': 'live-test',
                          'ports': None,
                          'readiness_probe': None,
                          'resources': {'limits': None, 'requests': None},
                          'security_context': None,
                          'stdin': None,
                          'stdin_once': None,
                          'termination_message_path': '/dev/termination-log',
                          'termination_message_policy': 'File',
                          'tty': None,
                          'volume_devices': None,
                          'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
                                             'mount_propagation': None,
                                             'name': 'default-token-8x245',
                                             'read_only': True,
                                             'sub_path': None,
                                             'sub_path_expr': None}],
                          'working_dir': None}],
          'dns_config': None,
          'dns_policy': 'ClusterFirst',
          'enable_service_links': True,
          'host_aliases': None,
          'host_ipc': None,
          'host_network': None,
          'host_pid': None,
          'hostname': None,
          'image_pull_secrets': None,
          'init_containers': None,
          'node_name': None,
          'node_selector': None,
          'priority': 0,
          'priority_class_name': None,
          'readiness_gates': None,
          'restart_policy': 'Never',
          'runtime_class_name': None,
          'scheduler_name': 'default-scheduler',
          'security_context': {'fs_group': None,
                               'run_as_group': None,
                               'run_as_non_root': None,
                               'run_as_user': None,
                               'se_linux_options': None,
                               'supplemental_groups': None,
                               'sysctls': None},
          'service_account': 'default',
          'service_account_name': 'default',
          'share_process_namespace': None,
          'subdomain': None,
          'termination_grace_period_seconds': 30,
          'tolerations': [{'effect': 'NoExecute',
                           'key': 'node.kubernetes.io/not-ready',
                           'operator': 'Exists',
                           'toleration_seconds': 300,
                           'value': None},
                          {'effect': 'NoExecute',
                           'key': 'node.kubernetes.io/unreachable',
                           'operator': 'Exists',
                           'toleration_seconds': 300,
                           'value': None}],
          'volumes': [{'aws_elastic_block_store': None,
                       'azure_disk': None,
                       'azure_file': None,
                       'cephfs': None,
                       'cinder': None,
                       'config_map': None,
                       'csi': None,
                       'downward_api': None,
                       'empty_dir': None,
                       'fc': None,
                       'flex_volume': None,
                       'flocker': None,
                       'gce_persistent_disk': None,
                       'git_repo': None,
                       'glusterfs': None,
                       'host_path': None,
                       'iscsi': None,
                       'name': 'default-token-8x245',
                       'nfs': None,
                       'persistent_volume_claim': None,
                       'photon_persistent_disk': None,
                       'portworx_volume': None,
                       'projected': None,
                       'quobyte': None,
                       'rbd': None,
                       'scale_io': None,
                       'secret': {'default_mode': 420,
                                  'items': None,
                                  'optional': None,
                                  'secret_name': 'default-token-8x245'},
                       'storageos': None,
                       'vsphere_volume': None}]},
 'status': {'conditions': None,
            'container_statuses': None,
            'host_ip': None,
            'init_container_statuses': None,
            'message': None,
            'nominated_node_name': None,
            'phase': 'Pending',
            'pod_ip': None,
            'qos_class': 'BestEffort',
            'reason': None,
            'start_time': None}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test', 'namespace': 'ims-h4q84', 'selfLink': '/api/v1/namespaces/ims-h4q84/pods/live-test', 'uid': '487f89c4-432e-4517-95a8-5cd68e775399', 'resourceVersion': '982467', 'creationTimestamp': '2020-08-19T04:08:28Z'}, 'spec': {'volumes': [{'name': 'default-token-8x245', 'secret': {'secretName': 'default-token-8x245', 'defaultMode': 420}}], 'containers': [{'name': 'live-test', 'image': 'ollivier/clearwater-live-test:latest', 'command': ['rake', 'test[ims-h4q84.svc.cluster.local]', 'PROXY=bono.ims-h4q84.svc.cluster.local', 'ELLIS=ellis.ims-h4q84.svc.cluster.local', 'SIGNUP_CODE=secret', '--trace'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-8x245', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Never', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Pending', 'qosClass': 'BestEffort'}}}
2020-08-19 04:08:29,262 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1',
 'kind': 'Pod',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': 'ellis-57b84b6dd7-',
              'generation': None,
              'initializers': None,
              'labels': {'pod-template-hash': '57b84b6dd7', 'service': 'ellis'},
              'managed_fields': None,
              'name': 'ellis-57b84b6dd7-nqshs',
              'namespace': 'ims-h4q84',
              'owner_references': [{'api_version': 'apps/v1',
                                    'block_owner_deletion': True,
                                    'controller': True,
                                    'kind': 'ReplicaSet',
                                    'name': 'ellis-57b84b6dd7',
                                    'uid': 'cf4e0198-cf96-46b7-b60a-7e9d80cfee12'}],
              'resource_version': '982345',
              'self_link': '/api/v1/namespaces/ims-h4q84/pods/ellis-57b84b6dd7-nqshs',
              'uid': 'fcfc27a8-62c0-49a4-a29b-94e63baaa70a'},
 'spec': {'active_deadline_seconds': None,
          'affinity': None,
          'automount_service_account_token': None,
          'containers': [{'args': None,
                          'command': None,
                          'env': [{'name': 'MY_POD_IP',
                                   'value': None,
                                   'value_from': {'config_map_key_ref': None,
                                                  'field_ref': {'api_version': 'v1',
                                                                'field_path': 'status.podIP'},
                                                  'resource_field_ref': None,
                                                  'secret_key_ref': None}}],
                          'env_from': [{'config_map_ref': {'name': 'env-vars',
                                                           'optional': None},
                                        'prefix': None,
                                        'secret_ref': None}],
                          'image': 'ollivier/clearwater-ellis:latest',
                          'image_pull_policy': 'Always',
                          'lifecycle': None,
                          'liveness_probe': {'_exec': None,
                                             'failure_threshold': 3,
                                             'http_get': None,
                                             'initial_delay_seconds': 30,
                                             'period_seconds': 10,
                                             'success_threshold': 1,
                                             'tcp_socket': {'host': None,
                                                            'port': 80},
                                             'timeout_seconds': 1},
                          'name': 'ellis',
                          'ports': [{'container_port': 22,
                                     'host_ip': None,
                                     'host_port': None,
                                     'name': None,
                                     'protocol': 'TCP'},
                                    {'container_port': 80,
                                     'host_ip': None,
                                     'host_port': None,
                                     'name': None,
                                     'protocol': 'TCP'}],
                          'readiness_probe': {'_exec': None,
                                              'failure_threshold': 3,
                                              'http_get': None,
                                              'initial_delay_seconds': None,
                                              'period_seconds': 10,
                                              'success_threshold': 1,
                                              'tcp_socket': {'host': None,
                                                             'port': 80},
                                              'timeout_seconds': 1},
                          'resources': {'limits': None, 'requests': None},
                          'security_context': None,
                          'stdin': None,
                          'stdin_once': None,
                          'termination_message_path': '/dev/termination-log',
                          'termination_message_policy': 'File',
                          'tty': None,
                          'volume_devices': None,
                          'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
                                             'mount_propagation': None,
                                             'name': 'default-token-8x245',
                                             'read_only': True,
                                             'sub_path': None,
                                             'sub_path_expr': None}],
                          'working_dir': None}],
          'dns_config': None,
          'dns_policy': 'ClusterFirst',
          'enable_service_links': True,
          'host_aliases': None,
          'host_ipc': None,
          'host_network': None,
          'host_pid': None,
          'hostname': None,
          'image_pull_secrets': [{'name': None}],
          'init_containers': [{'args': None,
                               'command': ['sh',
                                           '-c',
                                           'until nslookup homestead-prov; do '
                                           'echo waiting for homestead-prov to '
                                           'start ...; sleep 2; done'],
                               'env': None,
                               'env_from': None,
                               'image': 'busybox:1.28',
                               'image_pull_policy': 'IfNotPresent',
                               'lifecycle': None,
                               'liveness_probe': None,
                               'name': 'wait-on-homestead-prov',
                               'ports': None,
                               'readiness_probe': None,
                               'resources': {'limits': None, 'requests': None},
                               'security_context': None,
                               'stdin': None,
                               'stdin_once': None,
                               'termination_message_path': '/dev/termination-log',
                               'termination_message_policy': 'File',
                               'tty': None,
                               'volume_devices': None,
                               'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
                                                  'mount_propagation': None,
                                                  'name': 'default-token-8x245',
                                                  'read_only': True,
                                                  'sub_path': None,
                                                  'sub_path_expr': None}],
                               'working_dir': None},
                              {'args': None,
                               'command': ['sh',
                                           '-c',
                                           'until nslookup sprout; do echo '
                                           'waiting for sprout to start ...; '
                                           'sleep 2; done'],
                               'env': None,
                               'env_from': None,
                               'image': 'busybox:1.28',
                               'image_pull_policy': 'IfNotPresent',
                               'lifecycle': None,
                               'liveness_probe': None,
                               'name': 'wait-on-sprout',
                               'ports': None,
                               'readiness_probe': None,
                               'resources': {'limits': None, 'requests': None},
                               'security_context': None,
                               'stdin': None,
                               'stdin_once': None,
                               'termination_message_path': '/dev/termination-log',
                               'termination_message_policy': 'File',
                               'tty': None,
                               'volume_devices': None,
                               'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
                                                  'mount_propagation': None,
                                                  'name': 'default-token-8x245',
                                                  'read_only': True,
                                                  'sub_path': None,
                                                  'sub_path_expr': None}],
                               'working_dir': None}],
          'node_name': 'iruya-worker',
          'node_selector': None,
          'priority': 0,
          'priority_class_name': None,
          'readiness_gates': None,
          'restart_policy': 'Always',
          'runtime_class_name': None,
          'scheduler_name': 'default-scheduler',
          'security_context': {'fs_group': None,
                               'run_as_group': None,
                               'run_as_non_root': None,
                               'run_as_user': None,
                               'se_linux_options': None,
                               'supplemental_groups': None,
                               'sysctls': None},
          'service_account': 'default',
          'service_account_name': 'default',
          'share_process_namespace': None,
          'subdomain': None,
          'termination_grace_period_seconds': 30,
          'tolerations': [{'effect': 'NoExecute',
                           'key': 'node.kubernetes.io/not-ready',
                           'operator': 'Exists',
                           'toleration_seconds': 300,
                           'value': None},
                          {'effect': 'NoExecute',
                           'key': 'node.kubernetes.io/unreachable',
                           'operator': 'Exists',
                           'toleration_seconds': 300,
                           'value': None}],
          'volumes': [{'aws_elastic_block_store': None,
                       'azure_disk': None,
                       'azure_file': None,
                       'cephfs': None,
                       'cinder': None,
                       'config_map': None,
                       'csi': None,
                       'downward_api': None,
                       'empty_dir': None,
                       'fc': None,
                       'flex_volume': None,
                       'flocker': None,
                       'gce_persistent_disk': None,
                       'git_repo': None,
                       'glusterfs': None,
                       'host_path': None,
                       'iscsi': None,
                       'name': 'default-token-8x245',
                       'nfs': None,
                       'persistent_volume_claim': None,
                       'photon_persistent_disk': None,
                       'portworx_volume': None,
                       'projected': None,
                       'quobyte': None,
                       'rbd': None,
                       'scale_io': None,
                       'secret': {'default_mode': 420,
                                  'items': None,
                                  'optional': None,
                                  'secret_name': 'default-token-8x245'},
                       'storageos': None,
                       'vsphere_volume': None}]},
 'status': {'conditions': [{'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 7, 15, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'Initialized'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 7, 28, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'Ready'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 7, 28, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'ContainersReady'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'PodScheduled'}],
            'container_statuses': [{'container_id': 'containerd://b3a0e249afe5cc8924765c3071282bab9c657c8b8df2573368a02335bd536bac',
                                    'image': 'docker.io/ollivier/clearwater-ellis:latest',
                                    'image_id': 'docker.io/ollivier/clearwater-ellis@sha256:28557b896e190c72f02121314ca7c9abaca30f91a733b566b2c44b761e5a252c',
                                    'last_state': {'running': None,
                                                   'terminated': None,
                                                   'waiting': None},
                                    'name': 'ellis',
                                    'ready': True,
                                    'restart_count': 0,
                                    'state': {'running': {'started_at': datetime.datetime(2020, 8, 19, 4, 7, 20, tzinfo=tzlocal())},
                                              'terminated': None,
                                              'waiting': None}}],
            'host_ip': '172.18.0.9',
            'init_container_statuses': [{'container_id': 'containerd://bbe1916f01ec59eed52ae8289020bec3a3d8d1110ae2366cf9a00c41934ae00d',
                                         'image': 'docker.io/library/busybox:1.28',
                                         'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47',
                                         'last_state': {'running': None,
                                                        'terminated': None,
                                                        'waiting': None},
                                         'name': 'wait-on-homestead-prov',
                                         'ready': True,
                                         'restart_count': 0,
                                         'state': {'running': None,
                                                   'terminated': {'container_id': 'containerd://bbe1916f01ec59eed52ae8289020bec3a3d8d1110ae2366cf9a00c41934ae00d',
                                                                  'exit_code': 0,
                                                                  'finished_at': datetime.datetime(2020, 8, 19, 4, 7, 11, tzinfo=tzlocal()),
                                                                  'message': None,
                                                                  'reason': 'Completed',
                                                                  'signal': None,
                                                                  'started_at': datetime.datetime(2020, 8, 19, 3, 59, 51, tzinfo=tzlocal())},
                                                   'waiting': None}},
                                        {'container_id': 'containerd://f07e698e80c3f455ed07bdcec32990ec2d4740b5ac9e1a6ef5e5866741a170c4',
                                         'image': 'docker.io/library/busybox:1.28',
                                         'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47',
                                         'last_state': {'running': None,
                                                        'terminated': None,
                                                        'waiting': None},
                                         'name': 'wait-on-sprout',
                                         'ready': True,
                                         'restart_count': 0,
                                         'state': {'running': None,
                                                   'terminated': {'container_id': 'containerd://f07e698e80c3f455ed07bdcec32990ec2d4740b5ac9e1a6ef5e5866741a170c4',
                                                                  'exit_code': 0,
                                                                  'finished_at': datetime.datetime(2020, 8, 19, 4, 7, 14, tzinfo=tzlocal()),
                                                                  'message': None,
                                                                  'reason': 'Completed',
                                                                  'signal': None,
                                                                  'started_at': datetime.datetime(2020, 8, 19, 4, 7, 14, tzinfo=tzlocal())},
                                                   'waiting': None}}],
            'message': None,
            'nominated_node_name': None,
            'phase': 'Running',
            'pod_ip': '10.244.1.125',
            'qos_class': 'BestEffort',
            'reason': None,
            'start_time': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'ellis-57b84b6dd7-nqshs', 'generateName': 'ellis-57b84b6dd7-', 'namespace': 'ims-h4q84', 'selfLink': '/api/v1/namespaces/ims-h4q84/pods/ellis-57b84b6dd7-nqshs', 'uid': 'fcfc27a8-62c0-49a4-a29b-94e63baaa70a', 'resourceVersion': '982345', 'creationTimestamp': '2020-08-19T03:59:40Z', 'labels': {'pod-template-hash': '57b84b6dd7', 'service': 'ellis'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'ellis-57b84b6dd7', 'uid': 'cf4e0198-cf96-46b7-b60a-7e9d80cfee12', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-8x245', 'secret': {'secretName': 'default-token-8x245', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-homestead-prov', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead-prov; do echo waiting for homestead-prov to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-8x245', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-8x245', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'ellis', 'image': 'ollivier/clearwater-ellis:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 80, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'default-token-8x245', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'tcpSocket': {'port': 80}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 80}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:07:15Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:07:28Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:07:28Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T03:59:40Z'}], 'hostIP': '172.18.0.9', 'podIP': '10.244.1.125', 'startTime': '2020-08-19T03:59:40Z', 'initContainerStatuses': [{'name': 'wait-on-homestead-prov', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-08-19T03:59:51Z', 'finishedAt': '2020-08-19T04:07:11Z', 'containerID': 'containerd://bbe1916f01ec59eed52ae8289020bec3a3d8d1110ae2366cf9a00c41934ae00d'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://bbe1916f01ec59eed52ae8289020bec3a3d8d1110ae2366cf9a00c41934ae00d'}, {'name': 'wait-on-sprout', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-08-19T04:07:14Z', 'finishedAt': '2020-08-19T04:07:14Z', 'containerID': 'containerd://f07e698e80c3f455ed07bdcec32990ec2d4740b5ac9e1a6ef5e5866741a170c4'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://f07e698e80c3f455ed07bdcec32990ec2d4740b5ac9e1a6ef5e5866741a170c4'}], 'containerStatuses': [{'name': 'ellis', 'state': {'running': {'startedAt': '2020-08-19T04:07:20Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-ellis:latest', 'imageID': 'docker.io/ollivier/clearwater-ellis@sha256:28557b896e190c72f02121314ca7c9abaca30f91a733b566b2c44b761e5a252c', 'containerID': 'containerd://b3a0e249afe5cc8924765c3071282bab9c657c8b8df2573368a02335bd536bac'}], 'qosClass': 'BestEffort'}}}
2020-08-19 04:08:29,538 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1',
 'kind': 'Pod',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': 'homestead-prov-756c8bff5d-',
              'generation': None,
              'initializers': None,
              'labels': {'pod-template-hash': '756c8bff5d',
                         'service': 'homestead-prov',
                         'snmp': 'enabled'},
              'managed_fields': None,
              'name': 'homestead-prov-756c8bff5d-ffgwm',
              'namespace': 'ims-h4q84',
              'owner_references': [{'api_version': 'apps/v1',
                                    'block_owner_deletion': True,
                                    'controller': True,
                                    'kind': 'ReplicaSet',
                                    'name': 'homestead-prov-756c8bff5d',
                                    'uid': 'bf620d26-e0f0-4b66-8ad2-a14d10a54e50'}],
              'resource_version': '982287',
              'self_link': '/api/v1/namespaces/ims-h4q84/pods/homestead-prov-756c8bff5d-ffgwm',
              'uid': '8475f021-98fc-4226-9ef2-de327b4f8e57'},
 'spec': {'active_deadline_seconds': None,
          'affinity': None,
          'automount_service_account_token': None,
          'containers': [{'args': None,
                          'command': None,
                          'env': [{'name': 'MY_POD_IP',
                                   'value': None,
                                   'value_from': {'config_map_key_ref': None,
                                                  'field_ref': {'api_version': 'v1',
                                                                'field_path': 'status.podIP'},
                                                  'resource_field_ref': None,
                                                  'secret_key_ref': None}}],
                          'env_from': [{'config_map_ref': {'name': 'env-vars',
                                                           'optional': None},
                                        'prefix': None,
                                        'secret_ref': None}],
                          'image': 'ollivier/clearwater-homestead-prov:latest',
                          'image_pull_policy': 'Always',
                          'lifecycle': None,
                          'liveness_probe': {'_exec': {'command': ['/bin/bash',
                                                                   '/usr/share/clearwater/bin/poll_homestead-prov.sh']},
                                             'failure_threshold': 3,
                                             'http_get': None,
                                             'initial_delay_seconds': 60,
                                             'period_seconds': 10,
                                             'success_threshold': 1,
                                             'tcp_socket': None,
                                             'timeout_seconds': 1},
                          'name': 'homestead-prov',
                          'ports': [{'container_port': 22,
                                     'host_ip': None,
                                     'host_port': None,
                                     'name': None,
                                     'protocol': 'TCP'},
                                    {'container_port': 8889,
                                     'host_ip': None,
                                     'host_port': None,
                                     'name': None,
                                     'protocol': 'TCP'}],
                          'readiness_probe': {'_exec': {'command': ['/bin/bash',
                                                                    '/usr/share/clearwater/bin/poll_homestead-prov.sh']},
                                              'failure_threshold': 3,
                                              'http_get': None,
                                              'initial_delay_seconds': None,
                                              'period_seconds': 10,
                                              'success_threshold': 1,
                                              'tcp_socket': None,
                                              'timeout_seconds': 1},
                          'resources': {'limits': None, 'requests': None},
                          'security_context': None,
                          'stdin': None,
                          'stdin_once': None,
                          'termination_message_path': '/dev/termination-log',
                          'termination_message_policy': 'File',
                          'tty': None,
                          'volume_devices': None,
                          'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
                                             'mount_propagation': None,
                                             'name': 'default-token-8x245',
                                             'read_only': True,
                                             'sub_path': None,
                                             'sub_path_expr': None}],
                          'working_dir': None}],
          'dns_config': None,
          'dns_policy': 'ClusterFirst',
          'enable_service_links': True,
          'host_aliases': None,
          'host_ipc': None,
          'host_network': None,
          'host_pid': None,
          'hostname': None,
          'image_pull_secrets': [{'name': None}],
          'init_containers': [{'args': None,
                               'command': ['sh',
                                           '-c',
                                           'until nslookup homestead; do echo '
                                           'waiting for homestead to start '
                                           '...; sleep 2; done'],
                               'env': None,
                               'env_from': None,
                               'image': 'busybox:1.28',
                               'image_pull_policy': 'IfNotPresent',
                               'lifecycle': None,
                               'liveness_probe': None,
                               'name': 'wait-on-homestead',
                               'ports': None,
                               'readiness_probe': None,
                               'resources': {'limits': None, 'requests': None},
                               'security_context': None,
                               'stdin': None,
                               'stdin_once': None,
                               'termination_message_path': '/dev/termination-log',
                               'termination_message_policy': 'File',
                               'tty': None,
                               'volume_devices': None,
                               'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
                                                  'mount_propagation': None,
                                                  'name': 'default-token-8x245',
                                                  'read_only': True,
                                                  'sub_path': None,
                                                  'sub_path_expr': None}],
                               'working_dir': None}],
          'node_name': 'iruya-worker2',
          'node_selector': None,
          'priority': 0,
          'priority_class_name': None,
          'readiness_gates': None,
          'restart_policy': 'Always',
          'runtime_class_name': None,
          'scheduler_name': 'default-scheduler',
          'security_context': {'fs_group': None,
                               'run_as_group': None,
                               'run_as_non_root': None,
                               'run_as_user': None,
                               'se_linux_options': None,
                               'supplemental_groups': None,
                               'sysctls': None},
          'service_account': 'default',
          'service_account_name': 'default',
          'share_process_namespace': None,
          'subdomain': None,
          'termination_grace_period_seconds': 30,
          'tolerations': [{'effect': 'NoExecute',
                           'key': 'node.kubernetes.io/not-ready',
                           'operator': 'Exists',
                           'toleration_seconds': 300,
                           'value': None},
                          {'effect': 'NoExecute',
                           'key': 'node.kubernetes.io/unreachable',
                           'operator': 'Exists',
                           'toleration_seconds': 300,
                           'value': None}],
          'volumes': [{'aws_elastic_block_store': None,
                       'azure_disk': None,
                       'azure_file': None,
                       'cephfs': None,
                       'cinder': None,
                       'config_map': None,
                       'csi': None,
                       'downward_api': None,
                       'empty_dir': None,
                       'fc': None,
                       'flex_volume': None,
                       'flocker': None,
                       'gce_persistent_disk': None,
                       'git_repo': None,
                       'glusterfs': None,
                       'host_path': None,
                       'iscsi': None,
                       'name': 'default-token-8x245',
                       'nfs': None,
                       'persistent_volume_claim': None,
                       'photon_persistent_disk': None,
                       'portworx_volume': None,
                       'projected': None,
                       'quobyte': None,
                       'rbd': None,
                       'scale_io': None,
                       'secret': {'default_mode': 420,
                                  'items': None,
                                  'optional': None,
                                  'secret_name': 'default-token-8x245'},
                       'storageos': None,
                       'vsphere_volume': None}]},
 'status': {'conditions': [{'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 3, 42, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'Initialized'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 7, 5, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'Ready'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 7, 5, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'ContainersReady'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'PodScheduled'}],
            'container_statuses': [{'container_id': 'containerd://c0e5ac7ec99cc120ad5e8268734a78eceb19570f8884b965f63c78c92e19f1d5',
                                    'image': 'docker.io/ollivier/clearwater-homestead-prov:latest',
                                    'image_id': 'docker.io/ollivier/clearwater-homestead-prov@sha256:0b4d47a5161ecb6b44f6a479a27522b802096a2deea049cd6f3c01a62b585318',
                                    'last_state': {'running': None,
                                                   'terminated': {'container_id': 'containerd://01d302fcf9347dfd42f9a686d33b2698002a3f1765b1ccddb29d74adfe963c98',
                                                                  'exit_code': 0,
                                                                  'finished_at': datetime.datetime(2020, 8, 19, 4, 6, 46, tzinfo=tzlocal()),
                                                                  'message': None,
                                                                  'reason': 'Completed',
                                                                  'signal': None,
                                                                  'started_at': datetime.datetime(2020, 8, 19, 4, 5, 21, tzinfo=tzlocal())},
                                                   'waiting': None},
                                    'name': 'homestead-prov',
                                    'ready': True,
                                    'restart_count': 2,
                                    'state': {'running': {'started_at': datetime.datetime(2020, 8, 19, 4, 6, 51, tzinfo=tzlocal())},
                                              'terminated': None,
                                              'waiting': None}}],
            'host_ip': '172.18.0.5',
            'init_container_statuses': [{'container_id': 'containerd://0f4f11e1802c9c9d8acf57211f01c46adb2c69f791adb4179a59be189ed97df3',
                                         'image': 'docker.io/library/busybox:1.28',
                                         'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47',
                                         'last_state': {'running': None,
                                                        'terminated': None,
                                                        'waiting': None},
                                         'name': 'wait-on-homestead',
                                         'ready': True,
                                         'restart_count': 0,
                                         'state': {'running': None,
                                                   'terminated': {'container_id': 'containerd://0f4f11e1802c9c9d8acf57211f01c46adb2c69f791adb4179a59be189ed97df3',
                                                                  'exit_code': 0,
                                                                  'finished_at': datetime.datetime(2020, 8, 19, 4, 3, 41, tzinfo=tzlocal()),
                                                                  'message': None,
                                                                  'reason': 'Completed',
                                                                  'signal': None,
                                                                  'started_at': datetime.datetime(2020, 8, 19, 3, 59, 54, tzinfo=tzlocal())},
                                                   'waiting': None}}],
            'message': None,
            'nominated_node_name': None,
            'phase': 'Running',
            'pod_ip': '10.244.2.196',
            'qos_class': 'BestEffort',
            'reason': None,
            'start_time': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'homestead-prov-756c8bff5d-ffgwm', 'generateName': 'homestead-prov-756c8bff5d-', 'namespace': 'ims-h4q84', 'selfLink': '/api/v1/namespaces/ims-h4q84/pods/homestead-prov-756c8bff5d-ffgwm', 'uid': '8475f021-98fc-4226-9ef2-de327b4f8e57', 'resourceVersion': '982287', 'creationTimestamp': '2020-08-19T03:59:41Z', 'labels': {'pod-template-hash': '756c8bff5d', 'service': 'homestead-prov', 'snmp': 'enabled'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'homestead-prov-756c8bff5d', 'uid': 'bf620d26-e0f0-4b66-8ad2-a14d10a54e50', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-8x245', 'secret': {'secretName': 'default-token-8x245', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-homestead', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-8x245', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead-prov', 'image': 'ollivier/clearwater-homestead-prov:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8889, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'default-token-8x245', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:03:42Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:07:05Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:07:05Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T03:59:41Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.2.196', 'startTime': '2020-08-19T03:59:41Z', 'initContainerStatuses': [{'name': 'wait-on-homestead', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-08-19T03:59:54Z', 'finishedAt': '2020-08-19T04:03:41Z', 'containerID': 'containerd://0f4f11e1802c9c9d8acf57211f01c46adb2c69f791adb4179a59be189ed97df3'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://0f4f11e1802c9c9d8acf57211f01c46adb2c69f791adb4179a59be189ed97df3'}], 'containerStatuses': [{'name': 'homestead-prov', 'state': {'running': {'startedAt': '2020-08-19T04:06:51Z'}}, 'lastState': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-08-19T04:05:21Z', 'finishedAt': '2020-08-19T04:06:46Z', 'containerID': 'containerd://01d302fcf9347dfd42f9a686d33b2698002a3f1765b1ccddb29d74adfe963c98'}}, 'ready': True, 'restartCount': 2, 'image': 'docker.io/ollivier/clearwater-homestead-prov:latest', 'imageID': 'docker.io/ollivier/clearwater-homestead-prov@sha256:0b4d47a5161ecb6b44f6a479a27522b802096a2deea049cd6f3c01a62b585318', 'containerID': 'containerd://c0e5ac7ec99cc120ad5e8268734a78eceb19570f8884b965f63c78c92e19f1d5'}], 'qosClass': 'BestEffort'}}}
2020-08-19 04:08:29,777 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1',
 'kind': 'Pod',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': 'homer-74dd4556d9-',
              'generation': None,
              'initializers': None,
              'labels': {'pod-template-hash': '74dd4556d9', 'service': 'homer'},
              'managed_fields': None,
              'name': 'homer-74dd4556d9-wlcnq',
              'namespace': 'ims-h4q84',
              'owner_references': [{'api_version': 'apps/v1',
                                    'block_owner_deletion': True,
                                    'controller': True,
                                    'kind': 'ReplicaSet',
                                    'name': 'homer-74dd4556d9',
                                    'uid': '7e716eb5-4074-435f-ad9c-cb430df77727'}],
              'resource_version': '981622',
              'self_link': '/api/v1/namespaces/ims-h4q84/pods/homer-74dd4556d9-wlcnq',
              'uid': '647278b3-d12a-4006-ac68-d98958c009dd'},
 'spec': {'active_deadline_seconds': None,
          'affinity': None,
          'automount_service_account_token': None,
          'containers': [{'args': None,
                          'command': None,
                          'env': [{'name': 'MY_POD_IP',
                                   'value': None,
                                   'value_from': {'config_map_key_ref': None,
                                                  'field_ref': {'api_version': 'v1',
                                                                'field_path': 'status.podIP'},
                                                  'resource_field_ref': None,
                                                  'secret_key_ref': None}}],
                          'env_from': [{'config_map_ref': {'name': 'env-vars',
                                                           'optional': None},
                                        'prefix': None,
                                        'secret_ref': None}],
                          'image': 'ollivier/clearwater-homer:latest',
                          'image_pull_policy': 'Always',
                          'lifecycle': None,
                          'liveness_probe': {'_exec': None,
                                             'failure_threshold': 3,
                                             'http_get': None,
                                             'initial_delay_seconds': 30,
                                             'period_seconds': 10,
                                             'success_threshold': 1,
                                             'tcp_socket': {'host': None,
                                                            'port': 7888},
                                             'timeout_seconds': 1},
                          'name': 'homer',
                          'ports': [{'container_port': 22,
                                     'host_ip': None,
                                     'host_port': None,
                                     'name': None,
                                     'protocol': 'TCP'},
                                    {'container_port': 7888,
                                     'host_ip': None,
                                     'host_port': None,
                                     'name': None,
                                     'protocol': 'TCP'}],
                          'readiness_probe': {'_exec': None,
                                              'failure_threshold': 3,
                                              'http_get': None,
                                              'initial_delay_seconds': None,
                                              'period_seconds': 10,
                                              'success_threshold': 1,
                                              'tcp_socket': {'host': None,
                                                             'port': 7888},
                                              'timeout_seconds': 1},
                          'resources': {'limits': None, 'requests': None},
                          'security_context': None,
                          'stdin': None,
                          'stdin_once': None,
                          'termination_message_path': '/dev/termination-log',
                          'termination_message_policy': 'File',
                          'tty': None,
                          'volume_devices': None,
                          'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
                                             'mount_propagation': None,
                                             'name': 'default-token-8x245',
                                             'read_only': True,
                                             'sub_path': None,
                                             'sub_path_expr': None}],
                          'working_dir': None}],
          'dns_config': None,
          'dns_policy': 'ClusterFirst',
          'enable_service_links': True,
          'host_aliases': None,
          'host_ipc': None,
          'host_network': None,
          'host_pid': None,
          'hostname': None,
          'image_pull_secrets': [{'name': None}],
          'init_containers': [{'args': None,
                               'command': ['sh',
                                           '-c',
                                           'until nslookup cassandra; do echo '
                                           'waiting for cassandra to start '
                                           '...; sleep 2; done'],
                               'env': None,
                               'env_from': None,
                               'image': 'busybox:1.28',
                               'image_pull_policy': 'IfNotPresent',
                               'lifecycle': None,
                               'liveness_probe': None,
                               'name': 'wait-on-cassandra',
                               'ports': None,
                               'readiness_probe': None,
                               'resources': {'limits': None, 'requests': None},
                               'security_context': None,
                               'stdin': None,
                               'stdin_once': None,
                               'termination_message_path': '/dev/termination-log',
                               'termination_message_policy': 'File',
                               'tty': None,
                               'volume_devices': None,
                               'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
                                                  'mount_propagation': None,
                                                  'name': 'default-token-8x245',
                                                  'read_only': True,
                                                  'sub_path': None,
                                                  'sub_path_expr': None}],
                               'working_dir': None}],
          'node_name': 'iruya-worker',
          'node_selector': None,
          'priority': 0,
          'priority_class_name': None,
          'readiness_gates': None,
          'restart_policy': 'Always',
          'runtime_class_name': None,
          'scheduler_name': 'default-scheduler',
          'security_context': {'fs_group': None,
                               'run_as_group': None,
                               'run_as_non_root': None,
                               'run_as_user': None,
                               'se_linux_options': None,
                               'supplemental_groups': None,
                               'sysctls': None},
          'service_account': 'default',
          'service_account_name': 'default',
          'share_process_namespace': None,
          'subdomain': None,
          'termination_grace_period_seconds': 30,
          'tolerations': [{'effect': 'NoExecute',
                           'key': 'node.kubernetes.io/not-ready',
                           'operator': 'Exists',
                           'toleration_seconds': 300,
                           'value': None},
                          {'effect': 'NoExecute',
                           'key': 'node.kubernetes.io/unreachable',
                           'operator': 'Exists',
                           'toleration_seconds': 300,
                           'value': None}],
          'volumes': [{'aws_elastic_block_store': None,
                       'azure_disk': None,
                       'azure_file': None,
                       'cephfs': None,
                       'cinder': None,
                       'config_map': None,
                       'csi': None,
                       'downward_api': None,
                       'empty_dir': None,
                       'fc': None,
                       'flex_volume': None,
                       'flocker': None,
                       'gce_persistent_disk': None,
                       'git_repo': None,
                       'glusterfs': None,
                       'host_path': None,
                       'iscsi': None,
                       'name': 'default-token-8x245',
                       'nfs': None,
                       'persistent_volume_claim': None,
                       'photon_persistent_disk': None,
                       'portworx_volume': None,
                       'projected': None,
                       'quobyte': None,
                       'rbd': None,
                       'scale_io': None,
                       'secret': {'default_mode': 420,
                                  'items': None,
                                  'optional': None,
                                  'secret_name': 'default-token-8x245'},
                       'storageos': None,
                       'vsphere_volume': None}]},
 'status': {'conditions': [{'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 1, 54, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'Initialized'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 2, 13, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'Ready'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 2, 13, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'ContainersReady'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'PodScheduled'}],
            'container_statuses': [{'container_id': 'containerd://66ad5046fb8d23000c1f2ae3161271162af8fa2978c923fe3ef668394417013e',
                                    'image': 'docker.io/ollivier/clearwater-homer:latest',
                                    'image_id': 'docker.io/ollivier/clearwater-homer@sha256:257ef9011d4ff30771c0c48ef7e3b16926dce88c17d4435953f433fa9e0d731a',
                                    'last_state': {'running': None,
                                                   'terminated': None,
                                                   'waiting': None},
                                    'name': 'homer',
                                    'ready': True,
                                    'restart_count': 0,
                                    'state': {'running': {'started_at': datetime.datetime(2020, 8, 19, 4, 2, tzinfo=tzlocal())},
                                              'terminated': None,
                                              'waiting': None}}],
            'host_ip': '172.18.0.9',
            'init_container_statuses': [{'container_id': 'containerd://e1b1060cad11741150ef5a5bab02ae8a68ecb34692e24d50868dda3a41a61f0a',
                                         'image': 'docker.io/library/busybox:1.28',
                                         'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47',
                                         'last_state': {'running': None,
                                                        'terminated': None,
                                                        'waiting': None},
                                         'name': 'wait-on-cassandra',
                                         'ready': True,
                                         'restart_count': 0,
                                         'state': {'running': None,
                                                   'terminated': {'container_id': 'containerd://e1b1060cad11741150ef5a5bab02ae8a68ecb34692e24d50868dda3a41a61f0a',
                                                                  'exit_code': 0,
                                                                  'finished_at': datetime.datetime(2020, 8, 19, 4, 1, 53, tzinfo=tzlocal()),
                                                                  'message': None,
                                                                  'reason': 'Completed',
                                                                  'signal': None,
                                                                  'started_at': datetime.datetime(2020, 8, 19, 3, 59, 50, tzinfo=tzlocal())},
                                                   'waiting': None}}],
            'message': None,
            'nominated_node_name': None,
            'phase': 'Running',
            'pod_ip': '10.244.1.126',
            'qos_class': 'BestEffort',
            'reason': None,
            'start_time': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'homer-74dd4556d9-wlcnq', 'generateName': 'homer-74dd4556d9-', 'namespace': 'ims-h4q84', 'selfLink': '/api/v1/namespaces/ims-h4q84/pods/homer-74dd4556d9-wlcnq', 'uid': '647278b3-d12a-4006-ac68-d98958c009dd', 'resourceVersion': '981622', 'creationTimestamp': '2020-08-19T03:59:41Z', 'labels': {'pod-template-hash': '74dd4556d9', 'service': 'homer'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'homer-74dd4556d9', 'uid': '7e716eb5-4074-435f-ad9c-cb430df77727', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-8x245', 'secret': {'secretName': 'default-token-8x245', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-8x245', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homer', 'image': 'ollivier/clearwater-homer:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'default-token-8x245', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'tcpSocket': {'port': 7888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 7888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:01:54Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:02:13Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:02:13Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T03:59:41Z'}], 'hostIP': '172.18.0.9', 'podIP': '10.244.1.126', 'startTime': '2020-08-19T03:59:41Z', 'initContainerStatuses': [{'name': 'wait-on-cassandra', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-08-19T03:59:50Z', 'finishedAt': '2020-08-19T04:01:53Z', 'containerID': 'containerd://e1b1060cad11741150ef5a5bab02ae8a68ecb34692e24d50868dda3a41a61f0a'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://e1b1060cad11741150ef5a5bab02ae8a68ecb34692e24d50868dda3a41a61f0a'}], 'containerStatuses': [{'name': 'homer', 'state': {'running': {'startedAt': '2020-08-19T04:02:00Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-homer:latest', 'imageID': 'docker.io/ollivier/clearwater-homer@sha256:257ef9011d4ff30771c0c48ef7e3b16926dce88c17d4435953f433fa9e0d731a', 'containerID': 'containerd://66ad5046fb8d23000c1f2ae3161271162af8fa2978c923fe3ef668394417013e'}], 'qosClass': 'BestEffort'}}}
2020-08-19 04:08:30,009 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1',
 'kind': 'Pod',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': 'cassandra-76f5c4d86c-',
              'generation': None,
              'initializers': None,
              'labels': {'pod-template-hash': '76f5c4d86c',
                         'service': 'cassandra'},
              'managed_fields': None,
              'name': 'cassandra-76f5c4d86c-7gknc',
              'namespace': 'ims-h4q84',
              'owner_references': [{'api_version': 'apps/v1',
                                    'block_owner_deletion': True,
                                    'controller': True,
                                    'kind': 'ReplicaSet',
                                    'name': 'cassandra-76f5c4d86c',
                                    'uid': 'f1142eb1-ac8b-4434-9e55-fdaf5f73da0c'}],
              'resource_version': '981490',
              'self_link': '/api/v1/namespaces/ims-h4q84/pods/cassandra-76f5c4d86c-7gknc',
              'uid': 'b7b141ef-ad0f-4345-bc6a-3437b4d429c1'},
 'spec': {'active_deadline_seconds': None,
          'affinity': None,
          'automount_service_account_token': None,
          'containers': [{'args': None,
                          'command': None,
                          'env': [{'name': 'MY_POD_IP',
                                   'value': None,
                                   'value_from': {'config_map_key_ref': None,
                                                  'field_ref': {'api_version': 'v1',
                                                                'field_path': 'status.podIP'},
                                                  'resource_field_ref': None,
                                                  'secret_key_ref': None}}],
                          'env_from': [{'config_map_ref': {'name': 'env-vars',
                                                           'optional': None},
                                        'prefix': None,
                                        'secret_ref': None}],
                          'image': 'ollivier/clearwater-cassandra:latest',
                          'image_pull_policy': 'Always',
                          'lifecycle': None,
                          'liveness_probe': {'_exec': {'command': ['/bin/bash',
                                                                   '/usr/share/kubernetes/liveness.sh',
                                                                   '7000 9042 '
                                                                   '9160']},
                                             'failure_threshold': 3,
                                             'http_get': None,
                                             'initial_delay_seconds': 600,
                                             'period_seconds': 10,
                                             'success_threshold': 1,
                                             'tcp_socket': None,
                                             'timeout_seconds': 1},
                          'name': 'cassandra',
                          'ports': [{'container_port': 22,
                                     'host_ip': None,
                                     'host_port': None,
                                     'name': None,
                                     'protocol': 'TCP'},
                                    {'container_port': 7001,
                                     'host_ip': None,
                                     'host_port': None,
                                     'name': None,
                                     'protocol': 'TCP'},
                                    {'container_port': 9042,
                                     'host_ip': None,
                                     'host_port': None,
                                     'name': None,
                                     'protocol': 'TCP'},
                                    {'container_port': 9160,
                                     'host_ip': None,
                                     'host_port': None,
                                     'name': None,
                                     'protocol': 'TCP'}],
                          'readiness_probe': {'_exec': {'command': ['/bin/bash',
                                                                    '/usr/share/kubernetes/liveness.sh',
                                                                    '7000 9042 '
                                                                    '9160']},
                                              'failure_threshold': 3,
                                              'http_get': None,
                                              'initial_delay_seconds': None,
                                              'period_seconds': 10,
                                              'success_threshold': 1,
                                              'tcp_socket': None,
                                              'timeout_seconds': 1},
                          'resources': {'limits': None, 'requests': None},
                          'security_context': None,
                          'stdin': None,
                          'stdin_once': None,
                          'termination_message_path': '/dev/termination-log',
                          'termination_message_policy': 'File',
                          'tty': None,
                          'volume_devices': None,
                          'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
                                             'mount_propagation': None,
                                             'name': 'default-token-8x245',
                                             'read_only': True,
                                             'sub_path': None,
                                             'sub_path_expr': None}],
                          'working_dir': None}],
          'dns_config': None,
          'dns_policy': 'ClusterFirst',
          'enable_service_links': True,
          'host_aliases': None,
          'host_ipc': None,
          'host_network': None,
          'host_pid': None,
          'hostname': None,
          'image_pull_secrets': [{'name': None}],
          'init_containers': [{'args': None,
                               'command': ['sh',
                                           '-c',
                                           'until nslookup etcd; do echo '
                                           'waiting for etcd to start ...; '
                                           'sleep 2; done'],
                               'env': None,
                               'env_from': None,
                               'image': 'busybox:1.28',
                               'image_pull_policy': 'IfNotPresent',
                               'lifecycle': None,
                               'liveness_probe': None,
                               'name': 'wait-on-etcd',
                               'ports': None,
                               'readiness_probe': None,
                               'resources': {'limits': None, 'requests': None},
                               'security_context': None,
                               'stdin': None,
                               'stdin_once': None,
                               'termination_message_path': '/dev/termination-log',
                               'termination_message_policy': 'File',
                               'tty': None,
                               'volume_devices': None,
                               'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
                                                  'mount_propagation': None,
                                                  'name': 'default-token-8x245',
                                                  'read_only': True,
                                                  'sub_path': None,
                                                  'sub_path_expr': None}],
                               'working_dir': None}],
          'node_name': 'iruya-worker2',
          'node_selector': None,
          'priority': 0,
          'priority_class_name': None,
          'readiness_gates': None,
          'restart_policy': 'Always',
          'runtime_class_name': None,
          'scheduler_name': 'default-scheduler',
          'security_context': {'fs_group': None,
                               'run_as_group': None,
                               'run_as_non_root': None,
                               'run_as_user': None,
                               'se_linux_options': None,
                               'supplemental_groups': None,
                               'sysctls': None},
          'service_account': 'default',
          'service_account_name': 'default',
          'share_process_namespace': None,
          'subdomain': None,
          'termination_grace_period_seconds': 30,
          'tolerations': [{'effect': 'NoExecute',
                           'key': 'node.kubernetes.io/not-ready',
                           'operator': 'Exists',
                           'toleration_seconds': 300,
                           'value': None},
                          {'effect': 'NoExecute',
                           'key': 'node.kubernetes.io/unreachable',
                           'operator': 'Exists',
                           'toleration_seconds': 300,
                           'value': None}],
          'volumes': [{'aws_elastic_block_store': None,
                       'azure_disk': None,
                       'azure_file': None,
                       'cephfs': None,
                       'cinder': None,
                       'config_map': None,
                       'csi': None,
                       'downward_api': None,
                       'empty_dir': None,
                       'fc': None,
                       'flex_volume': None,
                       'flocker': None,
                       'gce_persistent_disk': None,
                       'git_repo': None,
                       'glusterfs': None,
                       'host_path': None,
                       'iscsi': None,
                       'name': 'default-token-8x245',
                       'nfs': None,
                       'persistent_volume_claim': None,
                       'photon_persistent_disk': None,
                       'portworx_volume': None,
                       'projected': None,
                       'quobyte': None,
                       'rbd': None,
                       'scale_io': None,
                       'secret': {'default_mode': 420,
                                  'items': None,
                                  'optional': None,
                                  'secret_name': 'default-token-8x245'},
                       'storageos': None,
                       'vsphere_volume': None}]},
 'status': {'conditions': [{'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 0, 27, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'Initialized'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 1, 31, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'Ready'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 1, 31, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'ContainersReady'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'PodScheduled'}],
            'container_statuses': [{'container_id': 'containerd://fc24a5b737292ac1266d3ca5afa879a3b0fef12558f18418a684b5fa63d895c5',
                                    'image': 'docker.io/ollivier/clearwater-cassandra:latest',
                                    'image_id': 'docker.io/ollivier/clearwater-cassandra@sha256:232be9c5a4400e4c5e0932fde50af8f379e3e9ddd4d3f28da6ec78c86f6ed9f6',
                                    'last_state': {'running': None,
                                                   'terminated': None,
                                                   'waiting': None},
                                    'name': 'cassandra',
                                    'ready': True,
                                    'restart_count': 0,
                                    'state': {'running': {'started_at': datetime.datetime(2020, 8, 19, 4, 0, 30, tzinfo=tzlocal())},
                                              'terminated': None,
                                              'waiting': None}}],
            'host_ip': '172.18.0.5',
            'init_container_statuses': [{'container_id': 'containerd://f46d7bb2f064bbbf1172602423122052da7c16d7b23142ac05584d81c8ae7d45',
                                         'image': 'docker.io/library/busybox:1.28',
                                         'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47',
                                         'last_state': {'running': None,
                                                        'terminated': None,
                                                        'waiting': None},
                                         'name': 'wait-on-etcd',
                                         'ready': True,
                                         'restart_count': 0,
                                         'state': {'running': None,
                                                   'terminated': {'container_id': 'containerd://f46d7bb2f064bbbf1172602423122052da7c16d7b23142ac05584d81c8ae7d45',
                                                                  'exit_code': 0,
                                                                  'finished_at': datetime.datetime(2020, 8, 19, 4, 0, 25, tzinfo=tzlocal()),
                                                                  'message': None,
                                                                  'reason': 'Completed',
                                                                  'signal': None,
                                                                  'started_at': datetime.datetime(2020, 8, 19, 3, 59, 53, tzinfo=tzlocal())},
                                                   'waiting': None}}],
            'message': None,
            'nominated_node_name': None,
            'phase': 'Running',
            'pod_ip': '10.244.2.193',
            'qos_class': 'BestEffort',
            'reason': None,
            'start_time': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'cassandra-76f5c4d86c-7gknc', 'generateName': 'cassandra-76f5c4d86c-', 'namespace': 'ims-h4q84', 'selfLink': '/api/v1/namespaces/ims-h4q84/pods/cassandra-76f5c4d86c-7gknc', 'uid': 'b7b141ef-ad0f-4345-bc6a-3437b4d429c1', 'resourceVersion': '981490', 'creationTimestamp': '2020-08-19T03:59:40Z', 'labels': {'pod-template-hash': '76f5c4d86c', 'service': 'cassandra'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'cassandra-76f5c4d86c', 'uid': 'f1142eb1-ac8b-4434-9e55-fdaf5f73da0c', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-8x245', 'secret': {'secretName': 'default-token-8x245', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-etcd', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup etcd; do echo waiting for etcd to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-8x245', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'cassandra', 'image': 'ollivier/clearwater-cassandra:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7001, 'protocol': 'TCP'}, {'containerPort': 9042, 'protocol': 'TCP'}, {'containerPort': 9160, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'default-token-8x245', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 9160']}, 'initialDelaySeconds': 600, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 9160']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:00:27Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:01:31Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:01:31Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T03:59:40Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.2.193', 'startTime': '2020-08-19T03:59:40Z', 'initContainerStatuses': [{'name': 'wait-on-etcd', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-08-19T03:59:53Z', 'finishedAt': '2020-08-19T04:00:25Z', 'containerID': 'containerd://f46d7bb2f064bbbf1172602423122052da7c16d7b23142ac05584d81c8ae7d45'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://f46d7bb2f064bbbf1172602423122052da7c16d7b23142ac05584d81c8ae7d45'}], 'containerStatuses': [{'name': 'cassandra', 'state': {'running': {'startedAt': '2020-08-19T04:00:30Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-cassandra:latest', 'imageID': 'docker.io/ollivier/clearwater-cassandra@sha256:232be9c5a4400e4c5e0932fde50af8f379e3e9ddd4d3f28da6ec78c86f6ed9f6', 'containerID': 'containerd://fc24a5b737292ac1266d3ca5afa879a3b0fef12558f18418a684b5fa63d895c5'}], 'qosClass': 'BestEffort'}}}
2020-08-19 04:08:30,253 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1',
 'kind': 'Pod',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': 'chronos-687b9884c5-',
              'generation': None,
              'initializers': None,
              'labels': {'pod-template-hash': '687b9884c5',
                         'service': 'chronos'},
              'managed_fields': None,
              'name': 'chronos-687b9884c5-nxvxx',
              'namespace': 'ims-h4q84',
              'owner_references': [{'api_version': 'apps/v1',
                                    'block_owner_deletion': True,
                                    'controller': True,
                                    'kind': 'ReplicaSet',
                                    'name': 'chronos-687b9884c5',
                                    'uid': '5de6c80a-2fe6-4f00-8faf-b8203a345e8d'}],
              'resource_version': '981627',
              'self_link': '/api/v1/namespaces/ims-h4q84/pods/chronos-687b9884c5-nxvxx',
              'uid': 'd44f1d57-fbf7-45c5-9574-66b5c82d94dd'},
 'spec': {'active_deadline_seconds': None,
          'affinity': None,
          'automount_service_account_token': None,
          'containers': [{'args': None,
                          'command': None,
                          'env': [{'name': 'MY_POD_IP',
                                   'value': None,
                                   'value_from': {'config_map_key_ref': None,
                                                  'field_ref': {'api_version': 'v1',
                                                                'field_path': 'status.podIP'},
                                                  'resource_field_ref': None,
                                                  'secret_key_ref': None}}],
                          'env_from': [{'config_map_ref': {'name': 'env-vars',
                                                           'optional': None},
                                        'prefix': None,
                                        'secret_ref': None}],
                          'image': 'ollivier/clearwater-chronos:latest',
                          'image_pull_policy': 'Always',
                          'lifecycle': {'post_start': None,
                                        'pre_stop': {'_exec': {'command': ['/bin/bash',
                                                                           '-c',
                                                                           '/usr/bin/pre-stop']},
                                                     'http_get': None,
                                                     'tcp_socket': None}},
                          'liveness_probe': {'_exec': None,
                                             'failure_threshold': 9,
                                             'http_get': None,
                                             'initial_delay_seconds': None,
                                             'period_seconds': 10,
                                             'success_threshold': 1,
                                             'tcp_socket': {'host': None,
                                                            'port': 7253},
                                             'timeout_seconds': 1},
                          'name': 'chronos',
                          'ports': [{'container_port': 22,
                                     'host_ip': None,
                                     'host_port': None,
                                     'name': None,
                                     'protocol': 'TCP'},
                                    {'container_port': 7253,
                                     'host_ip': None,
                                     'host_port': None,
                                     'name': None,
                                     'protocol': 'TCP'}],
                          'readiness_probe': {'_exec': None,
                                              'failure_threshold': 3,
                                              'http_get': None,
                                              'initial_delay_seconds': None,
                                              'period_seconds': 10,
                                              'success_threshold': 1,
                                              'tcp_socket': {'host': None,
                                                             'port': 7253},
                                              'timeout_seconds': 1},
                          'resources': {'limits': None, 'requests': None},
                          'security_context': None,
                          'stdin': None,
                          'stdin_once': None,
                          'termination_message_path': '/dev/termination-log',
                          'termination_message_policy': 'File',
                          'tty': None,
                          'volume_devices': None,
                          'volume_mounts': [{'mount_path': '/var/log/chronos',
                                             'mount_propagation': None,
                                             'name': 'chronoslogs',
                                             'read_only': None,
                                             'sub_path': None,
                                             'sub_path_expr': None},
                                            {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
                                             'mount_propagation': None,
                                             'name': 'default-token-8x245',
                                             'read_only': True,
                                             'sub_path': None,
                                             'sub_path_expr': None}],
                          'working_dir': None},
                         {'args': None,
                          'command': ['tail',
                                      '-F',
                                      '/var/log/chronos/chronos_current.txt'],
                          'env': None,
                          'env_from': None,
                          'image': 'busybox',
                          'image_pull_policy': 'Always',
                          'lifecycle': None,
                          'liveness_probe': None,
                          'name': 'tailer',
                          'ports': None,
                          'readiness_probe': None,
                          'resources': {'limits': None, 'requests': None},
                          'security_context': None,
                          'stdin': None,
                          'stdin_once': None,
                          'termination_message_path': '/dev/termination-log',
                          'termination_message_policy': 'File',
                          'tty': None,
                          'volume_devices': None,
                          'volume_mounts': [{'mount_path': '/var/log/chronos',
                                             'mount_propagation': None,
                                             'name': 'chronoslogs',
                                             'read_only': None,
                                             'sub_path': None,
                                             'sub_path_expr': None},
                                            {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
                                             'mount_propagation': None,
                                             'name': 'default-token-8x245',
                                             'read_only': True,
                                             'sub_path': None,
                                             'sub_path_expr': None}],
                          'working_dir': None}],
          'dns_config': None,
          'dns_policy': 'ClusterFirst',
          'enable_service_links': True,
          'host_aliases': None,
          'host_ipc': None,
          'host_network': None,
          'host_pid': None,
          'hostname': None,
          'image_pull_secrets': [{'name': None}],
          'init_containers': [{'args': None,
                               'command': ['sh',
                                           '-c',
                                           'until nslookup cassandra; do echo '
                                           'waiting for cassandra to start '
                                           '...; sleep 2; done'],
                               'env': None,
                               'env_from': None,
                               'image': 'busybox:1.28',
                               'image_pull_policy': 'IfNotPresent',
                               'lifecycle': None,
                               'liveness_probe': None,
                               'name': 'wait-on-cassandra',
                               'ports': None,
                               'readiness_probe': None,
                               'resources': {'limits': None, 'requests': None},
                               'security_context': None,
                               'stdin': None,
                               'stdin_once': None,
                               'termination_message_path': '/dev/termination-log',
                               'termination_message_policy': 'File',
                               'tty': None,
                               'volume_devices': None,
                               'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
                                                  'mount_propagation': None,
                                                  'name': 'default-token-8x245',
                                                  'read_only': True,
                                                  'sub_path': None,
                                                  'sub_path_expr': None}],
                               'working_dir': None}],
          'node_name': 'iruya-worker2',
          'node_selector': None,
          'priority': 0,
          'priority_class_name': None,
          'readiness_gates': None,
          'restart_policy': 'Always',
          'runtime_class_name': None,
          'scheduler_name': 'default-scheduler',
          'security_context': {'fs_group': None,
                               'run_as_group': None,
                               'run_as_non_root': None,
                               'run_as_user': None,
                               'se_linux_options': None,
                               'supplemental_groups': None,
                               'sysctls': None},
          'service_account': 'default',
          'service_account_name': 'default',
          'share_process_namespace': None,
          'subdomain': None,
          'termination_grace_period_seconds': 120,
          'tolerations': [{'effect': 'NoExecute',
                           'key': 'node.kubernetes.io/not-ready',
                           'operator': 'Exists',
                           'toleration_seconds': 300,
                           'value': None},
                          {'effect': 'NoExecute',
                           'key': 'node.kubernetes.io/unreachable',
                           'operator': 'Exists',
                           'toleration_seconds': 300,
                           'value': None}],
          'volumes': [{'aws_elastic_block_store': None,
                       'azure_disk': None,
                       'azure_file': None,
                       'cephfs': None,
                       'cinder': None,
                       'config_map': None,
                       'csi': None,
                       'downward_api': None,
                       'empty_dir': {'medium': None, 'size_limit': None},
                       'fc': None,
                       'flex_volume': None,
                       'flocker': None,
                       'gce_persistent_disk': None,
                       'git_repo': None,
                       'glusterfs': None,
                       'host_path': None,
                       'iscsi': None,
                       'name': 'chronoslogs',
                       'nfs': None,
                       'persistent_volume_claim': None,
                       'photon_persistent_disk': None,
                       'portworx_volume': None,
                       'projected': None,
                       'quobyte': None,
                       'rbd': None,
                       'scale_io': None,
                       'secret': None,
                       'storageos': None,
                       'vsphere_volume': None},
                      {'aws_elastic_block_store': None,
                       'azure_disk': None,
                       'azure_file': None,
                       'cephfs': None,
                       'cinder': None,
                       'config_map': None,
                       'csi': None,
                       'downward_api': None,
                       'empty_dir': None,
                       'fc': None,
                       'flex_volume': None,
                       'flocker': None,
                       'gce_persistent_disk': None,
                       'git_repo': None,
                       'glusterfs': None,
                       'host_path': None,
                       'iscsi': None,
                       'name': 'default-token-8x245',
                       'nfs': None,
                       'persistent_volume_claim': None,
                       'photon_persistent_disk': None,
                       'portworx_volume': None,
                       'projected': None,
                       'quobyte': None,
                       'rbd': None,
                       'scale_io': None,
                       'secret': {'default_mode': 420,
                                  'items': None,
                                  'optional': None,
                                  'secret_name': 'default-token-8x245'},
                       'storageos': None,
                       'vsphere_volume': None}]},
 'status': {'conditions': [{'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 1, 52, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'Initialized'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 2, 13, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'Ready'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 2, 13, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'ContainersReady'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'PodScheduled'}],
            'container_statuses': [{'container_id': 'containerd://610ac1ede1ddaf0c2e54197d83e662fa42434c31d6f72f4036fa0af2a61ba66b',
                                    'image': 'docker.io/ollivier/clearwater-chronos:latest',
                                    'image_id': 'docker.io/ollivier/clearwater-chronos@sha256:3e838bae03946022eae06e3d343167d4b28507909e9c17e1bf574a23b423f83d',
                                    'last_state': {'running': None,
                                                   'terminated': None,
                                                   'waiting': None},
                                    'name': 'chronos',
                                    'ready': True,
                                    'restart_count': 0,
                                    'state': {'running': {'started_at': datetime.datetime(2020, 8, 19, 4, 1, 57, tzinfo=tzlocal())},
                                              'terminated': None,
                                              'waiting': None}},
                                   {'container_id': 'containerd://0124d85fbf61045ab9c157680665307e2f00cf671669671ad525b6b5e8d6311e',
                                    'image': 'docker.io/library/busybox:latest',
                                    'image_id': 'docker.io/library/busybox@sha256:4f47c01fa91355af2865ac10fef5bf6ec9c7f42ad2321377c21e844427972977',
                                    'last_state': {'running': None,
                                                   'terminated': None,
                                                   'waiting': None},
                                    'name': 'tailer',
                                    'ready': True,
                                    'restart_count': 0,
                                    'state': {'running': {'started_at': datetime.datetime(2020, 8, 19, 4, 2, 4, tzinfo=tzlocal())},
                                              'terminated': None,
                                              'waiting': None}}],
            'host_ip': '172.18.0.5',
            'init_container_statuses': [{'container_id': 'containerd://901fc50832d5be65184a878ec2b6f8056a7f944ee7df71d8503166ac64337d9d',
                                         'image': 'docker.io/library/busybox:1.28',
                                         'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47',
                                         'last_state': {'running': None,
                                                        'terminated': None,
                                                        'waiting': None},
                                         'name': 'wait-on-cassandra',
                                         'ready': True,
                                         'restart_count': 0,
                                         'state': {'running': None,
                                                   'terminated': {'container_id': 'containerd://901fc50832d5be65184a878ec2b6f8056a7f944ee7df71d8503166ac64337d9d',
                                                                  'exit_code': 0,
                                                                  'finished_at': datetime.datetime(2020, 8, 19, 4, 1, 51, tzinfo=tzlocal()),
                                                                  'message': None,
                                                                  'reason': 'Completed',
                                                                  'signal': None,
                                                                  'started_at': datetime.datetime(2020, 8, 19, 3, 59, 52, tzinfo=tzlocal())},
                                                   'waiting': None}}],
            'message': None,
            'nominated_node_name': None,
            'phase': 'Running',
            'pod_ip': '10.244.2.194',
            'qos_class': 'BestEffort',
            'reason': None,
            'start_time': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'chronos-687b9884c5-nxvxx', 'generateName': 'chronos-687b9884c5-', 'namespace': 'ims-h4q84', 'selfLink': '/api/v1/namespaces/ims-h4q84/pods/chronos-687b9884c5-nxvxx', 'uid': 'd44f1d57-fbf7-45c5-9574-66b5c82d94dd', 'resourceVersion': '981627', 'creationTimestamp': '2020-08-19T03:59:40Z', 'labels': {'pod-template-hash': '687b9884c5', 'service': 'chronos'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'chronos-687b9884c5', 'uid': '5de6c80a-2fe6-4f00-8faf-b8203a345e8d', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'chronoslogs', 'emptyDir': {}}, {'name': 'default-token-8x245', 'secret': {'secretName': 'default-token-8x245', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-8x245', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'chronos', 'image': 'ollivier/clearwater-chronos:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7253, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'chronoslogs', 'mountPath': '/var/log/chronos'}, {'name': 'default-token-8x245', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'tcpSocket': {'port': 7253}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 9}, 'readinessProbe': {'tcpSocket': {'port': 7253}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'lifecycle': {'preStop': {'exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}}}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/chronos/chronos_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'chronoslogs', 'mountPath': '/var/log/chronos'}, {'name': 'default-token-8x245', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 120, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:01:52Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:02:13Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:02:13Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T03:59:40Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.2.194', 'startTime': '2020-08-19T03:59:40Z', 'initContainerStatuses': [{'name': 'wait-on-cassandra', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-08-19T03:59:52Z', 'finishedAt': '2020-08-19T04:01:51Z', 'containerID': 'containerd://901fc50832d5be65184a878ec2b6f8056a7f944ee7df71d8503166ac64337d9d'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://901fc50832d5be65184a878ec2b6f8056a7f944ee7df71d8503166ac64337d9d'}], 'containerStatuses': [{'name': 'chronos', 'state': {'running': {'startedAt': '2020-08-19T04:01:57Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-chronos:latest', 'imageID': 'docker.io/ollivier/clearwater-chronos@sha256:3e838bae03946022eae06e3d343167d4b28507909e9c17e1bf574a23b423f83d', 'containerID': 'containerd://610ac1ede1ddaf0c2e54197d83e662fa42434c31d6f72f4036fa0af2a61ba66b'}, {'name': 'tailer', 'state': {'running': {'startedAt': '2020-08-19T04:02:04Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:latest', 'imageID': 'docker.io/library/busybox@sha256:4f47c01fa91355af2865ac10fef5bf6ec9c7f42ad2321377c21e844427972977', 'containerID': 'containerd://0124d85fbf61045ab9c157680665307e2f00cf671669671ad525b6b5e8d6311e'}], 'qosClass': 'BestEffort'}}}
2020-08-19 04:08:30,551 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1',
 'kind': 'Pod',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': 'ralf-57c4654cb8-',
              'generation': None,
              'initializers': None,
              'labels': {'pod-template-hash': '57c4654cb8',
                         'service': 'ralf',
                         'snmp': 'enabled'},
              'managed_fields': None,
              'name': 'ralf-57c4654cb8-pg4gb',
              'namespace': 'ims-h4q84',
              'owner_references': [{'api_version': 'apps/v1',
                                    'block_owner_deletion': True,
                                    'controller': True,
                                    'kind': 'ReplicaSet',
                                    'name': 'ralf-57c4654cb8',
                                    'uid': '5e8345dd-6129-446c-ba42-7e0d02e72dd9'}],
              'resource_version': '981612',
              'self_link': '/api/v1/namespaces/ims-h4q84/pods/ralf-57c4654cb8-pg4gb',
              'uid': '813af80c-f9bb-4971-b0f2-01cda83defb2'},
 'spec': {'active_deadline_seconds': None,
          'affinity': None,
          'automount_service_account_token': None,
          'containers': [{'args': None,
                          'command': None,
                          'env': [{'name': 'MY_POD_IP',
                                   'value': None,
                                   'value_from': {'config_map_key_ref': None,
                                                  'field_ref': {'api_version': 'v1',
                                                                'field_path': 'status.podIP'},
                                                  'resource_field_ref': None,
                                                  'secret_key_ref': None}}],
                          'env_from': [{'config_map_ref': {'name': 'env-vars',
                                                           'optional': None},
                                        'prefix': None,
                                        'secret_ref': None}],
                          'image': 'ollivier/clearwater-ralf:latest',
                          'image_pull_policy': 'Always',
                          'lifecycle': None,
                          'liveness_probe': {'_exec': None,
                                             'failure_threshold': 3,
                                             'http_get': None,
                                             'initial_delay_seconds': 30,
                                             'period_seconds': 10,
                                             'success_threshold': 1,
                                             'tcp_socket': {'host': None,
                                                            'port': 10888},
                                             'timeout_seconds': 1},
                          'name': 'ralf',
                          'ports': [{'container_port': 22,
                                     'host_ip': None,
                                     'host_port': None,
                                     'name': None,
                                     'protocol': 'TCP'},
                                    {'container_port': 10888,
                                     'host_ip': None,
                                     'host_port': None,
                                     'name': None,
                                     'protocol': 'TCP'}],
                          'readiness_probe': {'_exec': None,
                                              'failure_threshold': 3,
                                              'http_get': None,
                                              'initial_delay_seconds': None,
                                              'period_seconds': 10,
                                              'success_threshold': 1,
                                              'tcp_socket': {'host': None,
                                                             'port': 10888},
                                              'timeout_seconds': 1},
                          'resources': {'limits': None, 'requests': None},
                          'security_context': None,
                          'stdin': None,
                          'stdin_once': None,
                          'termination_message_path': '/dev/termination-log',
                          'termination_message_policy': 'File',
                          'tty': None,
                          'volume_devices': None,
                          'volume_mounts': [{'mount_path': '/var/log/ralf',
                                             'mount_propagation': None,
                                             'name': 'ralflogs',
                                             'read_only': None,
                                             'sub_path': None,
                                             'sub_path_expr': None},
                                            {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
                                             'mount_propagation': None,
                                             'name': 'default-token-8x245',
                                             'read_only': True,
                                             'sub_path': None,
                                             'sub_path_expr': None}],
                          'working_dir': None},
                         {'args': None,
                          'command': ['tail',
                                      '-F',
                                      '/var/log/ralf/ralf_current.txt'],
                          'env': None,
                          'env_from': None,
                          'image': 'busybox',
                          'image_pull_policy': 'Always',
                          'lifecycle': None,
                          'liveness_probe': None,
                          'name': 'tailer',
                          'ports': None,
                          'readiness_probe': None,
                          'resources': {'limits': None, 'requests': None},
                          'security_context': None,
                          'stdin': None,
                          'stdin_once': None,
                          'termination_message_path': '/dev/termination-log',
                          'termination_message_policy': 'File',
                          'tty': None,
                          'volume_devices': None,
                          'volume_mounts': [{'mount_path': '/var/log/ralf',
                                             'mount_propagation': None,
                                             'name': 'ralflogs',
                                             'read_only': None,
                                             'sub_path': None,
                                             'sub_path_expr': None},
                                            {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
                                             'mount_propagation': None,
                                             'name': 'default-token-8x245',
                                             'read_only': True,
                                             'sub_path': None,
                                             'sub_path_expr': None}],
                          'working_dir': None}],
          'dns_config': None,
          'dns_policy': 'ClusterFirst',
          'enable_service_links': True,
          'host_aliases': None,
          'host_ipc': None,
          'host_network': None,
          'host_pid': None,
          'hostname': None,
          'image_pull_secrets': [{'name': None}],
          'init_containers': [{'args': None,
                               'command': ['sh',
                                           '-c',
                                           'until nslookup cassandra; do echo '
                                           'waiting for cassandra to start '
                                           '...; sleep 2; done'],
                               'env': None,
                               'env_from': None,
                               'image': 'busybox:1.28',
                               'image_pull_policy': 'IfNotPresent',
                               'lifecycle': None,
                               'liveness_probe': None,
                               'name': 'wait-on-cassandra',
                               'ports': None,
                               'readiness_probe': None,
                               'resources': {'limits': None, 'requests': None},
                               'security_context': None,
                               'stdin': None,
                               'stdin_once': None,
                               'termination_message_path': '/dev/termination-log',
                               'termination_message_policy': 'File',
                               'tty': None,
                               'volume_devices': None,
                               'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
                                                  'mount_propagation': None,
                                                  'name': 'default-token-8x245',
                                                  'read_only': True,
                                                  'sub_path': None,
                                                  'sub_path_expr': None}],
                               'working_dir': None}],
          'node_name': 'iruya-worker2',
          'node_selector': None,
          'priority': 0,
          'priority_class_name': None,
          'readiness_gates': None,
          'restart_policy': 'Always',
          'runtime_class_name': None,
          'scheduler_name': 'default-scheduler',
          'security_context': {'fs_group': None,
                               'run_as_group': None,
                               'run_as_non_root': None,
                               'run_as_user': None,
                               'se_linux_options': None,
                               'supplemental_groups': None,
                               'sysctls': None},
          'service_account': 'default',
          'service_account_name': 'default',
          'share_process_namespace': None,
          'subdomain': None,
          'termination_grace_period_seconds': 30,
          'tolerations': [{'effect': 'NoExecute',
                           'key': 'node.kubernetes.io/not-ready',
                           'operator': 'Exists',
                           'toleration_seconds': 300,
                           'value': None},
                          {'effect': 'NoExecute',
                           'key': 'node.kubernetes.io/unreachable',
                           'operator': 'Exists',
                           'toleration_seconds': 300,
                           'value': None}],
          'volumes': [{'aws_elastic_block_store': None,
                       'azure_disk': None,
                       'azure_file': None,
                       'cephfs': None,
                       'cinder': None,
                       'config_map': None,
                       'csi': None,
                       'downward_api': None,
                       'empty_dir': {'medium': None, 'size_limit': None},
                       'fc': None,
                       'flex_volume': None,
                       'flocker': None,
                       'gce_persistent_disk': None,
                       'git_repo': None,
                       'glusterfs': None,
                       'host_path': None,
                       'iscsi': None,
                       'name': 'ralflogs',
                       'nfs': None,
                       'persistent_volume_claim': None,
                       'photon_persistent_disk': None,
                       'portworx_volume': None,
                       'projected': None,
                       'quobyte': None,
                       'rbd': None,
                       'scale_io': None,
                       'secret': None,
                       'storageos': None,
                       'vsphere_volume': None},
                      {'aws_elastic_block_store': None,
                       'azure_disk': None,
                       'azure_file': None,
                       'cephfs': None,
                       'cinder': None,
                       'config_map': None,
                       'csi': None,
                       'downward_api': None,
                       'empty_dir': None,
                       'fc': None,
                       'flex_volume': None,
                       'flocker': None,
                       'gce_persistent_disk': None,
                       'git_repo': None,
                       'glusterfs': None,
                       'host_path': None,
                       'iscsi': None,
                       'name': 'default-token-8x245',
                       'nfs': None,
                       'persistent_volume_claim': None,
                       'photon_persistent_disk': None,
                       'portworx_volume': None,
                       'projected': None,
                       'quobyte': None,
                       'rbd': None,
                       'scale_io': None,
                       'secret': {'default_mode': 420,
                                  'items': None,
                                  'optional': None,
                                  'secret_name': 'default-token-8x245'},
                       'storageos': None,
                       'vsphere_volume': None}]},
 'status': {'conditions': [{'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 1, 49, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'Initialized'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 2, 10, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'Ready'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 2, 10, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'ContainersReady'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'PodScheduled'}],
            'container_statuses': [{'container_id': 'containerd://ced19a0a95b463110cc5d6d48088cefcfb82d6727dedf0c0c96319c8f7a772ae',
                                    'image': 'docker.io/ollivier/clearwater-ralf:latest',
                                    'image_id': 'docker.io/ollivier/clearwater-ralf@sha256:adfa3978f2c94734010c014a2be7db9bc328419e0a205904543a86cd0719bd1a',
                                    'last_state': {'running': None,
                                                   'terminated': None,
                                                   'waiting': None},
                                    'name': 'ralf',
                                    'ready': True,
                                    'restart_count': 0,
                                    'state': {'running': {'started_at': datetime.datetime(2020, 8, 19, 4, 1, 53, tzinfo=tzlocal())},
                                              'terminated': None,
                                              'waiting': None}},
                                   {'container_id': 'containerd://fc8084d26e5be72808656ca182bae0ce5b0c378eb458af39cbb7f313c601acf6',
                                    'image': 'docker.io/library/busybox:latest',
                                    'image_id': 'docker.io/library/busybox@sha256:4f47c01fa91355af2865ac10fef5bf6ec9c7f42ad2321377c21e844427972977',
                                    'last_state': {'running': None,
                                                   'terminated': None,
                                                   'waiting': None},
                                    'name': 'tailer',
                                    'ready': True,
                                    'restart_count': 0,
                                    'state': {'running': {'started_at': datetime.datetime(2020, 8, 19, 4, 1, 56, tzinfo=tzlocal())},
                                              'terminated': None,
                                              'waiting': None}}],
            'host_ip': '172.18.0.5',
            'init_container_statuses': [{'container_id': 'containerd://f213a145b5e78541cfb76cf6fc264921ffe9a5db33caa8d328314cdd86331f40',
                                         'image': 'docker.io/library/busybox:1.28',
                                         'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47',
                                         'last_state': {'running': None,
                                                        'terminated': None,
                                                        'waiting': None},
                                         'name': 'wait-on-cassandra',
                                         'ready': True,
                                         'restart_count': 0,
                                         'state': {'running': None,
                                                   'terminated': {'container_id': 'containerd://f213a145b5e78541cfb76cf6fc264921ffe9a5db33caa8d328314cdd86331f40',
                                                                  'exit_code': 0,
                                                                  'finished_at': datetime.datetime(2020, 8, 19, 4, 1, 48, tzinfo=tzlocal()),
                                                                  'message': None,
                                                                  'reason': 'Completed',
                                                                  'signal': None,
                                                                  'started_at': datetime.datetime(2020, 8, 19, 3, 59, 54, tzinfo=tzlocal())},
                                                   'waiting': None}}],
            'message': None,
            'nominated_node_name': None,
            'phase': 'Running',
            'pod_ip': '10.244.2.198',
            'qos_class': 'BestEffort',
            'reason': None,
            'start_time': datetime.datetime(2020, 8, 19, 3, 59, 42, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'ralf-57c4654cb8-pg4gb', 'generateName': 'ralf-57c4654cb8-', 'namespace': 'ims-h4q84', 'selfLink': '/api/v1/namespaces/ims-h4q84/pods/ralf-57c4654cb8-pg4gb', 'uid': '813af80c-f9bb-4971-b0f2-01cda83defb2', 'resourceVersion': '981612', 'creationTimestamp': '2020-08-19T03:59:41Z', 'labels': {'pod-template-hash': '57c4654cb8', 'service': 'ralf', 'snmp': 'enabled'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'ralf-57c4654cb8', 'uid': '5e8345dd-6129-446c-ba42-7e0d02e72dd9', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'ralflogs', 'emptyDir': {}}, {'name': 'default-token-8x245', 'secret': {'secretName': 'default-token-8x245', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-8x245', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'ralf', 'image': 'ollivier/clearwater-ralf:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 10888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}, {'name': 'default-token-8x245', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'tcpSocket': {'port': 10888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 10888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}, {'name': 'default-token-8x245', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:01:49Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:02:10Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:02:10Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T03:59:41Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.2.198', 'startTime': '2020-08-19T03:59:42Z', 'initContainerStatuses': [{'name': 'wait-on-cassandra', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-08-19T03:59:54Z', 'finishedAt': '2020-08-19T04:01:48Z', 'containerID': 'containerd://f213a145b5e78541cfb76cf6fc264921ffe9a5db33caa8d328314cdd86331f40'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://f213a145b5e78541cfb76cf6fc264921ffe9a5db33caa8d328314cdd86331f40'}], 'containerStatuses': [{'name': 'ralf', 'state': {'running': {'startedAt': '2020-08-19T04:01:53Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-ralf:latest', 'imageID': 'docker.io/ollivier/clearwater-ralf@sha256:adfa3978f2c94734010c014a2be7db9bc328419e0a205904543a86cd0719bd1a', 'containerID': 'containerd://ced19a0a95b463110cc5d6d48088cefcfb82d6727dedf0c0c96319c8f7a772ae'}, {'name': 'tailer', 'state': {'running': {'startedAt': '2020-08-19T04:01:56Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:latest', 'imageID': 'docker.io/library/busybox@sha256:4f47c01fa91355af2865ac10fef5bf6ec9c7f42ad2321377c21e844427972977', 'containerID': 'containerd://fc8084d26e5be72808656ca182bae0ce5b0c378eb458af39cbb7f313c601acf6'}], 'qosClass': 'BestEffort'}}}
2020-08-19 04:08:30,855 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1',
 'kind': 'Pod',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': 'homestead-57586d6cdc-',
              'generation': None,
              'initializers': None,
              'labels': {'pod-template-hash': '57586d6cdc',
                         'service': 'homestead',
                         'snmp': 'enabled'},
              'managed_fields': None,
              'name': 'homestead-57586d6cdc-dhd8m',
              'namespace': 'ims-h4q84',
              'owner_references': [{'api_version': 'apps/v1',
                                    'block_owner_deletion': True,
                                    'controller': True,
                                    'kind': 'ReplicaSet',
                                    'name': 'homestead-57586d6cdc',
                                    'uid': '43bcc377-301b-413d-a5be-8842e7fa08fd'}],
              'resource_version': '981826',
              'self_link': '/api/v1/namespaces/ims-h4q84/pods/homestead-57586d6cdc-dhd8m',
              'uid': '5ff20270-8f27-4e9c-931b-cb1ef61ef244'},
 'spec': {'active_deadline_seconds': None,
          'affinity': None,
          'automount_service_account_token': None,
          'containers': [{'args': None,
                          'command': None,
                          'env': [{'name': 'MY_POD_IP',
                                   'value': None,
                                   'value_from': {'config_map_key_ref': None,
                                                  'field_ref': {'api_version': 'v1',
                                                                'field_path': 'status.podIP'},
                                                  'resource_field_ref': None,
                                                  'secret_key_ref': None}}],
                          'env_from': [{'config_map_ref': {'name': 'env-vars',
                                                           'optional': None},
                                        'prefix': None,
                                        'secret_ref': None}],
                          'image': 'ollivier/clearwater-homestead:latest',
                          'image_pull_policy': 'Always',
                          'lifecycle': None,
                          'liveness_probe': {'_exec': {'command': ['/bin/bash',
                                                                   '/usr/share/kubernetes/liveness.sh',
                                                                   '8888']},
                                             'failure_threshold': 3,
                                             'http_get': None,
                                             'initial_delay_seconds': 60,
                                             'period_seconds': 10,
                                             'success_threshold': 1,
                                             'tcp_socket': None,
                                             'timeout_seconds': 1},
                          'name': 'homestead',
                          'ports': [{'container_port': 22,
                                     'host_ip': None,
                                     'host_port': None,
                                     'name': None,
                                     'protocol': 'TCP'},
                                    {'container_port': 8888,
                                     'host_ip': None,
                                     'host_port': None,
                                     'name': None,
                                     'protocol': 'TCP'}],
                          'readiness_probe': {'_exec': {'command': ['/bin/bash',
                                                                    '/usr/share/kubernetes/liveness.sh',
                                                                    '8888']},
                                              'failure_threshold': 3,
                                              'http_get': None,
                                              'initial_delay_seconds': None,
                                              'period_seconds': 10,
                                              'success_threshold': 1,
                                              'tcp_socket': None,
                                              'timeout_seconds': 1},
                          'resources': {'limits': None, 'requests': None},
                          'security_context': None,
                          'stdin': None,
                          'stdin_once': None,
                          'termination_message_path': '/dev/termination-log',
                          'termination_message_policy': 'File',
                          'tty': None,
                          'volume_devices': None,
                          'volume_mounts': [{'mount_path': '/var/log/homestead',
                                             'mount_propagation': None,
                                             'name': 'homesteadlogs',
                                             'read_only': None,
                                             'sub_path': None,
                                             'sub_path_expr': None},
                                            {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
                                             'mount_propagation': None,
                                             'name': 'default-token-8x245',
                                             'read_only': True,
                                             'sub_path': None,
                                             'sub_path_expr': None}],
                          'working_dir': None},
                         {'args': None,
                          'command': ['tail',
                                      '-F',
                                      '/var/log/homestead/homestead_current.txt'],
                          'env': None,
                          'env_from': None,
                          'image': 'busybox',
                          'image_pull_policy': 'Always',
                          'lifecycle': None,
                          'liveness_probe': None,
                          'name': 'tailer',
                          'ports': None,
                          'readiness_probe': None,
                          'resources': {'limits': None, 'requests': None},
                          'security_context': None,
                          'stdin': None,
                          'stdin_once': None,
                          'termination_message_path': '/dev/termination-log',
                          'termination_message_policy': 'File',
                          'tty': None,
                          'volume_devices': None,
                          'volume_mounts': [{'mount_path': '/var/log/homestead',
                                             'mount_propagation': None,
                                             'name': 'homesteadlogs',
                                             'read_only': None,
                                             'sub_path': None,
                                             'sub_path_expr': None},
                                            {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
                                             'mount_propagation': None,
                                             'name': 'default-token-8x245',
                                             'read_only': True,
                                             'sub_path': None,
                                             'sub_path_expr': None}],
                          'working_dir': None}],
          'dns_config': None,
          'dns_policy': 'ClusterFirst',
          'enable_service_links': True,
          'host_aliases': None,
          'host_ipc': None,
          'host_network': None,
          'host_pid': None,
          'hostname': None,
          'image_pull_secrets': [{'name': None}],
          'init_containers': [{'args': None,
                               'command': ['sh',
                                           '-c',
                                           'until nslookup cassandra; do echo '
                                           'waiting for cassandra to start '
                                           '...; sleep 2; done'],
                               'env': None,
                               'env_from': None,
                               'image': 'busybox:1.28',
                               'image_pull_policy': 'IfNotPresent',
                               'lifecycle': None,
                               'liveness_probe': None,
                               'name': 'wait-on-cassandra',
                               'ports': None,
                               'readiness_probe': None,
                               'resources': {'limits': None, 'requests': None},
                               'security_context': None,
                               'stdin': None,
                               'stdin_once': None,
                               'termination_message_path': '/dev/termination-log',
                               'termination_message_policy': 'File',
                               'tty': None,
                               'volume_devices': None,
                               'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
                                                  'mount_propagation': None,
                                                  'name': 'default-token-8x245',
                                                  'read_only': True,
                                                  'sub_path': None,
                                                  'sub_path_expr': None}],
                               'working_dir': None},
                              {'args': None,
                               'command': ['sh',
                                           '-c',
                                           'until nslookup astaire; do echo '
                                           'waiting for astaire to start ...; '
                                           'sleep 2; done'],
                               'env': None,
                               'env_from': None,
                               'image': 'busybox:1.28',
                               'image_pull_policy': 'IfNotPresent',
                               'lifecycle': None,
                               'liveness_probe': None,
                               'name': 'wait-on-astaire',
                               'ports': None,
                               'readiness_probe': None,
                               'resources': {'limits': None, 'requests': None},
                               'security_context': None,
                               'stdin': None,
                               'stdin_once': None,
                               'termination_message_path': '/dev/termination-log',
                               'termination_message_policy': 'File',
                               'tty': None,
                               'volume_devices': None,
                               'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
                                                  'mount_propagation': None,
                                                  'name': 'default-token-8x245',
                                                  'read_only': True,
                                                  'sub_path': None,
                                                  'sub_path_expr': None}],
                               'working_dir': None}],
          'node_name': 'iruya-worker2',
          'node_selector': None,
          'priority': 0,
          'priority_class_name': None,
          'readiness_gates': None,
          'restart_policy': 'Always',
          'runtime_class_name': None,
          'scheduler_name': 'default-scheduler',
          'security_context': {'fs_group': None,
                               'run_as_group': None,
                               'run_as_non_root': None,
                               'run_as_user': None,
                               'se_linux_options': None,
                               'supplemental_groups': None,
                               'sysctls': None},
          'service_account': 'default',
          'service_account_name': 'default',
          'share_process_namespace': None,
          'subdomain': None,
          'termination_grace_period_seconds': 30,
          'tolerations': [{'effect': 'NoExecute',
                           'key': 'node.kubernetes.io/not-ready',
                           'operator': 'Exists',
                           'toleration_seconds': 300,
                           'value': None},
                          {'effect': 'NoExecute',
                           'key': 'node.kubernetes.io/unreachable',
                           'operator': 'Exists',
                           'toleration_seconds': 300,
                           'value': None}],
          'volumes': [{'aws_elastic_block_store': None,
                       'azure_disk': None,
                       'azure_file': None,
                       'cephfs': None,
                       'cinder': None,
                       'config_map': None,
                       'csi': None,
                       'downward_api': None,
                       'empty_dir': {'medium': None, 'size_limit': None},
                       'fc': None,
                       'flex_volume': None,
                       'flocker': None,
                       'gce_persistent_disk': None,
                       'git_repo': None,
                       'glusterfs': None,
                       'host_path': None,
                       'iscsi': None,
                       'name': 'homesteadlogs',
                       'nfs': None,
                       'persistent_volume_claim': None,
                       'photon_persistent_disk': None,
                       'portworx_volume': None,
                       'projected': None,
                       'quobyte': None,
                       'rbd': None,
                       'scale_io': None,
                       'secret': None,
                       'storageos': None,
                       'vsphere_volume': None},
                      {'aws_elastic_block_store': None,
                       'azure_disk': None,
                       'azure_file': None,
                       'cephfs': None,
                       'cinder': None,
                       'config_map': None,
                       'csi': None,
                       'downward_api': None,
                       'empty_dir': None,
                       'fc': None,
                       'flex_volume': None,
                       'flocker': None,
                       'gce_persistent_disk': None,
                       'git_repo': None,
                       'glusterfs': None,
                       'host_path': None,
                       'iscsi': None,
                       'name': 'default-token-8x245',
                       'nfs': None,
                       'persistent_volume_claim': None,
                       'photon_persistent_disk': None,
                       'portworx_volume': None,
                       'projected': None,
                       'quobyte': None,
                       'rbd': None,
                       'scale_io': None,
                       'secret': {'default_mode': 420,
                                  'items': None,
                                  'optional': None,
                                  'secret_name': 'default-token-8x245'},
                       'storageos': None,
                       'vsphere_volume': None}]},
 'status': {'conditions': [{'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 3, 27, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'Initialized'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 3, 38, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'Ready'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 3, 38, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'ContainersReady'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'PodScheduled'}],
            'container_statuses': [{'container_id': 'containerd://ae42b6cd99090f34fcb2cafb87188eb223ec49059faf132d04330f97b29f70c7',
                                    'image': 'docker.io/ollivier/clearwater-homestead:latest',
                                    'image_id': 'docker.io/ollivier/clearwater-homestead@sha256:98347f9bf0eaf79649590e3fa0ea8d1938ae50d7703e8f9c171f0d74520ac7fb',
                                    'last_state': {'running': None,
                                                   'terminated': None,
                                                   'waiting': None},
                                    'name': 'homestead',
                                    'ready': True,
                                    'restart_count': 0,
                                    'state': {'running': {'started_at': datetime.datetime(2020, 8, 19, 4, 3, 31, tzinfo=tzlocal())},
                                              'terminated': None,
                                              'waiting': None}},
                                   {'container_id': 'containerd://b0770c8e3b59ce8479d29ac7264946cd506eabd9b81705677b467885da3c84f2',
                                    'image': 'docker.io/library/busybox:latest',
                                    'image_id': 'docker.io/library/busybox@sha256:4f47c01fa91355af2865ac10fef5bf6ec9c7f42ad2321377c21e844427972977',
                                    'last_state': {'running': None,
                                                   'terminated': None,
                                                   'waiting': None},
                                    'name': 'tailer',
                                    'ready': True,
                                    'restart_count': 0,
                                    'state': {'running': {'started_at': datetime.datetime(2020, 8, 19, 4, 3, 34, tzinfo=tzlocal())},
                                              'terminated': None,
                                              'waiting': None}}],
            'host_ip': '172.18.0.5',
            'init_container_statuses': [{'container_id': 'containerd://40be67bb9a8156dbf702dd3fe4c3f4bafc11aee92a4b673226c8acd16bdf3d79',
                                         'image': 'docker.io/library/busybox:1.28',
                                         'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47',
                                         'last_state': {'running': None,
                                                        'terminated': None,
                                                        'waiting': None},
                                         'name': 'wait-on-cassandra',
                                         'ready': True,
                                         'restart_count': 0,
                                         'state': {'running': None,
                                                   'terminated': {'container_id': 'containerd://40be67bb9a8156dbf702dd3fe4c3f4bafc11aee92a4b673226c8acd16bdf3d79',
                                                                  'exit_code': 0,
                                                                  'finished_at': datetime.datetime(2020, 8, 19, 4, 1, 48, tzinfo=tzlocal()),
                                                                  'message': None,
                                                                  'reason': 'Completed',
                                                                  'signal': None,
                                                                  'started_at': datetime.datetime(2020, 8, 19, 3, 59, 53, tzinfo=tzlocal())},
                                                   'waiting': None}},
                                        {'container_id': 'containerd://ed414e81d7b18f84579cdf0216421941da4cfdec8902a295504d65c6e8f72a48',
                                         'image': 'docker.io/library/busybox:1.28',
                                         'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47',
                                         'last_state': {'running': None,
                                                        'terminated': None,
                                                        'waiting': None},
                                         'name': 'wait-on-astaire',
                                         'ready': True,
                                         'restart_count': 0,
                                         'state': {'running': None,
                                                   'terminated': {'container_id': 'containerd://ed414e81d7b18f84579cdf0216421941da4cfdec8902a295504d65c6e8f72a48',
                                                                  'exit_code': 0,
                                                                  'finished_at': datetime.datetime(2020, 8, 19, 4, 3, 26, tzinfo=tzlocal()),
                                                                  'message': None,
                                                                  'reason': 'Completed',
                                                                  'signal': None,
                                                                  'started_at': datetime.datetime(2020, 8, 19, 4, 1, 52, tzinfo=tzlocal())},
                                                   'waiting': None}}],
            'message': None,
            'nominated_node_name': None,
            'phase': 'Running',
            'pod_ip': '10.244.2.197',
            'qos_class': 'BestEffort',
            'reason': None,
            'start_time': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'homestead-57586d6cdc-dhd8m', 'generateName': 'homestead-57586d6cdc-', 'namespace': 'ims-h4q84', 'selfLink': '/api/v1/namespaces/ims-h4q84/pods/homestead-57586d6cdc-dhd8m', 'uid': '5ff20270-8f27-4e9c-931b-cb1ef61ef244', 'resourceVersion': '981826', 'creationTimestamp': '2020-08-19T03:59:41Z', 'labels': {'pod-template-hash': '57586d6cdc', 'service': 'homestead', 'snmp': 'enabled'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'homestead-57586d6cdc', 'uid': '43bcc377-301b-413d-a5be-8842e7fa08fd', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'homesteadlogs', 'emptyDir': {}}, {'name': 'default-token-8x245', 'secret': {'secretName': 'default-token-8x245', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-8x245', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-astaire', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup astaire; do echo waiting for astaire to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-8x245', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead', 'image': 'ollivier/clearwater-homestead:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'homesteadlogs', 'mountPath': '/var/log/homestead'}, {'name': 'default-token-8x245', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/homestead/homestead_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'homesteadlogs', 'mountPath': '/var/log/homestead'}, {'name': 'default-token-8x245', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:03:27Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:03:38Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:03:38Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T03:59:41Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.2.197', 'startTime': '2020-08-19T03:59:41Z', 'initContainerStatuses': [{'name': 'wait-on-cassandra', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-08-19T03:59:53Z', 'finishedAt': '2020-08-19T04:01:48Z', 'containerID': 'containerd://40be67bb9a8156dbf702dd3fe4c3f4bafc11aee92a4b673226c8acd16bdf3d79'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://40be67bb9a8156dbf702dd3fe4c3f4bafc11aee92a4b673226c8acd16bdf3d79'}, {'name': 'wait-on-astaire', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-08-19T04:01:52Z', 'finishedAt': '2020-08-19T04:03:26Z', 'containerID': 'containerd://ed414e81d7b18f84579cdf0216421941da4cfdec8902a295504d65c6e8f72a48'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://ed414e81d7b18f84579cdf0216421941da4cfdec8902a295504d65c6e8f72a48'}], 'containerStatuses': [{'name': 'homestead', 'state': {'running': {'startedAt': '2020-08-19T04:03:31Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-homestead:latest', 'imageID': 'docker.io/ollivier/clearwater-homestead@sha256:98347f9bf0eaf79649590e3fa0ea8d1938ae50d7703e8f9c171f0d74520ac7fb', 'containerID': 'containerd://ae42b6cd99090f34fcb2cafb87188eb223ec49059faf132d04330f97b29f70c7'}, {'name': 'tailer', 'state': {'running': {'startedAt': '2020-08-19T04:03:34Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:latest', 'imageID': 'docker.io/library/busybox@sha256:4f47c01fa91355af2865ac10fef5bf6ec9c7f42ad2321377c21e844427972977', 'containerID': 'containerd://b0770c8e3b59ce8479d29ac7264946cd506eabd9b81705677b467885da3c84f2'}], 'qosClass': 'BestEffort'}}}
2020-08-19 04:08:31,199 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1',
 'kind': 'Pod',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 42, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': 'sprout-686cc64cfb-',
              'generation': None,
              'initializers': None,
              'labels': {'pod-template-hash': '686cc64cfb',
                         'service': 'sprout',
                         'snmp': 'enabled'},
              'managed_fields': None,
              'name': 'sprout-686cc64cfb-z45kq',
              'namespace': 'ims-h4q84',
              'owner_references': [{'api_version': 'apps/v1',
                                    'block_owner_deletion': True,
                                    'controller': True,
                                    'kind': 'ReplicaSet',
                                    'name': 'sprout-686cc64cfb',
                                    'uid': '5a0517b1-db57-438f-9458-3c59b296420e'}],
              'resource_version': '981888',
              'self_link': '/api/v1/namespaces/ims-h4q84/pods/sprout-686cc64cfb-z45kq',
              'uid': '98fcb0c9-7e2f-4b94-89cb-041c640d847c'},
 'spec': {'active_deadline_seconds': None,
          'affinity': None,
          'automount_service_account_token': None,
          'containers': [{'args': None,
                          'command': None,
                          'env': [{'name': 'MY_POD_IP',
                                   'value': None,
                                   'value_from': {'config_map_key_ref': None,
                                                  'field_ref': {'api_version': 'v1',
                                                                'field_path': 'status.podIP'},
                                                  'resource_field_ref': None,
                                                  'secret_key_ref': None}}],
                          'env_from': [{'config_map_ref': {'name': 'env-vars',
                                                           'optional': None},
                                        'prefix': None,
                                        'secret_ref': None}],
                          'image': 'ollivier/clearwater-sprout:latest',
                          'image_pull_policy': 'Always',
                          'lifecycle': None,
                          'liveness_probe': {'_exec': {'command': ['/bin/bash',
                                                                   '/usr/share/kubernetes/liveness.sh',
                                                                   '5052 '
                                                                   '5054']},
                                             'failure_threshold': 3,
                                             'http_get': None,
                                             'initial_delay_seconds': 30,
                                             'period_seconds': 3,
                                             'success_threshold': 1,
                                             'tcp_socket': None,
                                             'timeout_seconds': 1},
                          'name': 'sprout',
                          'ports': [{'container_port': 22,
                                     'host_ip': None,
                                     'host_port': None,
                                     'name': None,
                                     'protocol': 'TCP'}],
                          'readiness_probe': {'_exec': {'command': ['/bin/bash',
                                                                    '/usr/share/kubernetes/liveness.sh',
                                                                    '5052 '
                                                                    '5054']},
                                              'failure_threshold': 3,
                                              'http_get': None,
                                              'initial_delay_seconds': None,
                                              'period_seconds': 10,
                                              'success_threshold': 1,
                                              'tcp_socket': None,
                                              'timeout_seconds': 1},
                          'resources': {'limits': None, 'requests': None},
                          'security_context': None,
                          'stdin': None,
                          'stdin_once': None,
                          'termination_message_path': '/dev/termination-log',
                          'termination_message_policy': 'File',
                          'tty': None,
                          'volume_devices': None,
                          'volume_mounts': [{'mount_path': '/var/log/sprout',
                                             'mount_propagation': None,
                                             'name': 'sproutlogs',
                                             'read_only': None,
                                             'sub_path': None,
                                             'sub_path_expr': None},
                                            {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
                                             'mount_propagation': None,
                                             'name': 'default-token-8x245',
                                             'read_only': True,
                                             'sub_path': None,
                                             'sub_path_expr': None}],
                          'working_dir': None},
                         {'args': None,
                          'command': ['tail',
                                      '-F',
                                      '/var/log/sprout/sprout_current.txt'],
                          'env': None,
                          'env_from': None,
                          'image': 'busybox',
                          'image_pull_policy': 'Always',
                          'lifecycle': None,
                          'liveness_probe': None,
                          'name': 'tailer',
                          'ports': None,
                          'readiness_probe': None,
                          'resources': {'limits': None, 'requests': None},
                          'security_context': None,
                          'stdin': None,
                          'stdin_once': None,
                          'termination_message_path': '/dev/termination-log',
                          'termination_message_policy': 'File',
                          'tty': None,
                          'volume_devices': None,
                          'volume_mounts': [{'mount_path': '/var/log/sprout',
                                             'mount_propagation': None,
                                             'name': 'sproutlogs',
                                             'read_only': None,
                                             'sub_path': None,
                                             'sub_path_expr': None},
                                            {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
                                             'mount_propagation': None,
                                             'name': 'default-token-8x245',
                                             'read_only': True,
                                             'sub_path': None,
                                             'sub_path_expr': None}],
                          'working_dir': None}],
          'dns_config': None,
          'dns_policy': 'ClusterFirst',
          'enable_service_links': True,
          'host_aliases': None,
          'host_ipc': None,
          'host_network': None,
          'host_pid': None,
          'hostname': None,
          'image_pull_secrets': [{'name': None}],
          'init_containers': [{'args': None,
                               'command': ['sh',
                                           '-c',
                                           'until nslookup ralf; do echo '
                                           'waiting for ralf to start ...; '
                                           'sleep 2; done'],
                               'env': None,
                               'env_from': None,
                               'image': 'busybox:1.28',
                               'image_pull_policy': 'IfNotPresent',
                               'lifecycle': None,
                               'liveness_probe': None,
                               'name': 'wait-on-ralf',
                               'ports': None,
                               'readiness_probe': None,
                               'resources': {'limits': None, 'requests': None},
                               'security_context': None,
                               'stdin': None,
                               'stdin_once': None,
                               'termination_message_path': '/dev/termination-log',
                               'termination_message_policy': 'File',
                               'tty': None,
                               'volume_devices': None,
                               'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
                                                  'mount_propagation': None,
                                                  'name': 'default-token-8x245',
                                                  'read_only': True,
                                                  'sub_path': None,
                                                  'sub_path_expr': None}],
                               'working_dir': None},
                              {'args': None,
                               'command': ['sh',
                                           '-c',
                                           'until nslookup chronos; do echo '
                                           'waiting for chronos to start ...; '
                                           'sleep 2; done'],
                               'env': None,
                               'env_from': None,
                               'image': 'busybox:1.28',
                               'image_pull_policy': 'IfNotPresent',
                               'lifecycle': None,
                               'liveness_probe': None,
                               'name': 'wait-on-chronos',
                               'ports': None,
                               'readiness_probe': None,
                               'resources': {'limits': None, 'requests': None},
                               'security_context': None,
                               'stdin': None,
                               'stdin_once': None,
                               'termination_message_path': '/dev/termination-log',
                               'termination_message_policy': 'File',
                               'tty': None,
                               'volume_devices': None,
                               'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
                                                  'mount_propagation': None,
                                                  'name': 'default-token-8x245',
                                                  'read_only': True,
                                                  'sub_path': None,
                                                  'sub_path_expr': None}],
                               'working_dir': None},
                              {'args': None,
                               'command': ['sh',
                                           '-c',
                                           'until nslookup homestead; do echo '
                                           'waiting for homestead to start '
                                           '...; sleep 2; done'],
                               'env': None,
                               'env_from': None,
                               'image': 'busybox:1.28',
                               'image_pull_policy': 'IfNotPresent',
                               'lifecycle': None,
                               'liveness_probe': None,
                               'name': 'wait-on-homestead',
                               'ports': None,
                               'readiness_probe': None,
                               'resources': {'limits': None, 'requests': None},
                               'security_context': None,
                               'stdin': None,
                               'stdin_once': None,
                               'termination_message_path': '/dev/termination-log',
                               'termination_message_policy': 'File',
                               'tty': None,
                               'volume_devices': None,
                               'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
                                                  'mount_propagation': None,
                                                  'name': 'default-token-8x245',
                                                  'read_only': True,
                                                  'sub_path': None,
                                                  'sub_path_expr': None}],
                               'working_dir': None}],
          'node_name': 'iruya-worker',
          'node_selector': None,
          'priority': 0,
          'priority_class_name': None,
          'readiness_gates': None,
          'restart_policy': 'Always',
          'runtime_class_name': None,
          'scheduler_name': 'default-scheduler',
          'security_context': {'fs_group': None,
                               'run_as_group': None,
                               'run_as_non_root': None,
                               'run_as_user': None,
                               'se_linux_options': None,
                               'supplemental_groups': None,
                               'sysctls': None},
          'service_account': 'default',
          'service_account_name': 'default',
          'share_process_namespace': None,
          'subdomain': None,
          'termination_grace_period_seconds': 30,
          'tolerations': [{'effect': 'NoExecute',
                           'key': 'node.kubernetes.io/not-ready',
                           'operator': 'Exists',
                           'toleration_seconds': 300,
                           'value': None},
                          {'effect': 'NoExecute',
                           'key': 'node.kubernetes.io/unreachable',
                           'operator': 'Exists',
                           'toleration_seconds': 300,
                           'value': None}],
          'volumes': [{'aws_elastic_block_store': None,
                       'azure_disk': None,
                       'azure_file': None,
                       'cephfs': None,
                       'cinder': None,
                       'config_map': None,
                       'csi': None,
                       'downward_api': None,
                       'empty_dir': {'medium': None, 'size_limit': None},
                       'fc': None,
                       'flex_volume': None,
                       'flocker': None,
                       'gce_persistent_disk': None,
                       'git_repo': None,
                       'glusterfs': None,
                       'host_path': None,
                       'iscsi': None,
                       'name': 'sproutlogs',
                       'nfs': None,
                       'persistent_volume_claim': None,
                       'photon_persistent_disk': None,
                       'portworx_volume': None,
                       'projected': None,
                       'quobyte': None,
                       'rbd': None,
                       'scale_io': None,
                       'secret': None,
                       'storageos': None,
                       'vsphere_volume': None},
                      {'aws_elastic_block_store': None,
                       'azure_disk': None,
                       'azure_file': None,
                       'cephfs': None,
                       'cinder': None,
                       'config_map': None,
                       'csi': None,
                       'downward_api': None,
                       'empty_dir': None,
                       'fc': None,
                       'flex_volume': None,
                       'flocker': None,
                       'gce_persistent_disk': None,
                       'git_repo': None,
                       'glusterfs': None,
                       'host_path': None,
                       'iscsi': None,
                       'name': 'default-token-8x245',
                       'nfs': None,
                       'persistent_volume_claim': None,
                       'photon_persistent_disk': None,
                       'portworx_volume': None,
                       'projected': None,
                       'quobyte': None,
                       'rbd': None,
                       'scale_io': None,
                       'secret': {'default_mode': 420,
                                  'items': None,
                                  'optional': None,
                                  'secret_name': 'default-token-8x245'},
                       'storageos': None,
                       'vsphere_volume': None}]},
 'status': {'conditions': [{'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 3, 43, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'Initialized'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 3, 59, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'Ready'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 3, 59, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'ContainersReady'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 42, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'PodScheduled'}],
            'container_statuses': [{'container_id': 'containerd://dca913e3994387a452e11bdf0ef9cf26201926b20ebf1b2ecf5dd5f06ffe88b0',
                                    'image': 'docker.io/ollivier/clearwater-sprout:latest',
                                    'image_id': 'docker.io/ollivier/clearwater-sprout@sha256:861863a8f603b8851858fcb66492d5fa8af26e14ec84a26da5d75fe762b144b2',
                                    'last_state': {'running': None,
                                                   'terminated': None,
                                                   'waiting': None},
                                    'name': 'sprout',
                                    'ready': True,
                                    'restart_count': 0,
                                    'state': {'running': {'started_at': datetime.datetime(2020, 8, 19, 4, 3, 48, tzinfo=tzlocal())},
                                              'terminated': None,
                                              'waiting': None}},
                                   {'container_id': 'containerd://0eba1253396b0a4fcd076697101b996136bfe6364bf150651c23d423794c0840',
                                    'image': 'docker.io/library/busybox:latest',
                                    'image_id': 'docker.io/library/busybox@sha256:4f47c01fa91355af2865ac10fef5bf6ec9c7f42ad2321377c21e844427972977',
                                    'last_state': {'running': None,
                                                   'terminated': None,
                                                   'waiting': None},
                                    'name': 'tailer',
                                    'ready': True,
                                    'restart_count': 0,
                                    'state': {'running': {'started_at': datetime.datetime(2020, 8, 19, 4, 3, 50, tzinfo=tzlocal())},
                                              'terminated': None,
                                              'waiting': None}}],
            'host_ip': '172.18.0.9',
            'init_container_statuses': [{'container_id': 'containerd://1c78ae8a64a6db9f65b7c10bc36394fd483c3036feaebafaa81ca1368750a72a',
                                         'image': 'docker.io/library/busybox:1.28',
                                         'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47',
                                         'last_state': {'running': None,
                                                        'terminated': None,
                                                        'waiting': None},
                                         'name': 'wait-on-ralf',
                                         'ready': True,
                                         'restart_count': 0,
                                         'state': {'running': None,
                                                   'terminated': {'container_id': 'containerd://1c78ae8a64a6db9f65b7c10bc36394fd483c3036feaebafaa81ca1368750a72a',
                                                                  'exit_code': 0,
                                                                  'finished_at': datetime.datetime(2020, 8, 19, 4, 2, 21, tzinfo=tzlocal()),
                                                                  'message': None,
                                                                  'reason': 'Completed',
                                                                  'signal': None,
                                                                  'started_at': datetime.datetime(2020, 8, 19, 3, 59, 52, tzinfo=tzlocal())},
                                                   'waiting': None}},
                                        {'container_id': 'containerd://8a5dab91bfe0279f9b3e60e546be728bee72fdc552acaeab2e2b73814b0f627c',
                                         'image': 'docker.io/library/busybox:1.28',
                                         'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47',
                                         'last_state': {'running': None,
                                                        'terminated': None,
                                                        'waiting': None},
                                         'name': 'wait-on-chronos',
                                         'ready': True,
                                         'restart_count': 0,
                                         'state': {'running': None,
                                                   'terminated': {'container_id': 'containerd://8a5dab91bfe0279f9b3e60e546be728bee72fdc552acaeab2e2b73814b0f627c',
                                                                  'exit_code': 0,
                                                                  'finished_at': datetime.datetime(2020, 8, 19, 4, 2, 26, tzinfo=tzlocal()),
                                                                  'message': None,
                                                                  'reason': 'Completed',
                                                                  'signal': None,
                                                                  'started_at': datetime.datetime(2020, 8, 19, 4, 2, 26, tzinfo=tzlocal())},
                                                   'waiting': None}},
                                        {'container_id': 'containerd://3997c04657cfcc766e40b5d163af17896ff42d54e4f3bd6e02bd833d0eb642b0',
                                         'image': 'docker.io/library/busybox:1.28',
                                         'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47',
                                         'last_state': {'running': None,
                                                        'terminated': None,
                                                        'waiting': None},
                                         'name': 'wait-on-homestead',
                                         'ready': True,
                                         'restart_count': 0,
                                         'state': {'running': None,
                                                   'terminated': {'container_id': 'containerd://3997c04657cfcc766e40b5d163af17896ff42d54e4f3bd6e02bd833d0eb642b0',
                                                                  'exit_code': 0,
                                                                  'finished_at': datetime.datetime(2020, 8, 19, 4, 3, 42, tzinfo=tzlocal()),
                                                                  'message': None,
                                                                  'reason': 'Completed',
                                                                  'signal': None,
                                                                  'started_at': datetime.datetime(2020, 8, 19, 4, 2, 31, tzinfo=tzlocal())},
                                                   'waiting': None}}],
            'message': None,
            'nominated_node_name': None,
            'phase': 'Running',
            'pod_ip': '10.244.1.127',
            'qos_class': 'BestEffort',
            'reason': None,
            'start_time': datetime.datetime(2020, 8, 19, 3, 59, 42, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'sprout-686cc64cfb-z45kq', 'generateName': 'sprout-686cc64cfb-', 'namespace': 'ims-h4q84', 'selfLink': '/api/v1/namespaces/ims-h4q84/pods/sprout-686cc64cfb-z45kq', 'uid': '98fcb0c9-7e2f-4b94-89cb-041c640d847c', 'resourceVersion': '981888', 'creationTimestamp': '2020-08-19T03:59:42Z', 'labels': {'pod-template-hash': '686cc64cfb', 'service': 'sprout', 'snmp': 'enabled'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'sprout-686cc64cfb', 'uid': '5a0517b1-db57-438f-9458-3c59b296420e', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'sproutlogs', 'emptyDir': {}}, {'name': 'default-token-8x245', 'secret': {'secretName': 'default-token-8x245', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-ralf', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup ralf; do echo waiting for ralf to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-8x245', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-chronos', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup chronos; do echo waiting for chronos to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-8x245', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-homestead', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-8x245', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'sprout', 'image': 'ollivier/clearwater-sprout:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}, {'name': 'default-token-8x245', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 3, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}, {'name': 'default-token-8x245', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:03:43Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:03:59Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:03:59Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T03:59:42Z'}], 'hostIP': '172.18.0.9', 'podIP': '10.244.1.127', 'startTime': '2020-08-19T03:59:42Z', 'initContainerStatuses': [{'name': 'wait-on-ralf', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-08-19T03:59:52Z', 'finishedAt': '2020-08-19T04:02:21Z', 'containerID': 'containerd://1c78ae8a64a6db9f65b7c10bc36394fd483c3036feaebafaa81ca1368750a72a'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://1c78ae8a64a6db9f65b7c10bc36394fd483c3036feaebafaa81ca1368750a72a'}, {'name': 'wait-on-chronos', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-08-19T04:02:26Z', 'finishedAt': '2020-08-19T04:02:26Z', 'containerID': 'containerd://8a5dab91bfe0279f9b3e60e546be728bee72fdc552acaeab2e2b73814b0f627c'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://8a5dab91bfe0279f9b3e60e546be728bee72fdc552acaeab2e2b73814b0f627c'}, {'name': 'wait-on-homestead', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-08-19T04:02:31Z', 'finishedAt': '2020-08-19T04:03:42Z', 'containerID': 'containerd://3997c04657cfcc766e40b5d163af17896ff42d54e4f3bd6e02bd833d0eb642b0'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://3997c04657cfcc766e40b5d163af17896ff42d54e4f3bd6e02bd833d0eb642b0'}], 'containerStatuses': [{'name': 'sprout', 'state': {'running': {'startedAt': '2020-08-19T04:03:48Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-sprout:latest', 'imageID': 'docker.io/ollivier/clearwater-sprout@sha256:861863a8f603b8851858fcb66492d5fa8af26e14ec84a26da5d75fe762b144b2', 'containerID': 'containerd://dca913e3994387a452e11bdf0ef9cf26201926b20ebf1b2ecf5dd5f06ffe88b0'}, {'name': 'tailer', 'state': {'running': {'startedAt': '2020-08-19T04:03:50Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:latest', 'imageID': 'docker.io/library/busybox@sha256:4f47c01fa91355af2865ac10fef5bf6ec9c7f42ad2321377c21e844427972977', 'containerID': 'containerd://0eba1253396b0a4fcd076697101b996136bfe6364bf150651c23d423794c0840'}], 'qosClass': 'BestEffort'}}}
2020-08-19 04:08:31,579 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1',
 'kind': 'Pod',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': 'bono-5cdb7bfcdd-',
              'generation': None,
              'initializers': None,
              'labels': {'pod-template-hash': '5cdb7bfcdd',
                         'service': 'bono',
                         'snmp': 'enabled'},
              'managed_fields': None,
              'name': 'bono-5cdb7bfcdd-87gzb',
              'namespace': 'ims-h4q84',
              'owner_references': [{'api_version': 'apps/v1',
                                    'block_owner_deletion': True,
                                    'controller': True,
                                    'kind': 'ReplicaSet',
                                    'name': 'bono-5cdb7bfcdd',
                                    'uid': '6704dc43-5ee3-44ee-986e-65dc1be6001a'}],
              'resource_version': '981956',
              'self_link': '/api/v1/namespaces/ims-h4q84/pods/bono-5cdb7bfcdd-87gzb',
              'uid': 'd649c142-1b2c-40f7-a2a8-acae32ff97bd'},
 'spec': {'active_deadline_seconds': None,
          'affinity': None,
          'automount_service_account_token': None,
          'containers': [{'args': None,
                          'command': None,
                          'env': [{'name': 'MY_POD_IP',
                                   'value': None,
                                   'value_from': {'config_map_key_ref': None,
                                                  'field_ref': {'api_version': 'v1',
                                                                'field_path': 'status.podIP'},
                                                  'resource_field_ref': None,
                                                  'secret_key_ref': None}}],
                          'env_from': [{'config_map_ref': {'name': 'env-vars',
                                                           'optional': None},
                                        'prefix': None,
                                        'secret_ref': None}],
                          'image': 'ollivier/clearwater-bono:latest',
                          'image_pull_policy': 'Always',
                          'lifecycle': None,
                          'liveness_probe': {'_exec': {'command': ['/bin/bash',
                                                                   '/usr/share/kubernetes/liveness.sh',
                                                                   '3478 5060 '
                                                                   '5062']},
                                             'failure_threshold': 3,
                                             'http_get': None,
                                             'initial_delay_seconds': 30,
                                             'period_seconds': 10,
                                             'success_threshold': 1,
                                             'tcp_socket': None,
                                             'timeout_seconds': 1},
                          'name': 'bono',
                          'ports': [{'container_port': 22,
                                     'host_ip': None,
                                     'host_port': None,
                                     'name': None,
                                     'protocol': 'TCP'},
                                    {'container_port': 3478,
                                     'host_ip': None,
                                     'host_port': None,
                                     'name': None,
                                     'protocol': 'TCP'},
                                    {'container_port': 5060,
                                     'host_ip': None,
                                     'host_port': None,
                                     'name': None,
                                     'protocol': 'TCP'},
                                    {'container_port': 5062,
                                     'host_ip': None,
                                     'host_port': None,
                                     'name': None,
                                     'protocol': 'TCP'},
                                    {'container_port': 5060,
                                     'host_ip': None,
                                     'host_port': None,
                                     'name': None,
                                     'protocol': 'UDP'},
                                    {'container_port': 5062,
                                     'host_ip': None,
                                     'host_port': None,
                                     'name': None,
                                     'protocol': 'UDP'}],
                          'readiness_probe': {'_exec': {'command': ['/bin/bash',
                                                                    '/usr/share/kubernetes/liveness.sh',
                                                                    '3478 5060 '
                                                                    '5062']},
                                              'failure_threshold': 3,
                                              'http_get': None,
                                              'initial_delay_seconds': None,
                                              'period_seconds': 10,
                                              'success_threshold': 1,
                                              'tcp_socket': None,
                                              'timeout_seconds': 1},
                          'resources': {'limits': None, 'requests': None},
                          'security_context': None,
                          'stdin': None,
                          'stdin_once': None,
                          'termination_message_path': '/dev/termination-log',
                          'termination_message_policy': 'File',
                          'tty': None,
                          'volume_devices': None,
                          'volume_mounts': [{'mount_path': '/var/log/bono',
                                             'mount_propagation': None,
                                             'name': 'bonologs',
                                             'read_only': None,
                                             'sub_path': None,
                                             'sub_path_expr': None},
                                            {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
                                             'mount_propagation': None,
                                             'name': 'default-token-8x245',
                                             'read_only': True,
                                             'sub_path': None,
                                             'sub_path_expr': None}],
                          'working_dir': None},
                         {'args': None,
                          'command': ['tail',
                                      '-F',
                                      '/var/log/bono/bono_current.txt'],
                          'env': None,
                          'env_from': None,
                          'image': 'busybox',
                          'image_pull_policy': 'Always',
                          'lifecycle': None,
                          'liveness_probe': None,
                          'name': 'tailer',
                          'ports': None,
                          'readiness_probe': None,
                          'resources': {'limits': None, 'requests': None},
                          'security_context': None,
                          'stdin': None,
                          'stdin_once': None,
                          'termination_message_path': '/dev/termination-log',
                          'termination_message_policy': 'File',
                          'tty': None,
                          'volume_devices': None,
                          'volume_mounts': [{'mount_path': '/var/log/bono',
                                             'mount_propagation': None,
                                             'name': 'bonologs',
                                             'read_only': None,
                                             'sub_path': None,
                                             'sub_path_expr': None},
                                            {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
                                             'mount_propagation': None,
                                             'name': 'default-token-8x245',
                                             'read_only': True,
                                             'sub_path': None,
                                             'sub_path_expr': None}],
                          'working_dir': None}],
          'dns_config': None,
          'dns_policy': 'ClusterFirst',
          'enable_service_links': True,
          'host_aliases': None,
          'host_ipc': None,
          'host_network': None,
          'host_pid': None,
          'hostname': None,
          'image_pull_secrets': [{'name': None}],
          'init_containers': [{'args': None,
                               'command': ['sh',
                                           '-c',
                                           'until nslookup sprout; do echo '
                                           'waiting for sprout to start ...; '
                                           'sleep 2; done'],
                               'env': None,
                               'env_from': None,
                               'image': 'busybox:1.28',
                               'image_pull_policy': 'IfNotPresent',
                               'lifecycle': None,
                               'liveness_probe': None,
                               'name': 'wait-on-sprout',
                               'ports': None,
                               'readiness_probe': None,
                               'resources': {'limits': None, 'requests': None},
                               'security_context': None,
                               'stdin': None,
                               'stdin_once': None,
                               'termination_message_path': '/dev/termination-log',
                               'termination_message_policy': 'File',
                               'tty': None,
                               'volume_devices': None,
                               'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
                                                  'mount_propagation': None,
                                                  'name': 'default-token-8x245',
                                                  'read_only': True,
                                                  'sub_path': None,
                                                  'sub_path_expr': None}],
                               'working_dir': None}],
          'node_name': 'iruya-worker2',
          'node_selector': None,
          'priority': 0,
          'priority_class_name': None,
          'readiness_gates': None,
          'restart_policy': 'Always',
          'runtime_class_name': None,
          'scheduler_name': 'default-scheduler',
          'security_context': {'fs_group': None,
                               'run_as_group': None,
                               'run_as_non_root': None,
                               'run_as_user': None,
                               'se_linux_options': None,
                               'supplemental_groups': None,
                               'sysctls': None},
          'service_account': 'default',
          'service_account_name': 'default',
          'share_process_namespace': None,
          'subdomain': None,
          'termination_grace_period_seconds': 30,
          'tolerations': [{'effect': 'NoExecute',
                           'key': 'node.kubernetes.io/not-ready',
                           'operator': 'Exists',
                           'toleration_seconds': 300,
                           'value': None},
                          {'effect': 'NoExecute',
                           'key': 'node.kubernetes.io/unreachable',
                           'operator': 'Exists',
                           'toleration_seconds': 300,
                           'value': None}],
          'volumes': [{'aws_elastic_block_store': None,
                       'azure_disk': None,
                       'azure_file': None,
                       'cephfs': None,
                       'cinder': None,
                       'config_map': None,
                       'csi': None,
                       'downward_api': None,
                       'empty_dir': {'medium': None, 'size_limit': None},
                       'fc': None,
                       'flex_volume': None,
                       'flocker': None,
                       'gce_persistent_disk': None,
                       'git_repo': None,
                       'glusterfs': None,
                       'host_path': None,
                       'iscsi': None,
                       'name': 'bonologs',
                       'nfs': None,
                       'persistent_volume_claim': None,
                       'photon_persistent_disk': None,
                       'portworx_volume': None,
                       'projected': None,
                       'quobyte': None,
                       'rbd': None,
                       'scale_io': None,
                       'secret': None,
                       'storageos': None,
                       'vsphere_volume': None},
                      {'aws_elastic_block_store': None,
                       'azure_disk': None,
                       'azure_file': None,
                       'cephfs': None,
                       'cinder': None,
                       'config_map': None,
                       'csi': None,
                       'downward_api': None,
                       'empty_dir': None,
                       'fc': None,
                       'flex_volume': None,
                       'flocker': None,
                       'gce_persistent_disk': None,
                       'git_repo': None,
                       'glusterfs': None,
                       'host_path': None,
                       'iscsi': None,
                       'name': 'default-token-8x245',
                       'nfs': None,
                       'persistent_volume_claim': None,
                       'photon_persistent_disk': None,
                       'portworx_volume': None,
                       'projected': None,
                       'quobyte': None,
                       'rbd': None,
                       'scale_io': None,
                       'secret': {'default_mode': 420,
                                  'items': None,
                                  'optional': None,
                                  'secret_name': 'default-token-8x245'},
                       'storageos': None,
                       'vsphere_volume': None}]},
 'status': {'conditions': [{'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 4, 7, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'Initialized'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 4, 25, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'Ready'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 4, 25, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'ContainersReady'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'PodScheduled'}],
            'container_statuses': [{'container_id': 'containerd://6b85eeb39775b93afdc325590f70bab993220b600e7687c4199cd6c027639fbe',
                                    'image': 'docker.io/ollivier/clearwater-bono:latest',
                                    'image_id': 'docker.io/ollivier/clearwater-bono@sha256:95d9d53fc68c24deb2095b7b91aa7e53090f99e9c1d5c43dcf5d9a6fb8a8cdc2',
                                    'last_state': {'running': None,
                                                   'terminated': None,
                                                   'waiting': None},
                                    'name': 'bono',
                                    'ready': True,
                                    'restart_count': 0,
                                    'state': {'running': {'started_at': datetime.datetime(2020, 8, 19, 4, 4, 11, tzinfo=tzlocal())},
                                              'terminated': None,
                                              'waiting': None}},
                                   {'container_id': 'containerd://244ff46d15ff0759c72d029ddd206097647a8a78a75027c83c51aa962162bbda',
                                    'image': 'docker.io/library/busybox:latest',
                                    'image_id': 'docker.io/library/busybox@sha256:4f47c01fa91355af2865ac10fef5bf6ec9c7f42ad2321377c21e844427972977',
                                    'last_state': {'running': None,
                                                   'terminated': None,
                                                   'waiting': None},
                                    'name': 'tailer',
                                    'ready': True,
                                    'restart_count': 0,
                                    'state': {'running': {'started_at': datetime.datetime(2020, 8, 19, 4, 4, 14, tzinfo=tzlocal())},
                                              'terminated': None,
                                              'waiting': None}}],
            'host_ip': '172.18.0.5',
            'init_container_statuses': [{'container_id': 'containerd://150dce55d8418d7d640917705e59d49bd5dae5510f77cba843cbb5137c349b45',
                                         'image': 'docker.io/library/busybox:1.28',
                                         'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47',
                                         'last_state': {'running': None,
                                                        'terminated': None,
                                                        'waiting': None},
                                         'name': 'wait-on-sprout',
                                         'ready': True,
                                         'restart_count': 0,
                                         'state': {'running': None,
                                                   'terminated': {'container_id': 'containerd://150dce55d8418d7d640917705e59d49bd5dae5510f77cba843cbb5137c349b45',
                                                                  'exit_code': 0,
                                                                  'finished_at': datetime.datetime(2020, 8, 19, 4, 4, 6, tzinfo=tzlocal()),
                                                                  'message': None,
                                                                  'reason': 'Completed',
                                                                  'signal': None,
                                                                  'started_at': datetime.datetime(2020, 8, 19, 3, 59, 49, tzinfo=tzlocal())},
                                                   'waiting': None}}],
            'message': None,
            'nominated_node_name': None,
            'phase': 'Running',
            'pod_ip': '10.244.2.192',
            'qos_class': 'BestEffort',
            'reason': None,
            'start_time': datetime.datetime(2020, 8, 19, 3, 59, 40, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'bono-5cdb7bfcdd-87gzb', 'generateName': 'bono-5cdb7bfcdd-', 'namespace': 'ims-h4q84', 'selfLink': '/api/v1/namespaces/ims-h4q84/pods/bono-5cdb7bfcdd-87gzb', 'uid': 'd649c142-1b2c-40f7-a2a8-acae32ff97bd', 'resourceVersion': '981956', 'creationTimestamp': '2020-08-19T03:59:40Z', 'labels': {'pod-template-hash': '5cdb7bfcdd', 'service': 'bono', 'snmp': 'enabled'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'bono-5cdb7bfcdd', 'uid': '6704dc43-5ee3-44ee-986e-65dc1be6001a', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'bonologs', 'emptyDir': {}}, {'name': 'default-token-8x245', 'secret': {'secretName': 'default-token-8x245', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-8x245', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'bono', 'image': 'ollivier/clearwater-bono:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 3478, 'protocol': 'TCP'}, {'containerPort': 5060, 'protocol': 'TCP'}, {'containerPort': 5062, 'protocol': 'TCP'}, {'containerPort': 5060, 'protocol': 'UDP'}, {'containerPort': 5062, 'protocol': 'UDP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'bonologs', 'mountPath': '/var/log/bono'}, {'name': 'default-token-8x245', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 5062']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 5062']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/bono/bono_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'bonologs', 'mountPath': '/var/log/bono'}, {'name': 'default-token-8x245', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:04:07Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:04:25Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:04:25Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T03:59:40Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.2.192', 'startTime': '2020-08-19T03:59:40Z', 'initContainerStatuses': [{'name': 'wait-on-sprout', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-08-19T03:59:49Z', 'finishedAt': '2020-08-19T04:04:06Z', 'containerID': 'containerd://150dce55d8418d7d640917705e59d49bd5dae5510f77cba843cbb5137c349b45'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://150dce55d8418d7d640917705e59d49bd5dae5510f77cba843cbb5137c349b45'}], 'containerStatuses': [{'name': 'bono', 'state': {'running': {'startedAt': '2020-08-19T04:04:11Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-bono:latest', 'imageID': 'docker.io/ollivier/clearwater-bono@sha256:95d9d53fc68c24deb2095b7b91aa7e53090f99e9c1d5c43dcf5d9a6fb8a8cdc2', 'containerID': 'containerd://6b85eeb39775b93afdc325590f70bab993220b600e7687c4199cd6c027639fbe'}, {'name': 'tailer', 'state': {'running': {'startedAt': '2020-08-19T04:04:14Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:latest', 'imageID': 'docker.io/library/busybox@sha256:4f47c01fa91355af2865ac10fef5bf6ec9c7f42ad2321377c21e844427972977', 'containerID': 'containerd://244ff46d15ff0759c72d029ddd206097647a8a78a75027c83c51aa962162bbda'}], 'qosClass': 'BestEffort'}}}
2020-08-19 04:08:31,894 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1',
 'kind': 'Pod',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': 'etcd-5cbf55c8c-',
              'generation': None,
              'initializers': None,
              'labels': {'instance-type': 'etcd-pod',
                         'pod-template-hash': '5cbf55c8c'},
              'managed_fields': None,
              'name': 'etcd-5cbf55c8c-98kz5',
              'namespace': 'ims-h4q84',
              'owner_references': [{'api_version': 'apps/v1',
                                    'block_owner_deletion': True,
                                    'controller': True,
                                    'kind': 'ReplicaSet',
                                    'name': 'etcd-5cbf55c8c',
                                    'uid': 'f4604def-ddc1-4883-a64d-6b4ad4a53944'}],
              'resource_version': '981298',
              'self_link': '/api/v1/namespaces/ims-h4q84/pods/etcd-5cbf55c8c-98kz5',
              'uid': '422ed524-5ab5-4bc9-97ea-7b840e65d2d2'},
 'spec': {'active_deadline_seconds': None,
          'affinity': None,
          'automount_service_account_token': None,
          'containers': [{'args': ['--name',
                                   '$(MY_POD_NAME)',
                                   '--advertise-client-urls',
                                   'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001',
                                   '--listen-client-urls',
                                   'http://0.0.0.0:2379,http://0.0.0.0:4001',
                                   '--initial-advertise-peer-urls',
                                   'http://$(MY_POD_IP):2380',
                                   '--listen-peer-urls',
                                   'http://0.0.0.0:2380',
                                   '--initial-cluster',
                                   '$(MY_POD_NAME)=http://$(MY_POD_IP):2380',
                                   '--initial-cluster-state',
                                   'new'],
                          'command': None,
                          'env': [{'name': 'MY_POD_IP',
                                   'value': None,
                                   'value_from': {'config_map_key_ref': None,
                                                  'field_ref': {'api_version': 'v1',
                                                                'field_path': 'status.podIP'},
                                                  'resource_field_ref': None,
                                                  'secret_key_ref': None}},
                                  {'name': 'MY_POD_NAME',
                                   'value': None,
                                   'value_from': {'config_map_key_ref': None,
                                                  'field_ref': {'api_version': 'v1',
                                                                'field_path': 'metadata.name'},
                                                  'resource_field_ref': None,
                                                  'secret_key_ref': None}}],
                          'env_from': None,
                          'image': 'quay.io/coreos/etcd:v2.2.5',
                          'image_pull_policy': 'IfNotPresent',
                          'lifecycle': None,
                          'liveness_probe': {'_exec': None,
                                             'failure_threshold': 3,
                                             'http_get': None,
                                             'initial_delay_seconds': 300,
                                             'period_seconds': 10,
                                             'success_threshold': 1,
                                             'tcp_socket': {'host': None,
                                                            'port': 4001},
                                             'timeout_seconds': 1},
                          'name': 'etcd',
                          'ports': [{'container_port': 2379,
                                     'host_ip': None,
                                     'host_port': None,
                                     'name': None,
                                     'protocol': 'TCP'},
                                    {'container_port': 2380,
                                     'host_ip': None,
                                     'host_port': None,
                                     'name': None,
                                     'protocol': 'TCP'},
                                    {'container_port': 4001,
                                     'host_ip': None,
                                     'host_port': None,
                                     'name': None,
                                     'protocol': 'TCP'}],
                          'readiness_probe': {'_exec': None,
                                              'failure_threshold': 3,
                                              'http_get': None,
                                              'initial_delay_seconds': None,
                                              'period_seconds': 10,
                                              'success_threshold': 1,
                                              'tcp_socket': {'host': None,
                                                             'port': 4001},
                                              'timeout_seconds': 1},
                          'resources': {'limits': None, 'requests': None},
                          'security_context': None,
                          'stdin': None,
                          'stdin_once': None,
                          'termination_message_path': '/dev/termination-log',
                          'termination_message_policy': 'File',
                          'tty': None,
                          'volume_devices': None,
                          'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
                                             'mount_propagation': None,
                                             'name': 'default-token-8x245',
                                             'read_only': True,
                                             'sub_path': None,
                                             'sub_path_expr': None}],
                          'working_dir': None}],
          'dns_config': None,
          'dns_policy': 'ClusterFirst',
          'enable_service_links': True,
          'host_aliases': None,
          'host_ipc': None,
          'host_network': None,
          'host_pid': None,
          'hostname': None,
          'image_pull_secrets': [{'name': None}],
          'init_containers': None,
          'node_name': 'iruya-worker2',
          'node_selector': None,
          'priority': 0,
          'priority_class_name': None,
          'readiness_gates': None,
          'restart_policy': 'Always',
          'runtime_class_name': None,
          'scheduler_name': 'default-scheduler',
          'security_context': {'fs_group': None,
                               'run_as_group': None,
                               'run_as_non_root': None,
                               'run_as_user': None,
                               'se_linux_options': None,
                               'supplemental_groups': None,
                               'sysctls': None},
          'service_account': 'default',
          'service_account_name': 'default',
          'share_process_namespace': None,
          'subdomain': None,
          'termination_grace_period_seconds': 30,
          'tolerations': [{'effect': 'NoExecute',
                           'key': 'node.kubernetes.io/not-ready',
                           'operator': 'Exists',
                           'toleration_seconds': 300,
                           'value': None},
                          {'effect': 'NoExecute',
                           'key': 'node.kubernetes.io/unreachable',
                           'operator': 'Exists',
                           'toleration_seconds': 300,
                           'value': None}],
          'volumes': [{'aws_elastic_block_store': None,
                       'azure_disk': None,
                       'azure_file': None,
                       'cephfs': None,
                       'cinder': None,
                       'config_map': None,
                       'csi': None,
                       'downward_api': None,
                       'empty_dir': None,
                       'fc': None,
                       'flex_volume': None,
                       'flocker': None,
                       'gce_persistent_disk': None,
                       'git_repo': None,
                       'glusterfs': None,
                       'host_path': None,
                       'iscsi': None,
                       'name': 'default-token-8x245',
                       'nfs': None,
                       'persistent_volume_claim': None,
                       'photon_persistent_disk': None,
                       'portworx_volume': None,
                       'projected': None,
                       'quobyte': None,
                       'rbd': None,
                       'scale_io': None,
                       'secret': {'default_mode': 420,
                                  'items': None,
                                  'optional': None,
                                  'secret_name': 'default-token-8x245'},
                       'storageos': None,
                       'vsphere_volume': None}]},
 'status': {'conditions': [{'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'Initialized'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 0, 1, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'Ready'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 0, 1, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'ContainersReady'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'PodScheduled'}],
            'container_statuses': [{'container_id': 'containerd://9bb973578273ab017e5549c499de3cbb7dde1bf3a2a9e729cc5b8dd8163617e6',
                                    'image': 'quay.io/coreos/etcd:v2.2.5',
                                    'image_id': 'sha256:66590e2dd05422771324d8ffe9ad35165ba35db0842ac5e0f1668c2d56733860',
                                    'last_state': {'running': None,
                                                   'terminated': None,
                                                   'waiting': None},
                                    'name': 'etcd',
                                    'ready': True,
                                    'restart_count': 0,
                                    'state': {'running': {'started_at': datetime.datetime(2020, 8, 19, 3, 59, 53, tzinfo=tzlocal())},
                                              'terminated': None,
                                              'waiting': None}}],
            'host_ip': '172.18.0.5',
            'init_container_statuses': None,
            'message': None,
            'nominated_node_name': None,
            'phase': 'Running',
            'pod_ip': '10.244.2.195',
            'qos_class': 'BestEffort',
            'reason': None,
            'start_time': datetime.datetime(2020, 8, 19, 3, 59, 41, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'etcd-5cbf55c8c-98kz5', 'generateName': 'etcd-5cbf55c8c-', 'namespace': 'ims-h4q84', 'selfLink': '/api/v1/namespaces/ims-h4q84/pods/etcd-5cbf55c8c-98kz5', 'uid': '422ed524-5ab5-4bc9-97ea-7b840e65d2d2', 'resourceVersion': '981298', 'creationTimestamp': '2020-08-19T03:59:41Z', 'labels': {'instance-type': 'etcd-pod', 'pod-template-hash': '5cbf55c8c'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'etcd-5cbf55c8c', 'uid': 'f4604def-ddc1-4883-a64d-6b4ad4a53944', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-8x245', 'secret': {'secretName': 'default-token-8x245', 'defaultMode': 420}}], 'containers': [{'name': 'etcd', 'image': 'quay.io/coreos/etcd:v2.2.5', 'args': ['--name', '$(MY_POD_NAME)', '--advertise-client-urls', 'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', '--listen-client-urls', 'http://0.0.0.0:2379,http://0.0.0.0:4001', '--initial-advertise-peer-urls', 'http://$(MY_POD_IP):2380', '--listen-peer-urls', 'http://0.0.0.0:2380', '--initial-cluster', '$(MY_POD_NAME)=http://$(MY_POD_IP):2380', '--initial-cluster-state', 'new'], 'ports': [{'containerPort': 2379, 'protocol': 'TCP'}, {'containerPort': 2380, 'protocol': 'TCP'}, {'containerPort': 4001, 'protocol': 'TCP'}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}, {'name': 'MY_POD_NAME', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'metadata.name'}}}], 'resources': {}, 'volumeMounts': [{'name': 'default-token-8x245', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'tcpSocket': {'port': 4001}, 'initialDelaySeconds': 300, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 4001}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T03:59:41Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:00:01Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:00:01Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T03:59:41Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.2.195', 'startTime': '2020-08-19T03:59:41Z', 'containerStatuses': [{'name': 'etcd', 'state': {'running': {'startedAt': '2020-08-19T03:59:53Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'quay.io/coreos/etcd:v2.2.5', 'imageID': 'sha256:66590e2dd05422771324d8ffe9ad35165ba35db0842ac5e0f1668c2d56733860', 'containerID': 'containerd://9bb973578273ab017e5549c499de3cbb7dde1bf3a2a9e729cc5b8dd8163617e6'}], 'qosClass': 'BestEffort'}}}
2020-08-19 04:08:32,070 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'v1',
 'kind': 'Pod',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 4, 8, 28, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': None,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'live-test',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '982468',
              'self_link': '/api/v1/namespaces/ims-h4q84/pods/live-test',
              'uid': '487f89c4-432e-4517-95a8-5cd68e775399'},
 'spec': {'active_deadline_seconds': None,
          'affinity': None,
          'automount_service_account_token': None,
          'containers': [{'args': None,
                          'command': ['rake',
                                      'test[ims-h4q84.svc.cluster.local]',
                                      'PROXY=bono.ims-h4q84.svc.cluster.local',
                                      'ELLIS=ellis.ims-h4q84.svc.cluster.local',
                                      'SIGNUP_CODE=secret',
                                      '--trace'],
                          'env': None,
                          'env_from': None,
                          'image': 'ollivier/clearwater-live-test:latest',
                          'image_pull_policy': 'Always',
                          'lifecycle': None,
                          'liveness_probe': None,
                          'name': 'live-test',
                          'ports': None,
                          'readiness_probe': None,
                          'resources': {'limits': None, 'requests': None},
                          'security_context': None,
                          'stdin': None,
                          'stdin_once': None,
                          'termination_message_path': '/dev/termination-log',
                          'termination_message_policy': 'File',
                          'tty': None,
                          'volume_devices': None,
                          'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
                                             'mount_propagation': None,
                                             'name': 'default-token-8x245',
                                             'read_only': True,
                                             'sub_path': None,
                                             'sub_path_expr': None}],
                          'working_dir': None}],
          'dns_config': None,
          'dns_policy': 'ClusterFirst',
          'enable_service_links': True,
          'host_aliases': None,
          'host_ipc': None,
          'host_network': None,
          'host_pid': None,
          'hostname': None,
          'image_pull_secrets': None,
          'init_containers': None,
          'node_name': 'iruya-worker2',
          'node_selector': None,
          'priority': 0,
          'priority_class_name': None,
          'readiness_gates': None,
          'restart_policy': 'Never',
          'runtime_class_name': None,
          'scheduler_name': 'default-scheduler',
          'security_context': {'fs_group': None,
                               'run_as_group': None,
                               'run_as_non_root': None,
                               'run_as_user': None,
                               'se_linux_options': None,
                               'supplemental_groups': None,
                               'sysctls': None},
          'service_account': 'default',
          'service_account_name': 'default',
          'share_process_namespace': None,
          'subdomain': None,
          'termination_grace_period_seconds': 30,
          'tolerations': [{'effect': 'NoExecute',
                           'key': 'node.kubernetes.io/not-ready',
                           'operator': 'Exists',
                           'toleration_seconds': 300,
                           'value': None},
                          {'effect': 'NoExecute',
                           'key': 'node.kubernetes.io/unreachable',
                           'operator': 'Exists',
                           'toleration_seconds': 300,
                           'value': None}],
          'volumes': [{'aws_elastic_block_store': None,
                       'azure_disk': None,
                       'azure_file': None,
                       'cephfs': None,
                       'cinder': None,
                       'config_map': None,
                       'csi': None,
                       'downward_api': None,
                       'empty_dir': None,
                       'fc': None,
                       'flex_volume': None,
                       'flocker': None,
                       'gce_persistent_disk': None,
                       'git_repo': None,
                       'glusterfs': None,
                       'host_path': None,
                       'iscsi': None,
                       'name': 'default-token-8x245',
                       'nfs': None,
                       'persistent_volume_claim': None,
                       'photon_persistent_disk': None,
                       'portworx_volume': None,
                       'projected': None,
                       'quobyte': None,
                       'rbd': None,
                       'scale_io': None,
                       'secret': {'default_mode': 420,
                                  'items': None,
                                  'optional': None,
                                  'secret_name': 'default-token-8x245'},
                       'storageos': None,
                       'vsphere_volume': None}]},
 'status': {'conditions': [{'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 8, 28, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'PodScheduled'}],
            'container_statuses': None,
            'host_ip': None,
            'init_container_statuses': None,
            'message': None,
            'nominated_node_name': None,
            'phase': 'Pending',
            'pod_ip': None,
            'qos_class': 'BestEffort',
            'reason': None,
            'start_time': None}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test', 'namespace': 'ims-h4q84', 'selfLink': '/api/v1/namespaces/ims-h4q84/pods/live-test', 'uid': '487f89c4-432e-4517-95a8-5cd68e775399', 'resourceVersion': '982468', 'creationTimestamp': '2020-08-19T04:08:28Z'}, 'spec': {'volumes': [{'name': 'default-token-8x245', 'secret': {'secretName': 'default-token-8x245', 'defaultMode': 420}}], 'containers': [{'name': 'live-test', 'image': 'ollivier/clearwater-live-test:latest', 'command': ['rake', 'test[ims-h4q84.svc.cluster.local]', 'PROXY=bono.ims-h4q84.svc.cluster.local', 'ELLIS=ellis.ims-h4q84.svc.cluster.local', 'SIGNUP_CODE=secret', '--trace'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-8x245', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Never', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Pending', 'conditions': [{'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:08:28Z'}], 'qosClass': 'BestEffort'}}}
2020-08-19 04:08:32,171 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'v1',
 'kind': 'Pod',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 4, 8, 28, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': None,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'live-test',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '982471',
              'self_link': '/api/v1/namespaces/ims-h4q84/pods/live-test',
              'uid': '487f89c4-432e-4517-95a8-5cd68e775399'},
 'spec': {'active_deadline_seconds': None,
          'affinity': None,
          'automount_service_account_token': None,
          'containers': [{'args': None,
                          'command': ['rake',
                                      'test[ims-h4q84.svc.cluster.local]',
                                      'PROXY=bono.ims-h4q84.svc.cluster.local',
                                      'ELLIS=ellis.ims-h4q84.svc.cluster.local',
                                      'SIGNUP_CODE=secret',
                                      '--trace'],
                          'env': None,
                          'env_from': None,
                          'image': 'ollivier/clearwater-live-test:latest',
                          'image_pull_policy': 'Always',
                          'lifecycle': None,
                          'liveness_probe': None,
                          'name': 'live-test',
                          'ports': None,
                          'readiness_probe': None,
                          'resources': {'limits': None, 'requests': None},
                          'security_context': None,
                          'stdin': None,
                          'stdin_once': None,
                          'termination_message_path': '/dev/termination-log',
                          'termination_message_policy': 'File',
                          'tty': None,
                          'volume_devices': None,
                          'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
                                             'mount_propagation': None,
                                             'name': 'default-token-8x245',
                                             'read_only': True,
                                             'sub_path': None,
                                             'sub_path_expr': None}],
                          'working_dir': None}],
          'dns_config': None,
          'dns_policy': 'ClusterFirst',
          'enable_service_links': True,
          'host_aliases': None,
          'host_ipc': None,
          'host_network': None,
          'host_pid': None,
          'hostname': None,
          'image_pull_secrets': None,
          'init_containers': None,
          'node_name': 'iruya-worker2',
          'node_selector': None,
          'priority': 0,
          'priority_class_name': None,
          'readiness_gates': None,
          'restart_policy': 'Never',
          'runtime_class_name': None,
          'scheduler_name': 'default-scheduler',
          'security_context': {'fs_group': None,
                               'run_as_group': None,
                               'run_as_non_root': None,
                               'run_as_user': None,
                               'se_linux_options': None,
                               'supplemental_groups': None,
                               'sysctls': None},
          'service_account': 'default',
          'service_account_name': 'default',
          'share_process_namespace': None,
          'subdomain': None,
          'termination_grace_period_seconds': 30,
          'tolerations': [{'effect': 'NoExecute',
                           'key': 'node.kubernetes.io/not-ready',
                           'operator': 'Exists',
                           'toleration_seconds': 300,
                           'value': None},
                          {'effect': 'NoExecute',
                           'key': 'node.kubernetes.io/unreachable',
                           'operator': 'Exists',
                           'toleration_seconds': 300,
                           'value': None}],
          'volumes': [{'aws_elastic_block_store': None,
                       'azure_disk': None,
                       'azure_file': None,
                       'cephfs': None,
                       'cinder': None,
                       'config_map': None,
                       'csi': None,
                       'downward_api': None,
                       'empty_dir': None,
                       'fc': None,
                       'flex_volume': None,
                       'flocker': None,
                       'gce_persistent_disk': None,
                       'git_repo': None,
                       'glusterfs': None,
                       'host_path': None,
                       'iscsi': None,
                       'name': 'default-token-8x245',
                       'nfs': None,
                       'persistent_volume_claim': None,
                       'photon_persistent_disk': None,
                       'portworx_volume': None,
                       'projected': None,
                       'quobyte': None,
                       'rbd': None,
                       'scale_io': None,
                       'secret': {'default_mode': 420,
                                  'items': None,
                                  'optional': None,
                                  'secret_name': 'default-token-8x245'},
                       'storageos': None,
                       'vsphere_volume': None}]},
 'status': {'conditions': [{'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 8, 28, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'Initialized'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 8, 28, tzinfo=tzlocal()),
                            'message': 'containers with unready status: '
                                       '[live-test]',
                            'reason': 'ContainersNotReady',
                            'status': 'False',
                            'type': 'Ready'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 8, 28, tzinfo=tzlocal()),
                            'message': 'containers with unready status: '
                                       '[live-test]',
                            'reason': 'ContainersNotReady',
                            'status': 'False',
                            'type': 'ContainersReady'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 8, 28, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'PodScheduled'}],
            'container_statuses': [{'container_id': None,
                                    'image': 'ollivier/clearwater-live-test:latest',
                                    'image_id': '',
                                    'last_state': {'running': None,
                                                   'terminated': None,
                                                   'waiting': None},
                                    'name': 'live-test',
                                    'ready': False,
                                    'restart_count': 0,
                                    'state': {'running': None,
                                              'terminated': None,
                                              'waiting': {'message': None,
                                                          'reason': 'ContainerCreating'}}}],
            'host_ip': '172.18.0.5',
            'init_container_statuses': None,
            'message': None,
            'nominated_node_name': None,
            'phase': 'Pending',
            'pod_ip': None,
            'qos_class': 'BestEffort',
            'reason': None,
            'start_time': datetime.datetime(2020, 8, 19, 4, 8, 28, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test', 'namespace': 'ims-h4q84', 'selfLink': '/api/v1/namespaces/ims-h4q84/pods/live-test', 'uid': '487f89c4-432e-4517-95a8-5cd68e775399', 'resourceVersion': '982471', 'creationTimestamp': '2020-08-19T04:08:28Z'}, 'spec': {'volumes': [{'name': 'default-token-8x245', 'secret': {'secretName': 'default-token-8x245', 'defaultMode': 420}}], 'containers': [{'name': 'live-test', 'image': 'ollivier/clearwater-live-test:latest', 'command': ['rake', 'test[ims-h4q84.svc.cluster.local]', 'PROXY=bono.ims-h4q84.svc.cluster.local', 'ELLIS=ellis.ims-h4q84.svc.cluster.local', 'SIGNUP_CODE=secret', '--trace'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-8x245', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Never', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Pending', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:08:28Z'}, {'type': 'Ready', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:08:28Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test]'}, {'type': 'ContainersReady', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:08:28Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test]'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:08:28Z'}], 'hostIP': '172.18.0.5', 'startTime': '2020-08-19T04:08:28Z', 'containerStatuses': [{'name': 'live-test', 'state': {'waiting': {'reason': 'ContainerCreating'}}, 'lastState': {}, 'ready': False, 'restartCount': 0, 'image': 'ollivier/clearwater-live-test:latest', 'imageID': ''}], 'qosClass': 'BestEffort'}}}
2020-08-19 04:08:32,805 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'v1',
 'kind': 'Pod',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 4, 8, 28, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': None,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'live-test',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '982484',
              'self_link': '/api/v1/namespaces/ims-h4q84/pods/live-test',
              'uid': '487f89c4-432e-4517-95a8-5cd68e775399'},
 'spec': {'active_deadline_seconds': None,
          'affinity': None,
          'automount_service_account_token': None,
          'containers': [{'args': None,
                          'command': ['rake',
                                      'test[ims-h4q84.svc.cluster.local]',
                                      'PROXY=bono.ims-h4q84.svc.cluster.local',
                                      'ELLIS=ellis.ims-h4q84.svc.cluster.local',
                                      'SIGNUP_CODE=secret',
                                      '--trace'],
                          'env': None,
                          'env_from': None,
                          'image': 'ollivier/clearwater-live-test:latest',
                          'image_pull_policy': 'Always',
                          'lifecycle': None,
                          'liveness_probe': None,
                          'name': 'live-test',
                          'ports': None,
                          'readiness_probe': None,
                          'resources': {'limits': None, 'requests': None},
                          'security_context': None,
                          'stdin': None,
                          'stdin_once': None,
                          'termination_message_path': '/dev/termination-log',
                          'termination_message_policy': 'File',
                          'tty': None,
                          'volume_devices': None,
                          'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
                                             'mount_propagation': None,
                                             'name': 'default-token-8x245',
                                             'read_only': True,
                                             'sub_path': None,
                                             'sub_path_expr': None}],
                          'working_dir': None}],
          'dns_config': None,
          'dns_policy': 'ClusterFirst',
          'enable_service_links': True,
          'host_aliases': None,
          'host_ipc': None,
          'host_network': None,
          'host_pid': None,
          'hostname': None,
          'image_pull_secrets': None,
          'init_containers': None,
          'node_name': 'iruya-worker2',
          'node_selector': None,
          'priority': 0,
          'priority_class_name': None,
          'readiness_gates': None,
          'restart_policy': 'Never',
          'runtime_class_name': None,
          'scheduler_name': 'default-scheduler',
          'security_context': {'fs_group': None,
                               'run_as_group': None,
                               'run_as_non_root': None,
                               'run_as_user': None,
                               'se_linux_options': None,
                               'supplemental_groups': None,
                               'sysctls': None},
          'service_account': 'default',
          'service_account_name': 'default',
          'share_process_namespace': None,
          'subdomain': None,
          'termination_grace_period_seconds': 30,
          'tolerations': [{'effect': 'NoExecute',
                           'key': 'node.kubernetes.io/not-ready',
                           'operator': 'Exists',
                           'toleration_seconds': 300,
                           'value': None},
                          {'effect': 'NoExecute',
                           'key': 'node.kubernetes.io/unreachable',
                           'operator': 'Exists',
                           'toleration_seconds': 300,
                           'value': None}],
          'volumes': [{'aws_elastic_block_store': None,
                       'azure_disk': None,
                       'azure_file': None,
                       'cephfs': None,
                       'cinder': None,
                       'config_map': None,
                       'csi': None,
                       'downward_api': None,
                       'empty_dir': None,
                       'fc': None,
                       'flex_volume': None,
                       'flocker': None,
                       'gce_persistent_disk': None,
                       'git_repo': None,
                       'glusterfs': None,
                       'host_path': None,
                       'iscsi': None,
                       'name': 'default-token-8x245',
                       'nfs': None,
                       'persistent_volume_claim': None,
                       'photon_persistent_disk': None,
                       'portworx_volume': None,
                       'projected': None,
                       'quobyte': None,
                       'rbd': None,
                       'scale_io': None,
                       'secret': {'default_mode': 420,
                                  'items': None,
                                  'optional': None,
                                  'secret_name': 'default-token-8x245'},
                       'storageos': None,
                       'vsphere_volume': None}]},
 'status': {'conditions': [{'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 8, 28, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'Initialized'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 8, 32, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'Ready'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 8, 32, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'ContainersReady'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 8, 28, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'PodScheduled'}],
            'container_statuses': [{'container_id': 'containerd://d7eca25873075bdb0d0368d8e4648924db51a46d9a7f2008e8653d5ff13a86e5',
                                    'image': 'docker.io/ollivier/clearwater-live-test:latest',
                                    'image_id': 'docker.io/ollivier/clearwater-live-test@sha256:77e928c23a5942aa681646be96dfb5897efe17b1e8676e8e94003ad08891b881',
                                    'last_state': {'running': None,
                                                   'terminated': None,
                                                   'waiting': None},
                                    'name': 'live-test',
                                    'ready': True,
                                    'restart_count': 0,
                                    'state': {'running': {'started_at': datetime.datetime(2020, 8, 19, 4, 8, 32, tzinfo=tzlocal())},
                                              'terminated': None,
                                              'waiting': None}}],
            'host_ip': '172.18.0.5',
            'init_container_statuses': None,
            'message': None,
            'nominated_node_name': None,
            'phase': 'Running',
            'pod_ip': '10.244.2.199',
            'qos_class': 'BestEffort',
            'reason': None,
            'start_time': datetime.datetime(2020, 8, 19, 4, 8, 28, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test', 'namespace': 'ims-h4q84', 'selfLink': '/api/v1/namespaces/ims-h4q84/pods/live-test', 'uid': '487f89c4-432e-4517-95a8-5cd68e775399', 'resourceVersion': '982484', 'creationTimestamp': '2020-08-19T04:08:28Z'}, 'spec': {'volumes': [{'name': 'default-token-8x245', 'secret': {'secretName': 'default-token-8x245', 'defaultMode': 420}}], 'containers': [{'name': 'live-test', 'image': 'ollivier/clearwater-live-test:latest', 'command': ['rake', 'test[ims-h4q84.svc.cluster.local]', 'PROXY=bono.ims-h4q84.svc.cluster.local', 'ELLIS=ellis.ims-h4q84.svc.cluster.local', 'SIGNUP_CODE=secret', '--trace'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-8x245', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Never', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:08:28Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:08:32Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:08:32Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:08:28Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.2.199', 'startTime': '2020-08-19T04:08:28Z', 'containerStatuses': [{'name': 'live-test', 'state': {'running': {'startedAt': '2020-08-19T04:08:32Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'imageID': 'docker.io/ollivier/clearwater-live-test@sha256:77e928c23a5942aa681646be96dfb5897efe17b1e8676e8e94003ad08891b881', 'containerID': 'containerd://d7eca25873075bdb0d0368d8e4648924db51a46d9a7f2008e8653d5ff13a86e5'}], 'qosClass': 'BestEffort'}}}
2020-08-19 04:08:39,654 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'v1',
 'kind': 'Pod',
 'metadata': {'annotations': None,
              'cluster_name': None,
              'creation_timestamp': datetime.datetime(2020, 8, 19, 4, 8, 28, tzinfo=tzlocal()),
              'deletion_grace_period_seconds': None,
              'deletion_timestamp': None,
              'finalizers': None,
              'generate_name': None,
              'generation': None,
              'initializers': None,
              'labels': None,
              'managed_fields': None,
              'name': 'live-test',
              'namespace': 'ims-h4q84',
              'owner_references': None,
              'resource_version': '982498',
              'self_link': '/api/v1/namespaces/ims-h4q84/pods/live-test',
              'uid': '487f89c4-432e-4517-95a8-5cd68e775399'},
 'spec': {'active_deadline_seconds': None,
          'affinity': None,
          'automount_service_account_token': None,
          'containers': [{'args': None,
                          'command': ['rake',
                                      'test[ims-h4q84.svc.cluster.local]',
                                      'PROXY=bono.ims-h4q84.svc.cluster.local',
                                      'ELLIS=ellis.ims-h4q84.svc.cluster.local',
                                      'SIGNUP_CODE=secret',
                                      '--trace'],
                          'env': None,
                          'env_from': None,
                          'image': 'ollivier/clearwater-live-test:latest',
                          'image_pull_policy': 'Always',
                          'lifecycle': None,
                          'liveness_probe': None,
                          'name': 'live-test',
                          'ports': None,
                          'readiness_probe': None,
                          'resources': {'limits': None, 'requests': None},
                          'security_context': None,
                          'stdin': None,
                          'stdin_once': None,
                          'termination_message_path': '/dev/termination-log',
                          'termination_message_policy': 'File',
                          'tty': None,
                          'volume_devices': None,
                          'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
                                             'mount_propagation': None,
                                             'name': 'default-token-8x245',
                                             'read_only': True,
                                             'sub_path': None,
                                             'sub_path_expr': None}],
                          'working_dir': None}],
          'dns_config': None,
          'dns_policy': 'ClusterFirst',
          'enable_service_links': True,
          'host_aliases': None,
          'host_ipc': None,
          'host_network': None,
          'host_pid': None,
          'hostname': None,
          'image_pull_secrets': None,
          'init_containers': None,
          'node_name': 'iruya-worker2',
          'node_selector': None,
          'priority': 0,
          'priority_class_name': None,
          'readiness_gates': None,
          'restart_policy': 'Never',
          'runtime_class_name': None,
          'scheduler_name': 'default-scheduler',
          'security_context': {'fs_group': None,
                               'run_as_group': None,
                               'run_as_non_root': None,
                               'run_as_user': None,
                               'se_linux_options': None,
                               'supplemental_groups': None,
                               'sysctls': None},
          'service_account': 'default',
          'service_account_name': 'default',
          'share_process_namespace': None,
          'subdomain': None,
          'termination_grace_period_seconds': 30,
          'tolerations': [{'effect': 'NoExecute',
                           'key': 'node.kubernetes.io/not-ready',
                           'operator': 'Exists',
                           'toleration_seconds': 300,
                           'value': None},
                          {'effect': 'NoExecute',
                           'key': 'node.kubernetes.io/unreachable',
                           'operator': 'Exists',
                           'toleration_seconds': 300,
                           'value': None}],
          'volumes': [{'aws_elastic_block_store': None,
                       'azure_disk': None,
                       'azure_file': None,
                       'cephfs': None,
                       'cinder': None,
                       'config_map': None,
                       'csi': None,
                       'downward_api': None,
                       'empty_dir': None,
                       'fc': None,
                       'flex_volume': None,
                       'flocker': None,
                       'gce_persistent_disk': None,
                       'git_repo': None,
                       'glusterfs': None,
                       'host_path': None,
                       'iscsi': None,
                       'name': 'default-token-8x245',
                       'nfs': None,
                       'persistent_volume_claim': None,
                       'photon_persistent_disk': None,
                       'portworx_volume': None,
                       'projected': None,
                       'quobyte': None,
                       'rbd': None,
                       'scale_io': None,
                       'secret': {'default_mode': 420,
                                  'items': None,
                                  'optional': None,
                                  'secret_name': 'default-token-8x245'},
                       'storageos': None,
                       'vsphere_volume': None}]},
 'status': {'conditions': [{'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 8, 28, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'Initialized'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 8, 39, tzinfo=tzlocal()),
                            'message': 'containers with unready status: '
                                       '[live-test]',
                            'reason': 'ContainersNotReady',
                            'status': 'False',
                            'type': 'Ready'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 8, 39, tzinfo=tzlocal()),
                            'message': 'containers with unready status: '
                                       '[live-test]',
                            'reason': 'ContainersNotReady',
                            'status': 'False',
                            'type': 'ContainersReady'},
                           {'last_probe_time': None,
                            'last_transition_time': datetime.datetime(2020, 8, 19, 4, 8, 28, tzinfo=tzlocal()),
                            'message': None,
                            'reason': None,
                            'status': 'True',
                            'type': 'PodScheduled'}],
            'container_statuses': [{'container_id': 'containerd://d7eca25873075bdb0d0368d8e4648924db51a46d9a7f2008e8653d5ff13a86e5',
                                    'image': 'docker.io/ollivier/clearwater-live-test:latest',
                                    'image_id': 'docker.io/ollivier/clearwater-live-test@sha256:77e928c23a5942aa681646be96dfb5897efe17b1e8676e8e94003ad08891b881',
                                    'last_state': {'running': None,
                                                   'terminated': None,
                                                   'waiting': None},
                                    'name': 'live-test',
                                    'ready': False,
                                    'restart_count': 0,
                                    'state': {'running': None,
                                              'terminated': {'container_id': 'containerd://d7eca25873075bdb0d0368d8e4648924db51a46d9a7f2008e8653d5ff13a86e5',
                                                             'exit_code': 1,
                                                             'finished_at': datetime.datetime(2020, 8, 19, 4, 8, 38, tzinfo=tzlocal()),
                                                             'message': None,
                                                             'reason': 'Error',
                                                             'signal': None,
                                                             'started_at': datetime.datetime(2020, 8, 19, 4, 8, 32, tzinfo=tzlocal())},
                                              'waiting': None}}],
            'host_ip': '172.18.0.5',
            'init_container_statuses': None,
            'message': None,
            'nominated_node_name': None,
            'phase': 'Failed',
            'pod_ip': '10.244.2.199',
            'qos_class': 'BestEffort',
            'reason': None,
            'start_time': datetime.datetime(2020, 8, 19, 4, 8, 28, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test', 'namespace': 'ims-h4q84', 'selfLink': '/api/v1/namespaces/ims-h4q84/pods/live-test', 'uid': '487f89c4-432e-4517-95a8-5cd68e775399', 'resourceVersion': '982498', 'creationTimestamp': '2020-08-19T04:08:28Z'}, 'spec': {'volumes': [{'name': 'default-token-8x245', 'secret': {'secretName': 'default-token-8x245', 'defaultMode': 420}}], 'containers': [{'name': 'live-test', 'image': 'ollivier/clearwater-live-test:latest', 'command': ['rake', 'test[ims-h4q84.svc.cluster.local]', 'PROXY=bono.ims-h4q84.svc.cluster.local', 'ELLIS=ellis.ims-h4q84.svc.cluster.local', 'SIGNUP_CODE=secret', '--trace'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-8x245', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Never', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Failed', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:08:28Z'}, {'type': 'Ready', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:08:39Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test]'}, {'type': 'ContainersReady', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:08:39Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test]'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-19T04:08:28Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.2.199', 'startTime': '2020-08-19T04:08:28Z', 'containerStatuses': [{'name': 'live-test', 'state': {'terminated': {'exitCode': 1, 'reason': 'Error', 'startedAt': '2020-08-19T04:08:32Z', 'finishedAt': '2020-08-19T04:08:38Z', 'containerID': 'containerd://d7eca25873075bdb0d0368d8e4648924db51a46d9a7f2008e8653d5ff13a86e5'}}, 'lastState': {}, 'ready': False, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'imageID': 'docker.io/ollivier/clearwater-live-test@sha256:77e928c23a5942aa681646be96dfb5897efe17b1e8676e8e94003ad08891b881', 'containerID': 'containerd://d7eca25873075bdb0d0368d8e4648924db51a46d9a7f2008e8653d5ff13a86e5'}], 'qosClass': 'BestEffort'}}}
2020-08-19 04:08:39,982 - kubernetes.client.rest - DEBUG - response body: ** Invoke test (first_time)
** Execute test
/usr/lib/ruby/gems/2.6.0/gems/httpi-2.4.0/lib/httpi/auth/ssl.rb:13: warning: constant OpenSSL::SSL::SSLContext::METHODS is deprecated
Basic Call - Mainline (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/basic-call.rb:19:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Basic Call - SDP (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/basic-call.rb:82:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Basic Call - Tel URIs (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550182%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/basic-call.rb:137:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Basic Call - Unknown number (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550225%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/basic-call.rb:178:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Basic Call - Rejected by remote endpoint (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550500%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/basic-call.rb:202:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Basic Call - Messages - Pager model (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550012%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/basic-call.rb:237:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Basic Call - Pracks (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550443%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/basic-call.rb:267:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Basic Registration (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550789%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/basic-register.rb:11:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Emergency Registration (TCP) - Skipped (Not running with emergency registrations)
   - Call with EMERGENCY_REG=Y to run test
Multiple Identities (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550466%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/basic-register.rb:65:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Call Barring - Outbound Rejection (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550789%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/call-barring.rb:13:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Call Barring - Allow non-international call (TCP) - Skipped (No PSTN support)
   - Call with PSTN=true to run test
Call Barring - Reject international call (TCP) - Skipped (No PSTN support)
   - Call with PSTN=true to run test
Call Barring - Inbound Rejection (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550089%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/call-barring.rb:130:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Call Diversion AS - Unconditional (TCP) - Skipped (No Call Diversion AS hostname provided)
   - Call with CDIV_AS=<hostname>
Call Diversion AS - Busy (TCP) - Skipped (No Call Diversion AS hostname provided)
   - Call with CDIV_AS=<hostname>
Call Diversion AS - No answer (TCP) - Skipped (No Call Diversion AS hostname provided)
   - Call with CDIV_AS=<hostname>
Call Diversion - Not registered (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550229%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/call-diversion.rb:80:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Call Diversion - Not reachable (not registered) (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550304%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/call-diversion.rb:101:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Call Diversion - Not reachable (408) (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550025%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/call-diversion.rb:124:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Call Diversion - Not reachable (503) (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550137%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/call-diversion.rb:159:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Call Diversion - Not reachable (500) (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550495%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/call-diversion.rb:193:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Call Diversion - Busy (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550003%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/call-diversion.rb:227:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Call Diversion - Unconditional (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550267%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/call-diversion.rb:258:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Call Diversion - No answer (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550727%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/call-diversion.rb:289:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Call Diversion - Bad target URI (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550295%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/call-diversion.rb:355:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Call Diversion - Audio-only call (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550709%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/call-diversion.rb:384:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Call Diversion - Audio-video call (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550014%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/call-diversion.rb:418:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Call Forking - Mainline (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550051%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/call-forking.rb:13:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Call Forking - Endpoint offline (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550410%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/call-forking.rb:108:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Call Forking - Endpoint offline while ringing (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550931%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/call-forking.rb:183:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Call Waiting - Accepted (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550926%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/call-waiting.rb:13:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Call Waiting - Cancelled (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550083%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/call-waiting.rb:123:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
CANCEL - Mainline (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550582%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/cancel.rb:13:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Filtering - Accept-Contact (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550567%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/contact-filtering.rb:12:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Accept-Contact with response (SFR 511195) (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550734%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/contact-filtering.rb:44:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Filtering - Accept-Contact no match (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550460%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/contact-filtering.rb:91:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Filtering - Accept-Contact negated match (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550931%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/contact-filtering.rb:118:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Filtering - RFC3841 example (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550203%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/contact-filtering.rb:152:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Filtering - Reject-Contact no match (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550626%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/contact-filtering.rb:236:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Filtering - Reject-Contact match (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550215%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/contact-filtering.rb:269:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Gemini - INVITE - VoIP device answers (TCP) - Skipped (No gemini hostname provided)
   - Call with GEMINI=<hostname>
Gemini - INVITE - Mobile device answers (TCP) - Skipped (No gemini hostname provided)
   - Call with GEMINI=<hostname>
Gemini - INVITE - VoIP device rejects (TCP) - Skipped (No gemini hostname provided)
   - Call with GEMINI=<hostname>
Gemini - INVITE - Mobile device rejects (TCP) - Skipped (No gemini hostname provided)
   - Call with GEMINI=<hostname>
Gemini - INVITE - Mobile device rejects with a 480 (TCP) - Skipped (No gemini hostname provided)
   - Call with GEMINI=<hostname>
Gemini - INVITE - Both reject, choose mobile response (TCP) - Skipped (No gemini hostname provided)
   - Call with GEMINI=<hostname>
Gemini - INVITE - Both reject, choose VoIP response (TCP) - Skipped (No gemini hostname provided)
   - Call with GEMINI=<hostname>
Gemini - INVITE - Successful call with GR (TCP) - Skipped (No gemini hostname provided)
   - Call with GEMINI=<hostname>
Gemini - INVITE - Failed call with GR (TCP) - Skipped (No gemini hostname provided)
   - Call with GEMINI=<hostname>
Gemini - INVITE - Successful call with Accept-Contact (TCP) - Skipped (No gemini hostname provided)
   - Call with GEMINI=<hostname>
Gemini - INVITE - Failed call with Accept-Contact (TCP) - Skipped (No gemini hostname provided)
   - Call with GEMINI=<hostname>
Gemini - SUBSCRIBE - Mobile Notifies (TCP) - Skipped (No gemini hostname provided)
   - Call with GEMINI=<hostname>
Gemini - SUBSCRIBE - Joint 408 (TCP) - Skipped (No gemini hostname provided)
   - Call with GEMINI=<hostname>
GRUU - REGISTER - two bindings with and without GRUU (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550738%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/gruu.rb:29:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
GRUU - REGISTER - binding suggested GRUU (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550831%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/gruu.rb:48:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
GRUU - REGISTER - instance ID requires escaping (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550210%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/gruu.rb:69:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
GRUU - REGISTER - three bindings with GRUUs (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550377%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/gruu.rb:84:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
GRUU - Call - first endpoint GRUU as target (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550988%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/gruu.rb:106:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
GRUU - Call - second endpoint GRUU as target (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550517%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/gruu.rb:142:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
GRUU - Call - only GRUU as target (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550281%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/gruu.rb:178:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
GRUU - Call - AoR as target (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550340%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/gruu.rb:214:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
GRUU - Call - unknown GRUU as target (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550987%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/gruu.rb:250:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
GRUU - Call - unknown GRUU as target - no GRUUs assigned (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550312%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/gruu.rb:278:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
GRUU - Call - Reject-Contact interop (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550592%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/gruu.rb:306:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
GRUU - Call - Accept-Contact interop (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550084%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/gruu.rb:336:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
GRUU - Call - AoR with other param as target (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550036%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/gruu.rb:375:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
GRUU - Call - GRUU with other param as target (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550816%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/gruu.rb:411:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
ISC Interface - Terminating (TCP) - Skipped (No hostname given)
   - Call with HOST_NAME=<publicly accessible hostname/IP of this machine>
ISC Interface - Terminating (UDP AS) (TCP) - Skipped (No hostname given)
   - Call with HOST_NAME=<publicly accessible hostname/IP of this machine>
ISC Interface - Terminating Failed (TCP) - Skipped (No hostname given)
   - Call with HOST_NAME=<publicly accessible hostname/IP of this machine>
ISC Interface - Third-party Registration (TCP) - Skipped (No hostname given)
   - Call with HOST_NAME=<publicly accessible hostname/IP of this machine>
ISC Interface - Third-party Registration - implicit registration (TCP) - Skipped (No hostname given)
   - Call with HOST_NAME=<publicly accessible hostname/IP of this machine>
ISC Interface - Redirect (TCP) - Skipped (No hostname given)
   - Call with HOST_NAME=<publicly accessible hostname/IP of this machine>
ISC Interface - B2BUA (TCP) - Skipped (No hostname given)
   - Call with HOST_NAME=<publicly accessible hostname/IP of this machine>
Live Call - Dial out to a real number (TCP) - Skipped (No live number given)
   - Call with LIVENUMBER=<number>
Memento - Incorrect Password (TCP) - Skipped (No memento hostnames provided)
   - Call with MEMENTO_SIP=<SIP hostname> and MEMENTO_HTTP=<HTTP hostname>
Memento - Wrong Call List (TCP) - Skipped (No memento hostnames provided)
   - Call with MEMENTO_SIP=<SIP hostname> and MEMENTO_HTTP=<HTTP hostname>
Memento - Basic Call (TCP) - Skipped (No memento hostnames provided)
   - Call with MEMENTO_SIP=<SIP hostname> and MEMENTO_HTTP=<HTTP hostname>
Memento - Unknown Number (TCP) - Skipped (No memento hostnames provided)
   - Call with MEMENTO_SIP=<SIP hostname> and MEMENTO_HTTP=<HTTP hostname>
Memento - Rejected Call (TCP) - Skipped (No memento hostnames provided)
   - Call with MEMENTO_SIP=<SIP hostname> and MEMENTO_HTTP=<HTTP hostname>
Memento - Cancelled Call (TCP) - Skipped (No memento hostnames provided)
   - Call with MEMENTO_SIP=<SIP hostname> and MEMENTO_HTTP=<HTTP hostname>
Memento - Privacy Call (TCP) - Skipped (No memento hostnames provided)
   - Call with MEMENTO_SIP=<SIP hostname> and MEMENTO_HTTP=<HTTP hostname>
Memento - Barred Call (TCP) - Skipped (No memento hostnames provided)
   - Call with MEMENTO_SIP=<SIP hostname> and MEMENTO_HTTP=<HTTP hostname>
Memento - Busy Call Forwarding (TCP) - Skipped (No memento hostnames provided)
   - Call with MEMENTO_SIP=<SIP hostname> and MEMENTO_HTTP=<HTTP hostname>
Nonce-Count - Mainline (TCP) - Skipped (No nonce-count support)
   - Call with NONCE_COUNT=Y to run test
Nonce-Count - Reject Re-Use (TCP) - Skipped (No nonce-count support)
   - Call with NONCE_COUNT=Y to run test
Off-net calls - tel: URI (TCP) - Skipped (No off-net number given)
   - Call with OFF_NET_TEL=<a number set up in ENUM/BGCF to route to port 5072 on this machine>
Off-net calls - sip: URI (TCP) - Skipped (No off-net number given)
   - Call with OFF_NET_TEL=<a number set up in ENUM/BGCF to route to port 5072 on this machine>
SUBSCRIBE - reg-event (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550714%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/subscribe.rb:24:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
SUBSCRIBE - reg-event with a GRUU (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550160%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/subscribe.rb:75:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
SUBSCRIBE - Subscription timeout (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550144%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/subscribe.rb:112:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
SUBSCRIBE - Registration timeout (TCP) - Skipped (Not running with short registrations)
   - Call with SHORT_REG=Y to run test
Multiple SUBSCRIBErs to one UE's reg-event (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550309%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/subscribe.rb:228:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Message - URN URIs (TCP) - Skipped (No hostname given)
   - Call with HOST_NAME=<publicly accessible hostname/IP of this machine>
Message - URN URIs to AS (TCP) - Skipped (No hostname given)
   - Call with HOST_NAME=<publicly accessible hostname/IP of this machine>
53 failures out of 96 tests run
    Basic Call - Mainline (TCP) at 2020-08-19 04:08:33 +0000
    Basic Call - SDP (TCP) at 2020-08-19 04:08:33 +0000
    Basic Call - Tel URIs (TCP) at 2020-08-19 04:08:34 +0000
    Basic Call - Unknown number (TCP) at 2020-08-19 04:08:34 +0000
    Basic Call - Rejected by remote endpoint (TCP) at 2020-08-19 04:08:34 +0000
    Basic Call - Messages - Pager model (TCP) at 2020-08-19 04:08:34 +0000
    Basic Call - Pracks (TCP) at 2020-08-19 04:08:35 +0000
    Basic Registration (TCP) at 2020-08-19 04:08:35 +0000
    Multiple Identities (TCP) at 2020-08-19 04:08:35 +0000
    Call Barring - Outbound Rejection (TCP) at 2020-08-19 04:08:35 +0000
    Call Barring - Inbound Rejection (TCP) at 2020-08-19 04:08:35 +0000
    Call Diversion - Not registered (TCP) at 2020-08-19 04:08:35 +0000
    Call Diversion - Not reachable (not registered) (TCP) at 2020-08-19 04:08:35 +0000
    Call Diversion - Not reachable (408) (TCP) at 2020-08-19 04:08:35 +0000
    Call Diversion - Not reachable (503) (TCP) at 2020-08-19 04:08:35 +0000
    Call Diversion - Not reachable (500) (TCP) at 2020-08-19 04:08:35 +0000
    Call Diversion - Busy (TCP) at 2020-08-19 04:08:35 +0000
    Call Diversion - Unconditional (TCP) at 2020-08-19 04:08:36 +0000
    Call Diversion - No answer (TCP) at 2020-08-19 04:08:36 +0000
    Call Diversion - Bad target URI (TCP) at 2020-08-19 04:08:36 +0000
    Call Diversion - Audio-only call (TCP) at 2020-08-19 04:08:36 +0000
    Call Diversion - Audio-video call (TCP) at 2020-08-19 04:08:36 +0000
    Call Forking - Mainline (TCP) at 2020-08-19 04:08:36 +0000
    Call Forking - Endpoint offline (TCP) at 2020-08-19 04:08:36 +0000
    Call Forking - Endpoint offline while ringing (TCP) at 2020-08-19 04:08:36 +0000
    Call Waiting - Accepted (TCP) at 2020-08-19 04:08:36 +0000
    Call Waiting - Cancelled (TCP) at 2020-08-19 04:08:36 +0000
    CANCEL - Mainline (TCP) at 2020-08-19 04:08:36 +0000
    Filtering - Accept-Contact (TCP) at 2020-08-19 04:08:36 +0000
    Accept-Contact with response (SFR 511195) (TCP) at 2020-08-19 04:08:36 +0000
    Filtering - Accept-Contact no match (TCP) at 2020-08-19 04:08:36 +0000
    Filtering - Accept-Contact negated match (TCP) at 2020-08-19 04:08:37 +0000
    Filtering - RFC3841 example (TCP) at 2020-08-19 04:08:37 +0000
    Filtering - Reject-Contact no match (TCP) at 2020-08-19 04:08:37 +0000
    Filtering - Reject-Contact match (TCP) at 2020-08-19 04:08:37 +0000
    GRUU - REGISTER - two bindings with and without GRUU (TCP) at 2020-08-19 04:08:37 +0000
    GRUU - REGISTER - binding suggested GRUU (TCP) at 2020-08-19 04:08:37 +0000
    GRUU - REGISTER - instance ID requires escaping (TCP) at 2020-08-19 04:08:37 +0000
    GRUU - REGISTER - three bindings with GRUUs (TCP) at 2020-08-19 04:08:37 +0000
    GRUU - Call - first endpoint GRUU as target (TCP) at 2020-08-19 04:08:37 +0000
    GRUU - Call - second endpoint GRUU as target (TCP) at 2020-08-19 04:08:37 +0000
    GRUU - Call - only GRUU as target (TCP) at 2020-08-19 04:08:37 +0000
    GRUU - Call - AoR as target (TCP) at 2020-08-19 04:08:37 +0000
    GRUU - Call - unknown GRUU as target (TCP) at 2020-08-19 04:08:37 +0000
    GRUU - Call - unknown GRUU as target - no GRUUs assigned (TCP) at 2020-08-19 04:08:37 +0000
    GRUU - Call - Reject-Contact interop (TCP) at 2020-08-19 04:08:37 +0000
    GRUU - Call - Accept-Contact interop (TCP) at 2020-08-19 04:08:38 +0000
    GRUU - Call - AoR with other param as target (TCP) at 2020-08-19 04:08:38 +0000
    GRUU - Call - GRUU with other param as target (TCP) at 2020-08-19 04:08:38 +0000
    SUBSCRIBE - reg-event (TCP) at 2020-08-19 04:08:38 +0000
    SUBSCRIBE - reg-event with a GRUU (TCP) at 2020-08-19 04:08:38 +0000
    SUBSCRIBE - Subscription timeout (TCP) at 2020-08-19 04:08:38 +0000
    Multiple SUBSCRIBErs to one UE's reg-event (TCP) at 2020-08-19 04:08:38 +0000
43 tests skipped
Error logs, including Call-IDs of failed calls, are in the 'logfiles' directory

2020-08-19 04:08:39,985 - functest_kubernetes.ims.ims - INFO - ** Invoke test (first_time)
** Execute test
/usr/lib/ruby/gems/2.6.0/gems/httpi-2.4.0/lib/httpi/auth/ssl.rb:13: warning: constant OpenSSL::SSL::SSLContext::METHODS is deprecated
Basic Call - Mainline (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/basic-call.rb:19:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Basic Call - SDP (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "500", "Upstream URL": "None"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/basic-call.rb:82:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Basic Call - Tel URIs (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550182%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/basic-call.rb:137:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Basic Call - Unknown number (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550225%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/basic-call.rb:178:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Basic Call - Rejected by remote endpoint (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550500%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/basic-call.rb:202:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Basic Call - Messages - Pager model (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550012%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/basic-call.rb:237:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Basic Call - Pracks (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550443%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/basic-call.rb:267:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Basic Registration (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550789%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/basic-register.rb:11:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Emergency Registration (TCP) - Skipped (Not running with emergency registrations)
   - Call with EMERGENCY_REG=Y to run test
Multiple Identities (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550466%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/basic-register.rb:65:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Call Barring - Outbound Rejection (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550789%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/call-barring.rb:13:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Call Barring - Allow non-international call (TCP) - Skipped (No PSTN support)
   - Call with PSTN=true to run test
Call Barring - Reject international call (TCP) - Skipped (No PSTN support)
   - Call with PSTN=true to run test
Call Barring - Inbound Rejection (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550089%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/call-barring.rb:130:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Call Diversion AS - Unconditional (TCP) - Skipped (No Call Diversion AS hostname provided)
   - Call with CDIV_AS=<hostname>
Call Diversion AS - Busy (TCP) - Skipped (No Call Diversion AS hostname provided)
   - Call with CDIV_AS=<hostname>
Call Diversion AS - No answer (TCP) - Skipped (No Call Diversion AS hostname provided)
   - Call with CDIV_AS=<hostname>
Call Diversion - Not registered (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550229%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/call-diversion.rb:80:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Call Diversion - Not reachable (not registered) (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550304%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/call-diversion.rb:101:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Call Diversion - Not reachable (408) (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550025%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/call-diversion.rb:124:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Call Diversion - Not reachable (503) (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550137%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/call-diversion.rb:159:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Call Diversion - Not reachable (500) (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550495%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/call-diversion.rb:193:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Call Diversion - Busy (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550003%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/call-diversion.rb:227:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Call Diversion - Unconditional (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550267%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/call-diversion.rb:258:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Call Diversion - No answer (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550727%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/call-diversion.rb:289:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Call Diversion - Bad target URI (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550295%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/call-diversion.rb:355:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Call Diversion - Audio-only call (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550709%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/call-diversion.rb:384:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Call Diversion - Audio-video call (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550014%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/call-diversion.rb:418:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Call Forking - Mainline (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550051%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/call-forking.rb:13:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Call Forking - Endpoint offline (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550410%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/call-forking.rb:108:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Call Forking - Endpoint offline while ringing (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550931%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/call-forking.rb:183:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Call Waiting - Accepted (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550926%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/call-waiting.rb:13:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Call Waiting - Cancelled (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550083%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/call-waiting.rb:123:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
CANCEL - Mainline (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550582%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/cancel.rb:13:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Filtering - Accept-Contact (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550567%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/contact-filtering.rb:12:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Accept-Contact with response (SFR 511195) (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550734%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/contact-filtering.rb:44:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Filtering - Accept-Contact no match (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550460%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/contact-filtering.rb:91:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Filtering - Accept-Contact negated match (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550931%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/contact-filtering.rb:118:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Filtering - RFC3841 example (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550203%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/contact-filtering.rb:152:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Filtering - Reject-Contact no match (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550626%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/contact-filtering.rb:236:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Filtering - Reject-Contact match (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550215%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/contact-filtering.rb:269:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Gemini - INVITE - VoIP device answers (TCP) - Skipped (No gemini hostname provided)
   - Call with GEMINI=<hostname>
Gemini - INVITE - Mobile device answers (TCP) - Skipped (No gemini hostname provided)
   - Call with GEMINI=<hostname>
Gemini - INVITE - VoIP device rejects (TCP) - Skipped (No gemini hostname provided)
   - Call with GEMINI=<hostname>
Gemini - INVITE - Mobile device rejects (TCP) - Skipped (No gemini hostname provided)
   - Call with GEMINI=<hostname>
Gemini - INVITE - Mobile device rejects with a 480 (TCP) - Skipped (No gemini hostname provided)
   - Call with GEMINI=<hostname>
Gemini - INVITE - Both reject, choose mobile response (TCP) - Skipped (No gemini hostname provided)
   - Call with GEMINI=<hostname>
Gemini - INVITE - Both reject, choose VoIP response (TCP) - Skipped (No gemini hostname provided)
   - Call with GEMINI=<hostname>
Gemini - INVITE - Successful call with GR (TCP) - Skipped (No gemini hostname provided)
   - Call with GEMINI=<hostname>
Gemini - INVITE - Failed call with GR (TCP) - Skipped (No gemini hostname provided)
   - Call with GEMINI=<hostname>
Gemini - INVITE - Successful call with Accept-Contact (TCP) - Skipped (No gemini hostname provided)
   - Call with GEMINI=<hostname>
Gemini - INVITE - Failed call with Accept-Contact (TCP) - Skipped (No gemini hostname provided)
   - Call with GEMINI=<hostname>
Gemini - SUBSCRIBE - Mobile Notifies (TCP) - Skipped (No gemini hostname provided)
   - Call with GEMINI=<hostname>
Gemini - SUBSCRIBE - Joint 408 (TCP) - Skipped (No gemini hostname provided)
   - Call with GEMINI=<hostname>
GRUU - REGISTER - two bindings with and without GRUU (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550738%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/gruu.rb:29:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
GRUU - REGISTER - binding suggested GRUU (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550831%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/gruu.rb:48:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
GRUU - REGISTER - instance ID requires escaping (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550210%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/gruu.rb:69:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
GRUU - REGISTER - three bindings with GRUUs (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550377%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/gruu.rb:84:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
GRUU - Call - first endpoint GRUU as target (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550988%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/gruu.rb:106:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
GRUU - Call - second endpoint GRUU as target (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550517%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/gruu.rb:142:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
GRUU - Call - only GRUU as target (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550281%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/gruu.rb:178:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
GRUU - Call - AoR as target (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550340%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/gruu.rb:214:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
GRUU - Call - unknown GRUU as target (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550987%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/gruu.rb:250:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
GRUU - Call - unknown GRUU as target - no GRUUs assigned (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550312%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/gruu.rb:278:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
GRUU - Call - Reject-Contact interop (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550592%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/gruu.rb:306:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
GRUU - Call - Accept-Contact interop (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550084%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/gruu.rb:336:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
GRUU - Call - AoR with other param as target (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550036%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/gruu.rb:375:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
GRUU - Call - GRUU with other param as target (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550816%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/gruu.rb:411:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
ISC Interface - Terminating (TCP) - Skipped (No hostname given)
   - Call with HOST_NAME=<publicly accessible hostname/IP of this machine>
ISC Interface - Terminating (UDP AS) (TCP) - Skipped (No hostname given)
   - Call with HOST_NAME=<publicly accessible hostname/IP of this machine>
ISC Interface - Terminating Failed (TCP) - Skipped (No hostname given)
   - Call with HOST_NAME=<publicly accessible hostname/IP of this machine>
ISC Interface - Third-party Registration (TCP) - Skipped (No hostname given)
   - Call with HOST_NAME=<publicly accessible hostname/IP of this machine>
ISC Interface - Third-party Registration - implicit registration (TCP) - Skipped (No hostname given)
   - Call with HOST_NAME=<publicly accessible hostname/IP of this machine>
ISC Interface - Redirect (TCP) - Skipped (No hostname given)
   - Call with HOST_NAME=<publicly accessible hostname/IP of this machine>
ISC Interface - B2BUA (TCP) - Skipped (No hostname given)
   - Call with HOST_NAME=<publicly accessible hostname/IP of this machine>
Live Call - Dial out to a real number (TCP) - Skipped (No live number given)
   - Call with LIVENUMBER=<number>
Memento - Incorrect Password (TCP) - Skipped (No memento hostnames provided)
   - Call with MEMENTO_SIP=<SIP hostname> and MEMENTO_HTTP=<HTTP hostname>
Memento - Wrong Call List (TCP) - Skipped (No memento hostnames provided)
   - Call with MEMENTO_SIP=<SIP hostname> and MEMENTO_HTTP=<HTTP hostname>
Memento - Basic Call (TCP) - Skipped (No memento hostnames provided)
   - Call with MEMENTO_SIP=<SIP hostname> and MEMENTO_HTTP=<HTTP hostname>
Memento - Unknown Number (TCP) - Skipped (No memento hostnames provided)
   - Call with MEMENTO_SIP=<SIP hostname> and MEMENTO_HTTP=<HTTP hostname>
Memento - Rejected Call (TCP) - Skipped (No memento hostnames provided)
   - Call with MEMENTO_SIP=<SIP hostname> and MEMENTO_HTTP=<HTTP hostname>
Memento - Cancelled Call (TCP) - Skipped (No memento hostnames provided)
   - Call with MEMENTO_SIP=<SIP hostname> and MEMENTO_HTTP=<HTTP hostname>
Memento - Privacy Call (TCP) - Skipped (No memento hostnames provided)
   - Call with MEMENTO_SIP=<SIP hostname> and MEMENTO_HTTP=<HTTP hostname>
Memento - Barred Call (TCP) - Skipped (No memento hostnames provided)
   - Call with MEMENTO_SIP=<SIP hostname> and MEMENTO_HTTP=<HTTP hostname>
Memento - Busy Call Forwarding (TCP) - Skipped (No memento hostnames provided)
   - Call with MEMENTO_SIP=<SIP hostname> and MEMENTO_HTTP=<HTTP hostname>
Nonce-Count - Mainline (TCP) - Skipped (No nonce-count support)
   - Call with NONCE_COUNT=Y to run test
Nonce-Count - Reject Re-Use (TCP) - Skipped (No nonce-count support)
   - Call with NONCE_COUNT=Y to run test
Off-net calls - tel: URI (TCP) - Skipped (No off-net number given)
   - Call with OFF_NET_TEL=<a number set up in ENUM/BGCF to route to port 5072 on this machine>
Off-net calls - sip: URI (TCP) - Skipped (No off-net number given)
   - Call with OFF_NET_TEL=<a number set up in ENUM/BGCF to route to port 5072 on this machine>
SUBSCRIBE - reg-event (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550714%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/subscribe.rb:24:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
SUBSCRIBE - reg-event with a GRUU (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550160%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/subscribe.rb:75:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
SUBSCRIBE - Subscription timeout (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550144%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/subscribe.rb:112:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
SUBSCRIBE - Registration timeout (TCP) - Skipped (Not running with short registrations)
   - Call with SHORT_REG=Y to run test
Multiple SUBSCRIBErs to one UE's reg-event (TCP) - Failed
  RuntimeError thrown:
   - Account creation failed with HTTP code 502, body {"status": 502, "message": "Bad Gateway", "reason": "Upstream request failed", "detail": {"Upstream error": "599", "Upstream URL": "http://homer.ims-h4q84.svc.cluster.local:7888/org.etsi.ngn.simservs/users/sip%3A6505550309%40ims-h4q84.svc.cluster.local/simservs.xml"}, "error": true}
     - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number'
     - /src/vims-test/lib/ellis.rb:187:in `get_number'
     - /src/vims-test/lib/ellis.rb:71:in `initialize'
     - /src/vims-test/lib/test-definition.rb:354:in `new'
     - /src/vims-test/lib/test-definition.rb:354:in `provision_line'
     - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint'
     - /src/vims-test/lib/tests/subscribe.rb:228:in `block in <top (required)>'
     - /src/vims-test/lib/test-definition.rb:256:in `run'
     - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all'
     - /src/vims-test/lib/test-definition.rb:112:in `collect'
     - /src/vims-test/lib/test-definition.rb:112:in `block in run_all'
     - /src/vims-test/lib/test-definition.rb:111:in `each'
     - /src/vims-test/lib/test-definition.rb:111:in `run_all'
     - /src/vims-test/lib/live-test.rb:23:in `run_tests'
     - /src/vims-test/Rakefile:18:in `block in <top (required)>'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
     - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run'
     - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `<top (required)>'
     - /usr/bin/rake:23:in `load'
     - /usr/bin/rake:23:in `<main>'
Message - URN URIs (TCP) - Skipped (No hostname given)
   - Call with HOST_NAME=<publicly accessible hostname/IP of this machine>
Message - URN URIs to AS (TCP) - Skipped (No hostname given)
   - Call with HOST_NAME=<publicly accessible hostname/IP of this machine>
53 failures out of 96 tests run
    Basic Call - Mainline (TCP) at 2020-08-19 04:08:33 +0000
    Basic Call - SDP (TCP) at 2020-08-19 04:08:33 +0000
    Basic Call - Tel URIs (TCP) at 2020-08-19 04:08:34 +0000
    Basic Call - Unknown number (TCP) at 2020-08-19 04:08:34 +0000
    Basic Call - Rejected by remote endpoint (TCP) at 2020-08-19 04:08:34 +0000
    Basic Call - Messages - Pager model (TCP) at 2020-08-19 04:08:34 +0000
    Basic Call - Pracks (TCP) at 2020-08-19 04:08:35 +0000
    Basic Registration (TCP) at 2020-08-19 04:08:35 +0000
    Multiple Identities (TCP) at 2020-08-19 04:08:35 +0000
    Call Barring - Outbound Rejection (TCP) at 2020-08-19 04:08:35 +0000
    Call Barring - Inbound Rejection (TCP) at 2020-08-19 04:08:35 +0000
    Call Diversion - Not registered (TCP) at 2020-08-19 04:08:35 +0000
    Call Diversion - Not reachable (not registered) (TCP) at 2020-08-19 04:08:35 +0000
    Call Diversion - Not reachable (408) (TCP) at 2020-08-19 04:08:35 +0000
    Call Diversion - Not reachable (503) (TCP) at 2020-08-19 04:08:35 +0000
    Call Diversion - Not reachable (500) (TCP) at 2020-08-19 04:08:35 +0000
    Call Diversion - Busy (TCP) at 2020-08-19 04:08:35 +0000
    Call Diversion - Unconditional (TCP) at 2020-08-19 04:08:36 +0000
    Call Diversion - No answer (TCP) at 2020-08-19 04:08:36 +0000
    Call Diversion - Bad target URI (TCP) at 2020-08-19 04:08:36 +0000
    Call Diversion - Audio-only call (TCP) at 2020-08-19 04:08:36 +0000
    Call Diversion - Audio-video call (TCP) at 2020-08-19 04:08:36 +0000
    Call Forking - Mainline (TCP) at 2020-08-19 04:08:36 +0000
    Call Forking - Endpoint offline (TCP) at 2020-08-19 04:08:36 +0000
    Call Forking - Endpoint offline while ringing (TCP) at 2020-08-19 04:08:36 +0000
    Call Waiting - Accepted (TCP) at 2020-08-19 04:08:36 +0000
    Call Waiting - Cancelled (TCP) at 2020-08-19 04:08:36 +0000
    CANCEL - Mainline (TCP) at 2020-08-19 04:08:36 +0000
    Filtering - Accept-Contact (TCP) at 2020-08-19 04:08:36 +0000
    Accept-Contact with response (SFR 511195) (TCP) at 2020-08-19 04:08:36 +0000
    Filtering - Accept-Contact no match (TCP) at 2020-08-19 04:08:36 +0000
    Filtering - Accept-Contact negated match (TCP) at 2020-08-19 04:08:37 +0000
    Filtering - RFC3841 example (TCP) at 2020-08-19 04:08:37 +0000
    Filtering - Reject-Contact no match (TCP) at 2020-08-19 04:08:37 +0000
    Filtering - Reject-Contact match (TCP) at 2020-08-19 04:08:37 +0000
    GRUU - REGISTER - two bindings with and without GRUU (TCP) at 2020-08-19 04:08:37 +0000
    GRUU - REGISTER - binding suggested GRUU (TCP) at 2020-08-19 04:08:37 +0000
    GRUU - REGISTER - instance ID requires escaping (TCP) at 2020-08-19 04:08:37 +0000
    GRUU - REGISTER - three bindings with GRUUs (TCP) at 2020-08-19 04:08:37 +0000
    GRUU - Call - first endpoint GRUU as target (TCP) at 2020-08-19 04:08:37 +0000
    GRUU - Call - second endpoint GRUU as target (TCP) at 2020-08-19 04:08:37 +0000
    GRUU - Call - only GRUU as target (TCP) at 2020-08-19 04:08:37 +0000
    GRUU - Call - AoR as target (TCP) at 2020-08-19 04:08:37 +0000
    GRUU - Call - unknown GRUU as target (TCP) at 2020-08-19 04:08:37 +0000
    GRUU - Call - unknown GRUU as target - no GRUUs assigned (TCP) at 2020-08-19 04:08:37 +0000
    GRUU - Call - Reject-Contact interop (TCP) at 2020-08-19 04:08:37 +0000
    GRUU - Call - Accept-Contact interop (TCP) at 2020-08-19 04:08:38 +0000
    GRUU - Call - AoR with other param as target (TCP) at 2020-08-19 04:08:38 +0000
    GRUU - Call - GRUU with other param as target (TCP) at 2020-08-19 04:08:38 +0000
    SUBSCRIBE - reg-event (TCP) at 2020-08-19 04:08:38 +0000
    SUBSCRIBE - reg-event with a GRUU (TCP) at 2020-08-19 04:08:38 +0000
    SUBSCRIBE - Subscription timeout (TCP) at 2020-08-19 04:08:38 +0000
    Multiple SUBSCRIBErs to one UE's reg-event (TCP) at 2020-08-19 04:08:38 +0000
43 tests skipped
Error logs, including Call-IDs of failed calls, are in the 'logfiles' directory

2020-08-19 04:08:40,016 - xtesting.ci.run_tests - INFO - Test result:

+-------------------+------------------+------------------+----------------+
|     TEST CASE     |     PROJECT      |     DURATION     |     RESULT     |
+-------------------+------------------+------------------+----------------+
|      k8s_vims     |     functest     |      09:01       |      FAIL      |
+-------------------+------------------+------------------+----------------+

2020-08-19 04:08:40,180 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"env-vars","kind":"configmaps","uid":"c06b3a3a-06ab-4866-a4c3-efb42f39cfaf"}}

2020-08-19 04:08:40,184 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_config_map: {'api_version': 'v1',
 'code': None,
 'details': {'causes': None,
             'group': None,
             'kind': 'configmaps',
             'name': 'env-vars',
             'retry_after_seconds': None,
             'uid': 'c06b3a3a-06ab-4866-a4c3-efb42f39cfaf'},
 'kind': 'Status',
 'message': None,
 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None},
 'reason': None,
 'status': 'Success'}
2020-08-19 04:08:40,218 - kubernetes.client.rest - DEBUG - response body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"live-test","namespace":"ims-h4q84","selfLink":"/api/v1/namespaces/ims-h4q84/pods/live-test","uid":"487f89c4-432e-4517-95a8-5cd68e775399","resourceVersion":"982503","creationTimestamp":"2020-08-19T04:08:28Z","deletionTimestamp":"2020-08-19T04:08:40Z","deletionGracePeriodSeconds":0},"spec":{"volumes":[{"name":"default-token-8x245","secret":{"secretName":"default-token-8x245","defaultMode":420}}],"containers":[{"name":"live-test","image":"ollivier/clearwater-live-test:latest","command":["rake","test[ims-h4q84.svc.cluster.local]","PROXY=bono.ims-h4q84.svc.cluster.local","ELLIS=ellis.ims-h4q84.svc.cluster.local","SIGNUP_CODE=secret","--trace"],"resources":{},"volumeMounts":[{"name":"default-token-8x245","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"restartPolicy":"Never","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"iruya-worker2","securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Failed","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-08-19T04:08:28Z"},{"type":"Ready","status":"False","lastProbeTime":null,"lastTransitionTime":"2020-08-19T04:08:39Z","reason":"ContainersNotReady","message":"containers with unready status: [live-test]"},{"type":"ContainersReady","status":"False","lastProbeTime":null,"lastTransitionTime":"2020-08-19T04:08:39Z","reason":"ContainersNotReady","message":"containers with unready status: [live-test]"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-08-19T04:08:28Z"}],"hostIP":"172.18.0.5","podIP":"10.244.2.199","startTime":"2020-08-19T04:08:28Z","containerStatuses":[{"name":"live-test","state":{"terminated":{"exitCode":1,"reason":"Error","startedAt":"2020-08-19T04:08:32Z","finishedAt":"2020-08-19T04:08:38Z","containerID":"containerd://d7eca25873075bdb0d0368d8e4648924db51a46d9a7f2008e8653d5ff13a86e5"}},"lastState":{},"ready":false,"restartCount":0,"image":"docker.io/ollivier/clearwater-live-test:latest","imageID":"docker.io/ollivier/clearwater-live-test@sha256:77e928c23a5942aa681646be96dfb5897efe17b1e8676e8e94003ad08891b881","containerID":"containerd://d7eca25873075bdb0d0368d8e4648924db51a46d9a7f2008e8653d5ff13a86e5"}],"qosClass":"BestEffort"}}

2020-08-19 04:08:40,221 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_pod: {'api_version': 'v1',
 'code': None,
 'details': None,
 'kind': 'Pod',
 'message': None,
 'metadata': {'_continue': None,
              'resource_version': '982503',
              'self_link': '/api/v1/namespaces/ims-h4q84/pods/live-test'},
 'reason': None,
 'status': "{'phase': 'Failed', 'conditions': [{'type': 'Initialized', "
           "'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': "
           "'2020-08-19T04:08:28Z'}, {'type': 'Ready', 'status': 'False', "
           "'lastProbeTime': None, 'lastTransitionTime': "
           "'2020-08-19T04:08:39Z', 'reason': 'ContainersNotReady', 'message': "
           "'containers with unready status: [live-test]'}, {'type': "
           "'ContainersReady', 'status': 'False', 'lastProbeTime': None, "
           "'lastTransitionTime': '2020-08-19T04:08:39Z', 'reason': "
           "'ContainersNotReady', 'message': 'containers with unready status: "
           "[live-test]'}, {'type': 'PodScheduled', 'status': 'True', "
           "'lastProbeTime': None, 'lastTransitionTime': "
           "'2020-08-19T04:08:28Z'}], 'hostIP': '172.18.0.5', 'podIP': "
           "'10.244.2.199', 'startTime': '2020-08-19T04:08:28Z', "
           "'containerStatuses': [{'name': 'live-test', 'state': "
           "{'terminated': {'exitCode': 1, 'reason': 'Error', 'startedAt': "
           "'2020-08-19T04:08:32Z', 'finishedAt': '2020-08-19T04:08:38Z', "
           "'containerID': "
           "'containerd://d7eca25873075bdb0d0368d8e4648924db51a46d9a7f2008e8653d5ff13a86e5'}}, "
           "'lastState': {}, 'ready': False, 'restartCount': 0, 'image': "
           "'docker.io/ollivier/clearwater-live-test:latest', 'imageID': "
           "'docker.io/ollivier/clearwater-live-test@sha256:77e928c23a5942aa681646be96dfb5897efe17b1e8676e8e94003ad08891b881', "
           "'containerID': "
           "'containerd://d7eca25873075bdb0d0368d8e4648924db51a46d9a7f2008e8653d5ff13a86e5'}], "
           "'qosClass': 'BestEffort'}"}
2020-08-19 04:08:40,297 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"astaire","group":"apps","kind":"deployments","uid":"70bf9edb-e201-4cbe-8cba-1b1ae3f80a33"}}

2020-08-19 04:08:40,299 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1',
 'code': None,
 'details': {'causes': None,
             'group': 'apps',
             'kind': 'deployments',
             'name': 'astaire',
             'retry_after_seconds': None,
             'uid': '70bf9edb-e201-4cbe-8cba-1b1ae3f80a33'},
 'kind': 'Status',
 'message': None,
 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None},
 'reason': None,
 'status': 'Success'}
2020-08-19 04:08:40,338 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"astaire","kind":"services","uid":"1d37a723-5ef3-4efb-bb33-65a62aba438c"}}

2020-08-19 04:08:40,350 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1',
 'code': None,
 'details': {'causes': None,
             'group': None,
             'kind': 'services',
             'name': 'astaire',
             'retry_after_seconds': None,
             'uid': '1d37a723-5ef3-4efb-bb33-65a62aba438c'},
 'kind': 'Status',
 'message': None,
 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None},
 'reason': None,
 'status': 'Success'}
2020-08-19 04:08:40,387 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"bono","group":"apps","kind":"deployments","uid":"08f3c434-4caf-4735-8f74-93f1561b3c04"}}

2020-08-19 04:08:40,389 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1',
 'code': None,
 'details': {'causes': None,
             'group': 'apps',
             'kind': 'deployments',
             'name': 'bono',
             'retry_after_seconds': None,
             'uid': '08f3c434-4caf-4735-8f74-93f1561b3c04'},
 'kind': 'Status',
 'message': None,
 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None},
 'reason': None,
 'status': 'Success'}
2020-08-19 04:08:40,443 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"bono","kind":"services","uid":"c7194672-5e0d-454a-92e1-93f73e065896"}}

2020-08-19 04:08:40,445 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1',
 'code': None,
 'details': {'causes': None,
             'group': None,
             'kind': 'services',
             'name': 'bono',
             'retry_after_seconds': None,
             'uid': 'c7194672-5e0d-454a-92e1-93f73e065896'},
 'kind': 'Status',
 'message': None,
 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None},
 'reason': None,
 'status': 'Success'}
2020-08-19 04:08:40,466 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"cassandra","group":"apps","kind":"deployments","uid":"2450d20d-764f-48c7-bd78-68a4bcdc93c2"}}

2020-08-19 04:08:40,468 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1',
 'code': None,
 'details': {'causes': None,
             'group': 'apps',
             'kind': 'deployments',
             'name': 'cassandra',
             'retry_after_seconds': None,
             'uid': '2450d20d-764f-48c7-bd78-68a4bcdc93c2'},
 'kind': 'Status',
 'message': None,
 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None},
 'reason': None,
 'status': 'Success'}
2020-08-19 04:08:40,509 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"cassandra","kind":"services","uid":"c2b895c1-af93-4493-975b-7828556fbb66"}}

2020-08-19 04:08:40,511 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1',
 'code': None,
 'details': {'causes': None,
             'group': None,
             'kind': 'services',
             'name': 'cassandra',
             'retry_after_seconds': None,
             'uid': 'c2b895c1-af93-4493-975b-7828556fbb66'},
 'kind': 'Status',
 'message': None,
 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None},
 'reason': None,
 'status': 'Success'}
2020-08-19 04:08:40,661 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"chronos","group":"apps","kind":"deployments","uid":"0fc1b512-88a4-4734-8f1e-3c57dc26a77b"}}

2020-08-19 04:08:40,663 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1',
 'code': None,
 'details': {'causes': None,
             'group': 'apps',
             'kind': 'deployments',
             'name': 'chronos',
             'retry_after_seconds': None,
             'uid': '0fc1b512-88a4-4734-8f1e-3c57dc26a77b'},
 'kind': 'Status',
 'message': None,
 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None},
 'reason': None,
 'status': 'Success'}
2020-08-19 04:08:40,926 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"chronos","kind":"services","uid":"05427d05-8835-4c01-b3fe-4c79d0faac64"}}

2020-08-19 04:08:40,929 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1',
 'code': None,
 'details': {'causes': None,
             'group': None,
             'kind': 'services',
             'name': 'chronos',
             'retry_after_seconds': None,
             'uid': '05427d05-8835-4c01-b3fe-4c79d0faac64'},
 'kind': 'Status',
 'message': None,
 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None},
 'reason': None,
 'status': 'Success'}
2020-08-19 04:08:40,974 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"ellis","group":"apps","kind":"deployments","uid":"1489ad06-8c54-4f56-a6b8-5cfd2daffb39"}}

2020-08-19 04:08:40,976 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1',
 'code': None,
 'details': {'causes': None,
             'group': 'apps',
             'kind': 'deployments',
             'name': 'ellis',
             'retry_after_seconds': None,
             'uid': '1489ad06-8c54-4f56-a6b8-5cfd2daffb39'},
 'kind': 'Status',
 'message': None,
 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None},
 'reason': None,
 'status': 'Success'}
2020-08-19 04:08:41,067 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"ellis","kind":"services","uid":"a9c333e0-5f90-4ae8-8b24-55470b511925"}}

2020-08-19 04:08:41,069 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1',
 'code': None,
 'details': {'causes': None,
             'group': None,
             'kind': 'services',
             'name': 'ellis',
             'retry_after_seconds': None,
             'uid': 'a9c333e0-5f90-4ae8-8b24-55470b511925'},
 'kind': 'Status',
 'message': None,
 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None},
 'reason': None,
 'status': 'Success'}
2020-08-19 04:08:41,089 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"etcd","group":"apps","kind":"deployments","uid":"ec404eeb-f1f4-4c19-abd5-a7605d350dd1"}}

2020-08-19 04:08:41,092 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1',
 'code': None,
 'details': {'causes': None,
             'group': 'apps',
             'kind': 'deployments',
             'name': 'etcd',
             'retry_after_seconds': None,
             'uid': 'ec404eeb-f1f4-4c19-abd5-a7605d350dd1'},
 'kind': 'Status',
 'message': None,
 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None},
 'reason': None,
 'status': 'Success'}
2020-08-19 04:08:41,141 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"etcd","kind":"services","uid":"a672f67b-10a6-4a63-aaf9-da166771c983"}}

2020-08-19 04:08:41,143 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1',
 'code': None,
 'details': {'causes': None,
             'group': None,
             'kind': 'services',
             'name': 'etcd',
             'retry_after_seconds': None,
             'uid': 'a672f67b-10a6-4a63-aaf9-da166771c983'},
 'kind': 'Status',
 'message': None,
 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None},
 'reason': None,
 'status': 'Success'}
2020-08-19 04:08:41,171 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"homer","group":"apps","kind":"deployments","uid":"75f3b2f0-529c-4fd0-8647-466ea1b655bc"}}

2020-08-19 04:08:41,173 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1',
 'code': None,
 'details': {'causes': None,
             'group': 'apps',
             'kind': 'deployments',
             'name': 'homer',
             'retry_after_seconds': None,
             'uid': '75f3b2f0-529c-4fd0-8647-466ea1b655bc'},
 'kind': 'Status',
 'message': None,
 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None},
 'reason': None,
 'status': 'Success'}
2020-08-19 04:08:41,521 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"homer","kind":"services","uid":"8e41d516-5475-412a-b2cc-8a5153d124e5"}}

2020-08-19 04:08:41,539 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1',
 'code': None,
 'details': {'causes': None,
             'group': None,
             'kind': 'services',
             'name': 'homer',
             'retry_after_seconds': None,
             'uid': '8e41d516-5475-412a-b2cc-8a5153d124e5'},
 'kind': 'Status',
 'message': None,
 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None},
 'reason': None,
 'status': 'Success'}
2020-08-19 04:08:41,561 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"homestead","group":"apps","kind":"deployments","uid":"165d9c1c-79b2-4d12-9ff0-a0801d1c1839"}}

2020-08-19 04:08:41,630 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1',
 'code': None,
 'details': {'causes': None,
             'group': 'apps',
             'kind': 'deployments',
             'name': 'homestead',
             'retry_after_seconds': None,
             'uid': '165d9c1c-79b2-4d12-9ff0-a0801d1c1839'},
 'kind': 'Status',
 'message': None,
 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None},
 'reason': None,
 'status': 'Success'}
2020-08-19 04:08:41,754 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"homestead","kind":"services","uid":"5365f334-2697-4fc4-921f-e8da33bdd788"}}

2020-08-19 04:08:41,756 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1',
 'code': None,
 'details': {'causes': None,
             'group': None,
             'kind': 'services',
             'name': 'homestead',
             'retry_after_seconds': None,
             'uid': '5365f334-2697-4fc4-921f-e8da33bdd788'},
 'kind': 'Status',
 'message': None,
 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None},
 'reason': None,
 'status': 'Success'}
2020-08-19 04:08:41,843 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"homestead-prov","group":"apps","kind":"deployments","uid":"74868f80-4d95-45cd-823a-a73146cb3109"}}

2020-08-19 04:08:41,845 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1',
 'code': None,
 'details': {'causes': None,
             'group': 'apps',
             'kind': 'deployments',
             'name': 'homestead-prov',
             'retry_after_seconds': None,
             'uid': '74868f80-4d95-45cd-823a-a73146cb3109'},
 'kind': 'Status',
 'message': None,
 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None},
 'reason': None,
 'status': 'Success'}
2020-08-19 04:08:42,248 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"homestead-prov","kind":"services","uid":"be768512-659e-40d3-b6ba-fa78194f32fe"}}

2020-08-19 04:08:42,250 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1',
 'code': None,
 'details': {'causes': None,
             'group': None,
             'kind': 'services',
             'name': 'homestead-prov',
             'retry_after_seconds': None,
             'uid': 'be768512-659e-40d3-b6ba-fa78194f32fe'},
 'kind': 'Status',
 'message': None,
 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None},
 'reason': None,
 'status': 'Success'}
2020-08-19 04:08:42,286 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"ralf","group":"apps","kind":"deployments","uid":"23b67868-499b-47be-94c2-817ef8fb0c04"}}

2020-08-19 04:08:42,291 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1',
 'code': None,
 'details': {'causes': None,
             'group': 'apps',
             'kind': 'deployments',
             'name': 'ralf',
             'retry_after_seconds': None,
             'uid': '23b67868-499b-47be-94c2-817ef8fb0c04'},
 'kind': 'Status',
 'message': None,
 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None},
 'reason': None,
 'status': 'Success'}
2020-08-19 04:08:42,818 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"ralf","kind":"services","uid":"cbc6ed58-1221-4c9b-8f1b-a95ecd1d6fc7"}}

2020-08-19 04:08:42,820 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1',
 'code': None,
 'details': {'causes': None,
             'group': None,
             'kind': 'services',
             'name': 'ralf',
             'retry_after_seconds': None,
             'uid': 'cbc6ed58-1221-4c9b-8f1b-a95ecd1d6fc7'},
 'kind': 'Status',
 'message': None,
 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None},
 'reason': None,
 'status': 'Success'}
2020-08-19 04:08:42,855 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"sprout","group":"apps","kind":"deployments","uid":"3a87fa02-60fb-44d1-aade-be3745d8c918"}}

2020-08-19 04:08:42,857 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1',
 'code': None,
 'details': {'causes': None,
             'group': 'apps',
             'kind': 'deployments',
             'name': 'sprout',
             'retry_after_seconds': None,
             'uid': '3a87fa02-60fb-44d1-aade-be3745d8c918'},
 'kind': 'Status',
 'message': None,
 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None},
 'reason': None,
 'status': 'Success'}
2020-08-19 04:08:42,988 - kubernetes.client.rest - DEBUG - response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"sprout","kind":"services","uid":"43eadbdf-18db-4c16-9f0f-e6451e1b7b3c"}}

2020-08-19 04:08:42,991 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1',
 'code': None,
 'details': {'causes': None,
             'group': None,
             'kind': 'services',
             'name': 'sprout',
             'retry_after_seconds': None,
             'uid': '43eadbdf-18db-4c16-9f0f-e6451e1b7b3c'},
 'kind': 'Status',
 'message': None,
 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None},
 'reason': None,
 'status': 'Success'}
2020-08-19 04:08:43,493 - kubernetes.client.rest - DEBUG - response body: {"kind":"Namespace","apiVersion":"v1","metadata":{"name":"ims-h4q84","generateName":"ims-","selfLink":"/api/v1/namespaces/ims-h4q84","uid":"5c6e206b-0717-4f1d-a9b8-548a04d8f354","resourceVersion":"982585","creationTimestamp":"2020-08-19T03:59:39Z","deletionTimestamp":"2020-08-19T04:08:43Z"},"spec":{"finalizers":["kubernetes"]},"status":{"phase":"Terminating"}}

2020-08-19 04:08:43,534 - functest_kubernetes.ims.ims - DEBUG - delete_namespace: ims-h4q84
2020-08-19 04:08:44,687 - xtesting.core.testcase - DEBUG - Publishing /var/lib/xtesting/results/functest-kubernetes.log ('text/plain', None)
2020-08-19 04:08:45,201 - xtesting.core.testcase - DEBUG - Publishing /var/lib/xtesting/results/functest-kubernetes.debug.log ('text/plain', None)