2020-08-15 02:19:24,977 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | k8-nosdn-nofeature-noha | | INSTALLER_TYPE | unknown | | BUILD_TAG | 2Z870F31X7KR | | NODE_NAME | lf-virtual1-2 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/functest-kubernetes/2Z870F31X7KR/functest-kubernetes-pi-ollivier-functest-kubernetes-cnf-arm-iruya-k8s_vims-run-6 | | HTTP_DST_URL | http://artifacts.opnfv.org/functest-kubernetes/2Z870F31X7KR/functest-kubernetes-pi-ollivier-functest-kubernetes-cnf-arm-iruya-k8s_vims-run-6 | +-------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------+ 2020-08-15 02:19:25,031 - xtesting.ci.run_tests - DEBUG - No env file /var/lib/xtesting/conf/env_file found 2020-08-15 02:19:25,034 - xtesting.ci.run_tests - DEBUG - Test args: k8s_vims 2020-08-15 02:19:25,083 - xtesting.ci.run_tests - INFO - Loading test case 'k8s_vims'... 2020-08-15 02:19:27,386 - xtesting.ci.run_tests - INFO - Running test case 'k8s_vims'... 2020-08-15 02:19:27,635 - functest_kubernetes.ims.ims - DEBUG - create_namespace: {'api_version': 'v1', 'kind': 'Namespace', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 27, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'ims-', 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'ims-wkr7p', 'namespace': None, 'owner_references': None, 'resource_version': '5019764', 'self_link': '/api/v1/namespaces/ims-wkr7p', 'uid': '81972d5b-1426-4dde-ae1f-c56139f7417b'}, 'spec': {'finalizers': ['kubernetes']}, 'status': {'phase': 'Active'}} 2020-08-15 02:19:27,681 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_config_map: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'ims-wkr7p.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 27, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5019766', 'self_link': '/api/v1/namespaces/ims-wkr7p/configmaps/env-vars', 'uid': '149f32ce-cace-4ab8-8d31-aeaa9fe7c7a4'}} 2020-08-15 02:19:28,021 - functest_kubernetes.ims.ims - INFO - Deployment astaire created 2020-08-15 02:19:28,022 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'ims-wkr7p.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 27, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5019766', 'self_link': '/api/v1/namespaces/ims-wkr7p/configmaps/env-vars', 'uid': '149f32ce-cace-4ab8-8d31-aeaa9fe7c7a4'}} 2020-08-15 02:19:28,492 - functest_kubernetes.ims.ims - INFO - Deployment bono created 2020-08-15 02:19:28,494 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'ims-wkr7p.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 27, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5019766', 'self_link': '/api/v1/namespaces/ims-wkr7p/configmaps/env-vars', 'uid': '149f32ce-cace-4ab8-8d31-aeaa9fe7c7a4'}} 2020-08-15 02:19:28,768 - functest_kubernetes.ims.ims - INFO - Deployment cassandra created 2020-08-15 02:19:28,776 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'ims-wkr7p.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 27, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5019766', 'self_link': '/api/v1/namespaces/ims-wkr7p/configmaps/env-vars', 'uid': '149f32ce-cace-4ab8-8d31-aeaa9fe7c7a4'}} 2020-08-15 02:19:29,133 - functest_kubernetes.ims.ims - INFO - Deployment chronos created 2020-08-15 02:19:29,139 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'ims-wkr7p.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 27, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5019766', 'self_link': '/api/v1/namespaces/ims-wkr7p/configmaps/env-vars', 'uid': '149f32ce-cace-4ab8-8d31-aeaa9fe7c7a4'}} 2020-08-15 02:19:29,405 - functest_kubernetes.ims.ims - INFO - Deployment ellis created 2020-08-15 02:19:29,406 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'ims-wkr7p.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 27, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5019766', 'self_link': '/api/v1/namespaces/ims-wkr7p/configmaps/env-vars', 'uid': '149f32ce-cace-4ab8-8d31-aeaa9fe7c7a4'}} 2020-08-15 02:19:30,486 - functest_kubernetes.ims.ims - INFO - Deployment etcd created 2020-08-15 02:19:30,487 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'ims-wkr7p.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 27, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5019766', 'self_link': '/api/v1/namespaces/ims-wkr7p/configmaps/env-vars', 'uid': '149f32ce-cace-4ab8-8d31-aeaa9fe7c7a4'}} 2020-08-15 02:19:30,890 - functest_kubernetes.ims.ims - INFO - Deployment homer created 2020-08-15 02:19:30,933 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'ims-wkr7p.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 27, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5019766', 'self_link': '/api/v1/namespaces/ims-wkr7p/configmaps/env-vars', 'uid': '149f32ce-cace-4ab8-8d31-aeaa9fe7c7a4'}} 2020-08-15 02:19:31,332 - functest_kubernetes.ims.ims - INFO - Deployment homestead created 2020-08-15 02:19:31,334 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'ims-wkr7p.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 27, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5019766', 'self_link': '/api/v1/namespaces/ims-wkr7p/configmaps/env-vars', 'uid': '149f32ce-cace-4ab8-8d31-aeaa9fe7c7a4'}} 2020-08-15 02:19:32,184 - functest_kubernetes.ims.ims - INFO - Deployment homestead-prov created 2020-08-15 02:19:32,186 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'ims-wkr7p.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 27, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5019766', 'self_link': '/api/v1/namespaces/ims-wkr7p/configmaps/env-vars', 'uid': '149f32ce-cace-4ab8-8d31-aeaa9fe7c7a4'}} 2020-08-15 02:19:32,441 - functest_kubernetes.ims.ims - INFO - Deployment ralf created 2020-08-15 02:19:32,442 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'ims-wkr7p.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 27, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5019766', 'self_link': '/api/v1/namespaces/ims-wkr7p/configmaps/env-vars', 'uid': '149f32ce-cace-4ab8-8d31-aeaa9fe7c7a4'}} 2020-08-15 02:19:33,412 - functest_kubernetes.ims.ims - INFO - Deployment sprout created 2020-08-15 02:19:33,414 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_deployment: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'ims-wkr7p.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 27, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5019766', 'self_link': '/api/v1/namespaces/ims-wkr7p/configmaps/env-vars', 'uid': '149f32ce-cace-4ab8-8d31-aeaa9fe7c7a4'}} 2020-08-15 02:19:33,867 - functest_kubernetes.ims.ims - INFO - Service astaire created 2020-08-15 02:19:33,868 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'ims-wkr7p.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 27, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5019766', 'self_link': '/api/v1/namespaces/ims-wkr7p/configmaps/env-vars', 'uid': '149f32ce-cace-4ab8-8d31-aeaa9fe7c7a4'}} 2020-08-15 02:19:35,265 - functest_kubernetes.ims.ims - INFO - Service bono created 2020-08-15 02:19:35,266 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'ims-wkr7p.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 27, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5019766', 'self_link': '/api/v1/namespaces/ims-wkr7p/configmaps/env-vars', 'uid': '149f32ce-cace-4ab8-8d31-aeaa9fe7c7a4'}} 2020-08-15 02:19:35,742 - functest_kubernetes.ims.ims - INFO - Service cassandra created 2020-08-15 02:19:35,743 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'ims-wkr7p.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 27, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5019766', 'self_link': '/api/v1/namespaces/ims-wkr7p/configmaps/env-vars', 'uid': '149f32ce-cace-4ab8-8d31-aeaa9fe7c7a4'}} 2020-08-15 02:19:35,970 - functest_kubernetes.ims.ims - INFO - Service chronos created 2020-08-15 02:19:35,972 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'ims-wkr7p.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 27, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5019766', 'self_link': '/api/v1/namespaces/ims-wkr7p/configmaps/env-vars', 'uid': '149f32ce-cace-4ab8-8d31-aeaa9fe7c7a4'}} 2020-08-15 02:19:36,869 - functest_kubernetes.ims.ims - INFO - Service ellis created 2020-08-15 02:19:36,871 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'ims-wkr7p.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 27, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5019766', 'self_link': '/api/v1/namespaces/ims-wkr7p/configmaps/env-vars', 'uid': '149f32ce-cace-4ab8-8d31-aeaa9fe7c7a4'}} 2020-08-15 02:19:37,305 - functest_kubernetes.ims.ims - INFO - Service etcd created 2020-08-15 02:19:37,306 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'ims-wkr7p.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 27, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5019766', 'self_link': '/api/v1/namespaces/ims-wkr7p/configmaps/env-vars', 'uid': '149f32ce-cace-4ab8-8d31-aeaa9fe7c7a4'}} 2020-08-15 02:19:37,991 - functest_kubernetes.ims.ims - INFO - Service homer created 2020-08-15 02:19:37,993 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'ims-wkr7p.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 27, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5019766', 'self_link': '/api/v1/namespaces/ims-wkr7p/configmaps/env-vars', 'uid': '149f32ce-cace-4ab8-8d31-aeaa9fe7c7a4'}} 2020-08-15 02:19:38,489 - functest_kubernetes.ims.ims - INFO - Service homestead created 2020-08-15 02:19:38,490 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'ims-wkr7p.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 27, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5019766', 'self_link': '/api/v1/namespaces/ims-wkr7p/configmaps/env-vars', 'uid': '149f32ce-cace-4ab8-8d31-aeaa9fe7c7a4'}} 2020-08-15 02:19:38,589 - functest_kubernetes.ims.ims - INFO - Service homestead-prov created 2020-08-15 02:19:38,590 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'ims-wkr7p.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 27, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5019766', 'self_link': '/api/v1/namespaces/ims-wkr7p/configmaps/env-vars', 'uid': '149f32ce-cace-4ab8-8d31-aeaa9fe7c7a4'}} 2020-08-15 02:19:39,218 - functest_kubernetes.ims.ims - INFO - Service ralf created 2020-08-15 02:19:39,219 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'ims-wkr7p.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 27, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5019766', 'self_link': '/api/v1/namespaces/ims-wkr7p/configmaps/env-vars', 'uid': '149f32ce-cace-4ab8-8d31-aeaa9fe7c7a4'}} 2020-08-15 02:19:39,831 - functest_kubernetes.ims.ims - INFO - Service sprout created 2020-08-15 02:19:39,833 - functest_kubernetes.ims.ims - DEBUG - create_namespaced_service: {'api_version': 'v1', 'binary_data': None, 'data': {'ADDITIONAL_SHARED_CONFIG': '', 'ZONE': 'ims-wkr7p.svc.cluster.local'}, 'kind': 'ConfigMap', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 27, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'env-vars', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5019766', 'self_link': '/api/v1/namespaces/ims-wkr7p/configmaps/env-vars', 'uid': '149f32ce-cace-4ab8-8d31-aeaa9fe7c7a4'}} 2020-08-15 02:19:39,887 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 27, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'astaire', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5019783', 'self_link': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/astaire', 'uid': '10769142-502b-4f28-b931-58790c379eaa'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'astaire'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'astaire'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-astaire:latest', 'image_pull_policy': 'Always', 'lifecycle': {'post_start': None, 'pre_stop': {'_exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}, 'http_get': None, 'tcp_socket': None}}, 'liveness_probe': {'_exec': None, 'failure_threshold': 9, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 11311}, 'timeout_seconds': 1}, 'name': 'astaire', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 11211, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 11311, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 11311}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/astaire', 'mount_propagation': None, 'name': 'astairelogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/astaire/astaire_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/astaire', 'mount_propagation': None, 'name': 'astairelogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 120, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'astairelogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 28, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 19, 28, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 28, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 19, 28, tzinfo=tzlocal()), 'message': 'ReplicaSet "astaire-5ddcdd6b7f" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'astaire', 'namespace': 'ims-wkr7p', 'selfLink': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/astaire', 'uid': '10769142-502b-4f28-b931-58790c379eaa', 'resourceVersion': '5019783', 'generation': 1, 'creationTimestamp': '2020-08-15T02:19:27Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'astaire'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'astaire'}}, 'spec': {'volumes': [{'name': 'astairelogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'astaire', 'image': 'ollivier/clearwater-astaire:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 11211, 'protocol': 'TCP'}, {'containerPort': 11311, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'astairelogs', 'mountPath': '/var/log/astaire'}], 'livenessProbe': {'tcpSocket': {'port': 11311}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 9}, 'readinessProbe': {'tcpSocket': {'port': 11311}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'lifecycle': {'preStop': {'exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}}}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/astaire/astaire_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'astairelogs', 'mountPath': '/var/log/astaire'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 120, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-08-15T02:19:28Z', 'lastTransitionTime': '2020-08-15T02:19:28Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-15T02:19:28Z', 'lastTransitionTime': '2020-08-15T02:19:28Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "astaire-5ddcdd6b7f" is progressing.'}]}}} 2020-08-15 02:19:40,170 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 31, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homestead', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5019881', 'self_link': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/homestead', 'uid': '4384a8ab-3852-4e40-ab06-def0f26a2d98'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'homestead'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'homestead', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/homestead', 'mount_propagation': None, 'name': 'homesteadlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/homestead/homestead_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/homestead', 'mount_propagation': None, 'name': 'homesteadlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'astaire; do ' 'echo waiting ' 'for astaire ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-astaire', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'homesteadlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 31, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 19, 31, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 31, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 19, 31, tzinfo=tzlocal()), 'message': 'ReplicaSet "homestead-57586d6cdc" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homestead', 'namespace': 'ims-wkr7p', 'selfLink': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/homestead', 'uid': '4384a8ab-3852-4e40-ab06-def0f26a2d98', 'resourceVersion': '5019881', 'generation': 1, 'creationTimestamp': '2020-08-15T02:19:31Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homestead'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homestead', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'homesteadlogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-astaire', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup astaire; do echo waiting for astaire to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead', 'image': 'ollivier/clearwater-homestead:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'homesteadlogs', 'mountPath': '/var/log/homestead'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/homestead/homestead_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'homesteadlogs', 'mountPath': '/var/log/homestead'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-08-15T02:19:31Z', 'lastTransitionTime': '2020-08-15T02:19:31Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-15T02:19:31Z', 'lastTransitionTime': '2020-08-15T02:19:31Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "homestead-57586d6cdc" is progressing.'}]}}} 2020-08-15 02:19:40,941 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 29, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'service': 'chronos'}, 'managed_fields': None, 'name': 'chronos', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5019824', 'self_link': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/chronos', 'uid': '653f9e3e-8bcd-470b-9fbf-c304b2f96b5e'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'chronos'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'chronos'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-chronos:latest', 'image_pull_policy': 'Always', 'lifecycle': {'post_start': None, 'pre_stop': {'_exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}, 'http_get': None, 'tcp_socket': None}}, 'liveness_probe': {'_exec': None, 'failure_threshold': 9, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7253}, 'timeout_seconds': 1}, 'name': 'chronos', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7253, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7253}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/chronos', 'mount_propagation': None, 'name': 'chronoslogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/chronos/chronos_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/chronos', 'mount_propagation': None, 'name': 'chronoslogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 120, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'chronoslogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 29, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 19, 29, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 29, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 19, 29, tzinfo=tzlocal()), 'message': 'ReplicaSet "chronos-687b9884c5" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'chronos', 'namespace': 'ims-wkr7p', 'selfLink': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/chronos', 'uid': '653f9e3e-8bcd-470b-9fbf-c304b2f96b5e', 'resourceVersion': '5019824', 'generation': 1, 'creationTimestamp': '2020-08-15T02:19:29Z', 'labels': {'service': 'chronos'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'chronos'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'chronos'}}, 'spec': {'volumes': [{'name': 'chronoslogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'chronos', 'image': 'ollivier/clearwater-chronos:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7253, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'chronoslogs', 'mountPath': '/var/log/chronos'}], 'livenessProbe': {'tcpSocket': {'port': 7253}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 9}, 'readinessProbe': {'tcpSocket': {'port': 7253}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'lifecycle': {'preStop': {'exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}}}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/chronos/chronos_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'chronoslogs', 'mountPath': '/var/log/chronos'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 120, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-08-15T02:19:29Z', 'lastTransitionTime': '2020-08-15T02:19:29Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-15T02:19:29Z', 'lastTransitionTime': '2020-08-15T02:19:29Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "chronos-687b9884c5" is progressing.'}]}}} 2020-08-15 02:19:41,214 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 29, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'etcd', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5019865', 'self_link': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/etcd', 'uid': 'db370c34-0b02-4623-b012-53f574082cc6'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'instance-type': 'etcd-pod'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'instance-type': 'etcd-pod'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': ['--name', '$(MY_POD_NAME)', '--advertise-client-urls', 'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', '--listen-client-urls', 'http://0.0.0.0:2379,http://0.0.0.0:4001', '--initial-advertise-peer-urls', 'http://$(MY_POD_IP):2380', '--listen-peer-urls', 'http://0.0.0.0:2380', '--initial-cluster', '$(MY_POD_NAME)=http://$(MY_POD_IP):2380', '--initial-cluster-state', 'new'], 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}, {'name': 'MY_POD_NAME', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'metadata.name'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': None, 'image': 'quay.io/coreos/etcd:v2.2.5', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 300, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 4001}, 'timeout_seconds': 1}, 'name': 'etcd', 'ports': [{'container_port': 2379, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 2380, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 4001, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 4001}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 30, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 19, 30, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 30, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 19, 31, tzinfo=tzlocal()), 'message': 'ReplicaSet "etcd-5cbf55c8c" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'etcd', 'namespace': 'ims-wkr7p', 'selfLink': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/etcd', 'uid': 'db370c34-0b02-4623-b012-53f574082cc6', 'resourceVersion': '5019865', 'generation': 1, 'creationTimestamp': '2020-08-15T02:19:29Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'instance-type': 'etcd-pod'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'instance-type': 'etcd-pod'}}, 'spec': {'containers': [{'name': 'etcd', 'image': 'quay.io/coreos/etcd:v2.2.5', 'args': ['--name', '$(MY_POD_NAME)', '--advertise-client-urls', 'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', '--listen-client-urls', 'http://0.0.0.0:2379,http://0.0.0.0:4001', '--initial-advertise-peer-urls', 'http://$(MY_POD_IP):2380', '--listen-peer-urls', 'http://0.0.0.0:2380', '--initial-cluster', '$(MY_POD_NAME)=http://$(MY_POD_IP):2380', '--initial-cluster-state', 'new'], 'ports': [{'containerPort': 2379, 'protocol': 'TCP'}, {'containerPort': 2380, 'protocol': 'TCP'}, {'containerPort': 4001, 'protocol': 'TCP'}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}, {'name': 'MY_POD_NAME', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'metadata.name'}}}], 'resources': {}, 'livenessProbe': {'tcpSocket': {'port': 4001}, 'initialDelaySeconds': 300, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 4001}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-08-15T02:19:30Z', 'lastTransitionTime': '2020-08-15T02:19:30Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-15T02:19:31Z', 'lastTransitionTime': '2020-08-15T02:19:30Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "etcd-5cbf55c8c" is progressing.'}]}}} 2020-08-15 02:19:41,402 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 29, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'ellis', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5019837', 'self_link': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/ellis', 'uid': '29b327ff-a49f-47e0-9243-d4fd4c9a18d3'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'ellis'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'ellis'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-ellis:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 80}, 'timeout_seconds': 1}, 'name': 'ellis', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 80, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 80}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'homestead-prov; ' 'do echo ' 'waiting for ' 'homestead-prov ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead-prov', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'sprout; do ' 'echo waiting ' 'for sprout ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 29, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 19, 29, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 29, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 19, 29, tzinfo=tzlocal()), 'message': 'ReplicaSet "ellis-57b84b6dd7" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'ellis', 'namespace': 'ims-wkr7p', 'selfLink': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/ellis', 'uid': '29b327ff-a49f-47e0-9243-d4fd4c9a18d3', 'resourceVersion': '5019837', 'generation': 1, 'creationTimestamp': '2020-08-15T02:19:29Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'ellis'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'ellis'}}, 'spec': {'initContainers': [{'name': 'wait-on-homestead-prov', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead-prov; do echo waiting for homestead-prov to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'ellis', 'image': 'ollivier/clearwater-ellis:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 80, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'tcpSocket': {'port': 80}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 80}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-08-15T02:19:29Z', 'lastTransitionTime': '2020-08-15T02:19:29Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-15T02:19:29Z', 'lastTransitionTime': '2020-08-15T02:19:29Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "ellis-57b84b6dd7" is progressing.'}]}}} 2020-08-15 02:19:41,614 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 30, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homer', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5019877', 'self_link': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/homer', 'uid': 'aca31640-7763-43f1-8dc5-cbb1be599d00'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'homer'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'homer'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homer:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'name': 'homer', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 31, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 19, 31, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 30, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 19, 31, tzinfo=tzlocal()), 'message': 'ReplicaSet "homer-74dd4556d9" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homer', 'namespace': 'ims-wkr7p', 'selfLink': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/homer', 'uid': 'aca31640-7763-43f1-8dc5-cbb1be599d00', 'resourceVersion': '5019877', 'generation': 1, 'creationTimestamp': '2020-08-15T02:19:30Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homer'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homer'}}, 'spec': {'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homer', 'image': 'ollivier/clearwater-homer:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'tcpSocket': {'port': 7888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 7888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-08-15T02:19:31Z', 'lastTransitionTime': '2020-08-15T02:19:31Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-15T02:19:31Z', 'lastTransitionTime': '2020-08-15T02:19:30Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "homer-74dd4556d9" is progressing.'}]}}} 2020-08-15 02:19:41,810 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 31, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homestead-prov', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5019900', 'self_link': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/homestead-prov', 'uid': '1094bf3d-81e2-463e-90ca-9f3b986ad6c6'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'homestead-prov'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'homestead-prov', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead-prov:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead-prov', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8889, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'homestead; ' 'do echo ' 'waiting for ' 'homestead to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 32, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 19, 32, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 32, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 19, 33, tzinfo=tzlocal()), 'message': 'ReplicaSet "homestead-prov-756c8bff5d" ' 'is progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homestead-prov', 'namespace': 'ims-wkr7p', 'selfLink': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/homestead-prov', 'uid': '1094bf3d-81e2-463e-90ca-9f3b986ad6c6', 'resourceVersion': '5019900', 'generation': 1, 'creationTimestamp': '2020-08-15T02:19:31Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homestead-prov'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homestead-prov', 'snmp': 'enabled'}}, 'spec': {'initContainers': [{'name': 'wait-on-homestead', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead-prov', 'image': 'ollivier/clearwater-homestead-prov:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8889, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-08-15T02:19:32Z', 'lastTransitionTime': '2020-08-15T02:19:32Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-15T02:19:33Z', 'lastTransitionTime': '2020-08-15T02:19:32Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "homestead-prov-756c8bff5d" is progressing.'}]}}} 2020-08-15 02:19:42,296 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 32, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'sprout', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5019933', 'self_link': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/sprout', 'uid': '99ac4155-92b8-4b61-9665-2b065f69ded8'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'sprout'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'sprout', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-sprout:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 3, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'sprout', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'ralf; do ' 'echo waiting ' 'for ralf to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-ralf', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'chronos; do ' 'echo waiting ' 'for chronos ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-chronos', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'homestead; ' 'do echo ' 'waiting for ' 'homestead to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'sproutlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 35, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 19, 35, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 33, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 19, 36, tzinfo=tzlocal()), 'message': 'ReplicaSet "sprout-686cc64cfb" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'sprout', 'namespace': 'ims-wkr7p', 'selfLink': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/sprout', 'uid': '99ac4155-92b8-4b61-9665-2b065f69ded8', 'resourceVersion': '5019933', 'generation': 1, 'creationTimestamp': '2020-08-15T02:19:32Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'sprout'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'sprout', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'sproutlogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-ralf', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup ralf; do echo waiting for ralf to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-chronos', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup chronos; do echo waiting for chronos to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-homestead', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'sprout', 'image': 'ollivier/clearwater-sprout:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 3, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-08-15T02:19:35Z', 'lastTransitionTime': '2020-08-15T02:19:35Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-15T02:19:36Z', 'lastTransitionTime': '2020-08-15T02:19:33Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "sprout-686cc64cfb" is progressing.'}]}}} 2020-08-15 02:19:42,595 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 28, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'cassandra', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5019810', 'self_link': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/cassandra', 'uid': '382fb138-8b87-4a76-b3d1-b5c31f2720ca'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'cassandra'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'cassandra'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-cassandra:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 ' '9042 ' '9160']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 600, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'cassandra', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7001, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 9042, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 9160, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 ' '9042 ' '9160']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'etcd; do ' 'echo waiting ' 'for etcd to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-etcd', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 28, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 19, 28, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 28, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 19, 28, tzinfo=tzlocal()), 'message': 'ReplicaSet "cassandra-76f5c4d86c" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'cassandra', 'namespace': 'ims-wkr7p', 'selfLink': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/cassandra', 'uid': '382fb138-8b87-4a76-b3d1-b5c31f2720ca', 'resourceVersion': '5019810', 'generation': 1, 'creationTimestamp': '2020-08-15T02:19:28Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'cassandra'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'cassandra'}}, 'spec': {'initContainers': [{'name': 'wait-on-etcd', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup etcd; do echo waiting for etcd to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'cassandra', 'image': 'ollivier/clearwater-cassandra:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7001, 'protocol': 'TCP'}, {'containerPort': 9042, 'protocol': 'TCP'}, {'containerPort': 9160, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 9160']}, 'initialDelaySeconds': 600, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 9160']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-08-15T02:19:28Z', 'lastTransitionTime': '2020-08-15T02:19:28Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-15T02:19:28Z', 'lastTransitionTime': '2020-08-15T02:19:28Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "cassandra-76f5c4d86c" is progressing.'}]}}} 2020-08-15 02:19:42,794 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 32, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'ralf', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5019928', 'self_link': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/ralf', 'uid': '31b4d4ef-a03d-48d6-9f1a-e12dde662c6b'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'ralf'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'ralf', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-ralf:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'name': 'ralf', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 10888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'ralflogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 33, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 19, 33, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 33, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 19, 35, tzinfo=tzlocal()), 'message': 'ReplicaSet "ralf-57c4654cb8" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'ralf', 'namespace': 'ims-wkr7p', 'selfLink': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/ralf', 'uid': '31b4d4ef-a03d-48d6-9f1a-e12dde662c6b', 'resourceVersion': '5019928', 'generation': 1, 'creationTimestamp': '2020-08-15T02:19:32Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'ralf'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'ralf', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'ralflogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'ralf', 'image': 'ollivier/clearwater-ralf:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 10888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}], 'livenessProbe': {'tcpSocket': {'port': 10888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 10888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-08-15T02:19:33Z', 'lastTransitionTime': '2020-08-15T02:19:33Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-15T02:19:35Z', 'lastTransitionTime': '2020-08-15T02:19:33Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "ralf-57c4654cb8" is progressing.'}]}}} 2020-08-15 02:19:43,047 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 28, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'bono', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5019797', 'self_link': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/bono', 'uid': 'afb32171-4e2c-42ef-9c4e-d4a496a308f5'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'bono'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'bono', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-bono:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 ' '5060 ' '5062']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'bono', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 3478, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5060, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5062, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5060, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'UDP'}, {'container_port': 5062, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'UDP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 ' '5060 ' '5062']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/bono', 'mount_propagation': None, 'name': 'bonologs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/bono/bono_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/bono', 'mount_propagation': None, 'name': 'bonologs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'sprout; do ' 'echo waiting ' 'for sprout ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'bonologs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': None, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 28, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 19, 28, tzinfo=tzlocal()), 'message': 'Deployment does not have minimum ' 'availability.', 'reason': 'MinimumReplicasUnavailable', 'status': 'False', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 28, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 19, 28, tzinfo=tzlocal()), 'message': 'ReplicaSet "bono-5cdb7bfcdd" is ' 'progressing.', 'reason': 'ReplicaSetUpdated', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': None, 'replicas': 1, 'unavailable_replicas': 1, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'bono', 'namespace': 'ims-wkr7p', 'selfLink': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/bono', 'uid': 'afb32171-4e2c-42ef-9c4e-d4a496a308f5', 'resourceVersion': '5019797', 'generation': 1, 'creationTimestamp': '2020-08-15T02:19:28Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'bono'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'bono', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'bonologs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'bono', 'image': 'ollivier/clearwater-bono:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 3478, 'protocol': 'TCP'}, {'containerPort': 5060, 'protocol': 'TCP'}, {'containerPort': 5062, 'protocol': 'TCP'}, {'containerPort': 5060, 'protocol': 'UDP'}, {'containerPort': 5062, 'protocol': 'UDP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'bonologs', 'mountPath': '/var/log/bono'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 5062']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 5062']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/bono/bono_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'bonologs', 'mountPath': '/var/log/bono'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'unavailableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'False', 'lastUpdateTime': '2020-08-15T02:19:28Z', 'lastTransitionTime': '2020-08-15T02:19:28Z', 'reason': 'MinimumReplicasUnavailable', 'message': 'Deployment does not have minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-15T02:19:28Z', 'lastTransitionTime': '2020-08-15T02:19:28Z', 'reason': 'ReplicaSetUpdated', 'message': 'ReplicaSet "bono-5cdb7bfcdd" is progressing.'}]}}} 2020-08-15 02:19:52,281 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 29, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'etcd', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5020034', 'self_link': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/etcd', 'uid': 'db370c34-0b02-4623-b012-53f574082cc6'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'instance-type': 'etcd-pod'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'instance-type': 'etcd-pod'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': ['--name', '$(MY_POD_NAME)', '--advertise-client-urls', 'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', '--listen-client-urls', 'http://0.0.0.0:2379,http://0.0.0.0:4001', '--initial-advertise-peer-urls', 'http://$(MY_POD_IP):2380', '--listen-peer-urls', 'http://0.0.0.0:2380', '--initial-cluster', '$(MY_POD_NAME)=http://$(MY_POD_IP):2380', '--initial-cluster-state', 'new'], 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}, {'name': 'MY_POD_NAME', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'metadata.name'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': None, 'image': 'quay.io/coreos/etcd:v2.2.5', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 300, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 4001}, 'timeout_seconds': 1}, 'name': 'etcd', 'ports': [{'container_port': 2379, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 2380, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 4001, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 4001}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': None, 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 52, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 19, 52, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 30, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 19, 52, tzinfo=tzlocal()), 'message': 'ReplicaSet "etcd-5cbf55c8c" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'etcd', 'namespace': 'ims-wkr7p', 'selfLink': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/etcd', 'uid': 'db370c34-0b02-4623-b012-53f574082cc6', 'resourceVersion': '5020034', 'generation': 1, 'creationTimestamp': '2020-08-15T02:19:29Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'instance-type': 'etcd-pod'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'instance-type': 'etcd-pod'}}, 'spec': {'containers': [{'name': 'etcd', 'image': 'quay.io/coreos/etcd:v2.2.5', 'args': ['--name', '$(MY_POD_NAME)', '--advertise-client-urls', 'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', '--listen-client-urls', 'http://0.0.0.0:2379,http://0.0.0.0:4001', '--initial-advertise-peer-urls', 'http://$(MY_POD_IP):2380', '--listen-peer-urls', 'http://0.0.0.0:2380', '--initial-cluster', '$(MY_POD_NAME)=http://$(MY_POD_IP):2380', '--initial-cluster-state', 'new'], 'ports': [{'containerPort': 2379, 'protocol': 'TCP'}, {'containerPort': 2380, 'protocol': 'TCP'}, {'containerPort': 4001, 'protocol': 'TCP'}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}, {'name': 'MY_POD_NAME', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'metadata.name'}}}], 'resources': {}, 'livenessProbe': {'tcpSocket': {'port': 4001}, 'initialDelaySeconds': 300, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 4001}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-08-15T02:19:52Z', 'lastTransitionTime': '2020-08-15T02:19:52Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-15T02:19:52Z', 'lastTransitionTime': '2020-08-15T02:19:30Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "etcd-5cbf55c8c" has successfully progressed.'}]}}} 2020-08-15 02:19:52,455 - functest_kubernetes.ims.ims - INFO - etcd started in 25.07 sec 2020-08-15 02:21:30,206 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 28, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'cassandra', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5020243', 'self_link': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/cassandra', 'uid': '382fb138-8b87-4a76-b3d1-b5c31f2720ca'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'cassandra'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'cassandra'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-cassandra:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 ' '9042 ' '9160']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 600, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'cassandra', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7001, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 9042, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 9160, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 ' '9042 ' '9160']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'etcd; do ' 'echo waiting ' 'for etcd to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-etcd', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 15, 2, 21, 30, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 21, 30, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 28, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 21, 30, tzinfo=tzlocal()), 'message': 'ReplicaSet "cassandra-76f5c4d86c" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'cassandra', 'namespace': 'ims-wkr7p', 'selfLink': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/cassandra', 'uid': '382fb138-8b87-4a76-b3d1-b5c31f2720ca', 'resourceVersion': '5020243', 'generation': 1, 'creationTimestamp': '2020-08-15T02:19:28Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'cassandra'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'cassandra'}}, 'spec': {'initContainers': [{'name': 'wait-on-etcd', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup etcd; do echo waiting for etcd to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'cassandra', 'image': 'ollivier/clearwater-cassandra:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7001, 'protocol': 'TCP'}, {'containerPort': 9042, 'protocol': 'TCP'}, {'containerPort': 9160, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 9160']}, 'initialDelaySeconds': 600, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 9160']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-08-15T02:21:30Z', 'lastTransitionTime': '2020-08-15T02:21:30Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-15T02:21:30Z', 'lastTransitionTime': '2020-08-15T02:19:28Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "cassandra-76f5c4d86c" has successfully progressed.'}]}}} 2020-08-15 02:21:30,397 - functest_kubernetes.ims.ims - INFO - cassandra started in 123.01 sec 2020-08-15 02:22:01,009 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 32, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'ralf', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5020351', 'self_link': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/ralf', 'uid': '31b4d4ef-a03d-48d6-9f1a-e12dde662c6b'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'ralf'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'ralf', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-ralf:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'name': 'ralf', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 10888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'ralflogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 15, 2, 22, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 22, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 33, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 22, tzinfo=tzlocal()), 'message': 'ReplicaSet "ralf-57c4654cb8" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'ralf', 'namespace': 'ims-wkr7p', 'selfLink': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/ralf', 'uid': '31b4d4ef-a03d-48d6-9f1a-e12dde662c6b', 'resourceVersion': '5020351', 'generation': 1, 'creationTimestamp': '2020-08-15T02:19:32Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'ralf'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'ralf', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'ralflogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'ralf', 'image': 'ollivier/clearwater-ralf:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 10888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}], 'livenessProbe': {'tcpSocket': {'port': 10888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 10888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-08-15T02:22:00Z', 'lastTransitionTime': '2020-08-15T02:22:00Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-15T02:22:00Z', 'lastTransitionTime': '2020-08-15T02:19:33Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "ralf-57c4654cb8" has successfully progressed.'}]}}} 2020-08-15 02:22:01,254 - functest_kubernetes.ims.ims - INFO - ralf started in 153.87 sec 2020-08-15 02:22:04,955 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 29, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': {'service': 'chronos'}, 'managed_fields': None, 'name': 'chronos', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5020364', 'self_link': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/chronos', 'uid': '653f9e3e-8bcd-470b-9fbf-c304b2f96b5e'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'chronos'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'chronos'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-chronos:latest', 'image_pull_policy': 'Always', 'lifecycle': {'post_start': None, 'pre_stop': {'_exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}, 'http_get': None, 'tcp_socket': None}}, 'liveness_probe': {'_exec': None, 'failure_threshold': 9, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7253}, 'timeout_seconds': 1}, 'name': 'chronos', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7253, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7253}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/chronos', 'mount_propagation': None, 'name': 'chronoslogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/chronos/chronos_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/chronos', 'mount_propagation': None, 'name': 'chronoslogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 120, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'chronoslogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 15, 2, 22, 4, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 22, 4, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 29, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 22, 4, tzinfo=tzlocal()), 'message': 'ReplicaSet "chronos-687b9884c5" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'chronos', 'namespace': 'ims-wkr7p', 'selfLink': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/chronos', 'uid': '653f9e3e-8bcd-470b-9fbf-c304b2f96b5e', 'resourceVersion': '5020364', 'generation': 1, 'creationTimestamp': '2020-08-15T02:19:29Z', 'labels': {'service': 'chronos'}, 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'chronos'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'chronos'}}, 'spec': {'volumes': [{'name': 'chronoslogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'chronos', 'image': 'ollivier/clearwater-chronos:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7253, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'chronoslogs', 'mountPath': '/var/log/chronos'}], 'livenessProbe': {'tcpSocket': {'port': 7253}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 9}, 'readinessProbe': {'tcpSocket': {'port': 7253}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'lifecycle': {'preStop': {'exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}}}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/chronos/chronos_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'chronoslogs', 'mountPath': '/var/log/chronos'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 120, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-08-15T02:22:04Z', 'lastTransitionTime': '2020-08-15T02:22:04Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-15T02:22:04Z', 'lastTransitionTime': '2020-08-15T02:19:29Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "chronos-687b9884c5" has successfully progressed.'}]}}} 2020-08-15 02:22:05,227 - functest_kubernetes.ims.ims - INFO - chronos started in 157.84 sec 2020-08-15 02:22:05,247 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 30, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homer', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5020371', 'self_link': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/homer', 'uid': 'aca31640-7763-43f1-8dc5-cbb1be599d00'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'homer'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'homer'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homer:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'name': 'homer', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 15, 2, 22, 5, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 22, 5, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 30, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 22, 5, tzinfo=tzlocal()), 'message': 'ReplicaSet "homer-74dd4556d9" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homer', 'namespace': 'ims-wkr7p', 'selfLink': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/homer', 'uid': 'aca31640-7763-43f1-8dc5-cbb1be599d00', 'resourceVersion': '5020371', 'generation': 1, 'creationTimestamp': '2020-08-15T02:19:30Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homer'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homer'}}, 'spec': {'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homer', 'image': 'ollivier/clearwater-homer:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'tcpSocket': {'port': 7888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 7888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-08-15T02:22:05Z', 'lastTransitionTime': '2020-08-15T02:22:05Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-15T02:22:05Z', 'lastTransitionTime': '2020-08-15T02:19:30Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "homer-74dd4556d9" has successfully progressed.'}]}}} 2020-08-15 02:22:05,608 - functest_kubernetes.ims.ims - INFO - homer started in 158.22 sec 2020-08-15 02:22:34,859 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 27, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'astaire', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5020441', 'self_link': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/astaire', 'uid': '10769142-502b-4f28-b931-58790c379eaa'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'astaire'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'astaire'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-astaire:latest', 'image_pull_policy': 'Always', 'lifecycle': {'post_start': None, 'pre_stop': {'_exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}, 'http_get': None, 'tcp_socket': None}}, 'liveness_probe': {'_exec': None, 'failure_threshold': 9, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 11311}, 'timeout_seconds': 1}, 'name': 'astaire', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 11211, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 11311, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 11311}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/astaire', 'mount_propagation': None, 'name': 'astairelogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/astaire/astaire_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/astaire', 'mount_propagation': None, 'name': 'astairelogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 120, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'astairelogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 15, 2, 22, 34, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 22, 34, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 28, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 22, 34, tzinfo=tzlocal()), 'message': 'ReplicaSet "astaire-5ddcdd6b7f" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'astaire', 'namespace': 'ims-wkr7p', 'selfLink': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/astaire', 'uid': '10769142-502b-4f28-b931-58790c379eaa', 'resourceVersion': '5020441', 'generation': 1, 'creationTimestamp': '2020-08-15T02:19:27Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'astaire'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'astaire'}}, 'spec': {'volumes': [{'name': 'astairelogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'astaire', 'image': 'ollivier/clearwater-astaire:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 11211, 'protocol': 'TCP'}, {'containerPort': 11311, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'astairelogs', 'mountPath': '/var/log/astaire'}], 'livenessProbe': {'tcpSocket': {'port': 11311}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 9}, 'readinessProbe': {'tcpSocket': {'port': 11311}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'lifecycle': {'preStop': {'exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}}}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/astaire/astaire_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'astairelogs', 'mountPath': '/var/log/astaire'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 120, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-08-15T02:22:34Z', 'lastTransitionTime': '2020-08-15T02:22:34Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-15T02:22:34Z', 'lastTransitionTime': '2020-08-15T02:19:28Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "astaire-5ddcdd6b7f" has successfully progressed.'}]}}} 2020-08-15 02:22:35,140 - functest_kubernetes.ims.ims - INFO - astaire started in 187.75 sec 2020-08-15 02:23:05,124 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 31, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homestead', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5020515', 'self_link': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/homestead', 'uid': '4384a8ab-3852-4e40-ab06-def0f26a2d98'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'homestead'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'homestead', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/homestead', 'mount_propagation': None, 'name': 'homesteadlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/homestead/homestead_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/homestead', 'mount_propagation': None, 'name': 'homesteadlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'cassandra; ' 'do echo ' 'waiting for ' 'cassandra to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'astaire; do ' 'echo waiting ' 'for astaire ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-astaire', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'homesteadlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 15, 2, 23, 5, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 23, 5, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 31, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 23, 5, tzinfo=tzlocal()), 'message': 'ReplicaSet "homestead-57586d6cdc" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homestead', 'namespace': 'ims-wkr7p', 'selfLink': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/homestead', 'uid': '4384a8ab-3852-4e40-ab06-def0f26a2d98', 'resourceVersion': '5020515', 'generation': 1, 'creationTimestamp': '2020-08-15T02:19:31Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homestead'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homestead', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'homesteadlogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-astaire', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup astaire; do echo waiting for astaire to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead', 'image': 'ollivier/clearwater-homestead:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'homesteadlogs', 'mountPath': '/var/log/homestead'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/homestead/homestead_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'homesteadlogs', 'mountPath': '/var/log/homestead'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-08-15T02:23:05Z', 'lastTransitionTime': '2020-08-15T02:23:05Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-15T02:23:05Z', 'lastTransitionTime': '2020-08-15T02:19:31Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "homestead-57586d6cdc" has successfully progressed.'}]}}} 2020-08-15 02:23:05,400 - functest_kubernetes.ims.ims - INFO - homestead started in 218.01 sec 2020-08-15 02:23:23,053 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 32, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'sprout', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5020568', 'self_link': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/sprout', 'uid': '99ac4155-92b8-4b61-9665-2b065f69ded8'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'sprout'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'sprout', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-sprout:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 3, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'sprout', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'ralf; do ' 'echo waiting ' 'for ralf to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-ralf', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'chronos; do ' 'echo waiting ' 'for chronos ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-chronos', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'homestead; ' 'do echo ' 'waiting for ' 'homestead to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'sproutlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 15, 2, 23, 22, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 23, 22, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 33, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 23, 22, tzinfo=tzlocal()), 'message': 'ReplicaSet "sprout-686cc64cfb" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'sprout', 'namespace': 'ims-wkr7p', 'selfLink': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/sprout', 'uid': '99ac4155-92b8-4b61-9665-2b065f69ded8', 'resourceVersion': '5020568', 'generation': 1, 'creationTimestamp': '2020-08-15T02:19:32Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'sprout'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'sprout', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'sproutlogs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-ralf', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup ralf; do echo waiting for ralf to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-chronos', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup chronos; do echo waiting for chronos to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-homestead', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'sprout', 'image': 'ollivier/clearwater-sprout:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 3, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-08-15T02:23:22Z', 'lastTransitionTime': '2020-08-15T02:23:22Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-15T02:23:22Z', 'lastTransitionTime': '2020-08-15T02:19:33Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "sprout-686cc64cfb" has successfully progressed.'}]}}} 2020-08-15 02:23:23,359 - functest_kubernetes.ims.ims - INFO - sprout started in 235.97 sec 2020-08-15 02:23:23,380 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 31, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'homestead-prov', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5020572', 'self_link': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/homestead-prov', 'uid': '1094bf3d-81e2-463e-90ca-9f3b986ad6c6'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'homestead-prov'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'homestead-prov', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead-prov:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead-prov', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8889, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'homestead; ' 'do echo ' 'waiting for ' 'homestead to ' 'start ...; ' 'sleep 2; ' 'done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 15, 2, 23, 23, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 23, 23, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 32, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 23, 23, tzinfo=tzlocal()), 'message': 'ReplicaSet "homestead-prov-756c8bff5d" ' 'has successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'homestead-prov', 'namespace': 'ims-wkr7p', 'selfLink': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/homestead-prov', 'uid': '1094bf3d-81e2-463e-90ca-9f3b986ad6c6', 'resourceVersion': '5020572', 'generation': 1, 'creationTimestamp': '2020-08-15T02:19:31Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'homestead-prov'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'homestead-prov', 'snmp': 'enabled'}}, 'spec': {'initContainers': [{'name': 'wait-on-homestead', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead-prov', 'image': 'ollivier/clearwater-homestead-prov:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8889, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-08-15T02:23:23Z', 'lastTransitionTime': '2020-08-15T02:23:23Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-15T02:23:23Z', 'lastTransitionTime': '2020-08-15T02:19:32Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "homestead-prov-756c8bff5d" has successfully progressed.'}]}}} 2020-08-15 02:23:23,566 - functest_kubernetes.ims.ims - INFO - homestead-prov started in 236.18 sec 2020-08-15 02:23:39,973 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 28, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'bono', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5020632', 'self_link': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/bono', 'uid': 'afb32171-4e2c-42ef-9c4e-d4a496a308f5'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'bono'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'bono', 'snmp': 'enabled'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-bono:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 ' '5060 ' '5062']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'bono', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 3478, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5060, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5062, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5060, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'UDP'}, {'container_port': 5062, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'UDP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 ' '5060 ' '5062']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/bono', 'mount_propagation': None, 'name': 'bonologs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/bono/bono_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/bono', 'mount_propagation': None, 'name': 'bonologs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'sprout; do ' 'echo waiting ' 'for sprout ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'bonologs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}]}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 15, 2, 23, 39, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 23, 39, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 28, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 23, 39, tzinfo=tzlocal()), 'message': 'ReplicaSet "bono-5cdb7bfcdd" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'bono', 'namespace': 'ims-wkr7p', 'selfLink': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/bono', 'uid': 'afb32171-4e2c-42ef-9c4e-d4a496a308f5', 'resourceVersion': '5020632', 'generation': 1, 'creationTimestamp': '2020-08-15T02:19:28Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'bono'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'bono', 'snmp': 'enabled'}}, 'spec': {'volumes': [{'name': 'bonologs', 'emptyDir': {}}], 'initContainers': [{'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'bono', 'image': 'ollivier/clearwater-bono:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 3478, 'protocol': 'TCP'}, {'containerPort': 5060, 'protocol': 'TCP'}, {'containerPort': 5062, 'protocol': 'TCP'}, {'containerPort': 5060, 'protocol': 'UDP'}, {'containerPort': 5062, 'protocol': 'UDP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'bonologs', 'mountPath': '/var/log/bono'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 5062']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 5062']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/bono/bono_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'bonologs', 'mountPath': '/var/log/bono'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-08-15T02:23:39Z', 'lastTransitionTime': '2020-08-15T02:23:39Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-15T02:23:39Z', 'lastTransitionTime': '2020-08-15T02:19:28Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "bono-5cdb7bfcdd" has successfully progressed.'}]}}} 2020-08-15 02:23:40,265 - functest_kubernetes.ims.ims - INFO - bono started in 252.88 sec 2020-08-15 02:23:48,214 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'apps/v1', 'kind': 'Deployment', 'metadata': {'annotations': {'deployment.kubernetes.io/revision': '1'}, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 29, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': 1, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'ellis', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5020653', 'self_link': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/ellis', 'uid': '29b327ff-a49f-47e0-9243-d4fd4c9a18d3'}, 'spec': {'min_ready_seconds': None, 'paused': None, 'progress_deadline_seconds': 600, 'replicas': 1, 'revision_history_limit': 10, 'selector': {'match_expressions': None, 'match_labels': {'service': 'ellis'}}, 'strategy': {'rolling_update': {'max_surge': '25%', 'max_unavailable': '25%'}, 'type': 'RollingUpdate'}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'service': 'ellis'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-ellis:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 80}, 'timeout_seconds': 1}, 'name': 'ellis', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 80, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 80}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'homestead-prov; ' 'do echo ' 'waiting for ' 'homestead-prov ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead-prov', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until ' 'nslookup ' 'sprout; do ' 'echo waiting ' 'for sprout ' 'to start ' '...; sleep ' '2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'node_name': None, 'node_selector': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}}, 'status': {'available_replicas': 1, 'collision_count': None, 'conditions': [{'last_transition_time': datetime.datetime(2020, 8, 15, 2, 23, 48, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 23, 48, tzinfo=tzlocal()), 'message': 'Deployment has minimum availability.', 'reason': 'MinimumReplicasAvailable', 'status': 'True', 'type': 'Available'}, {'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 29, tzinfo=tzlocal()), 'last_update_time': datetime.datetime(2020, 8, 15, 2, 23, 48, tzinfo=tzlocal()), 'message': 'ReplicaSet "ellis-57b84b6dd7" has ' 'successfully progressed.', 'reason': 'NewReplicaSetAvailable', 'status': 'True', 'type': 'Progressing'}], 'observed_generation': 1, 'ready_replicas': 1, 'replicas': 1, 'unavailable_replicas': None, 'updated_replicas': 1}}, 'raw_object': {'kind': 'Deployment', 'apiVersion': 'apps/v1', 'metadata': {'name': 'ellis', 'namespace': 'ims-wkr7p', 'selfLink': '/apis/apps/v1/namespaces/ims-wkr7p/deployments/ellis', 'uid': '29b327ff-a49f-47e0-9243-d4fd4c9a18d3', 'resourceVersion': '5020653', 'generation': 1, 'creationTimestamp': '2020-08-15T02:19:29Z', 'annotations': {'deployment.kubernetes.io/revision': '1'}}, 'spec': {'replicas': 1, 'selector': {'matchLabels': {'service': 'ellis'}}, 'template': {'metadata': {'creationTimestamp': None, 'labels': {'service': 'ellis'}}, 'spec': {'initContainers': [{'name': 'wait-on-homestead-prov', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead-prov; do echo waiting for homestead-prov to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'ellis', 'image': 'ollivier/clearwater-ellis:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 80, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'livenessProbe': {'tcpSocket': {'port': 80}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 80}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler'}}, 'strategy': {'type': 'RollingUpdate', 'rollingUpdate': {'maxUnavailable': '25%', 'maxSurge': '25%'}}, 'revisionHistoryLimit': 10, 'progressDeadlineSeconds': 600}, 'status': {'observedGeneration': 1, 'replicas': 1, 'updatedReplicas': 1, 'readyReplicas': 1, 'availableReplicas': 1, 'conditions': [{'type': 'Available', 'status': 'True', 'lastUpdateTime': '2020-08-15T02:23:48Z', 'lastTransitionTime': '2020-08-15T02:23:48Z', 'reason': 'MinimumReplicasAvailable', 'message': 'Deployment has minimum availability.'}, {'type': 'Progressing', 'status': 'True', 'lastUpdateTime': '2020-08-15T02:23:48Z', 'lastTransitionTime': '2020-08-15T02:19:29Z', 'reason': 'NewReplicaSetAvailable', 'message': 'ReplicaSet "ellis-57b84b6dd7" has successfully progressed.'}]}}} 2020-08-15 02:23:48,430 - functest_kubernetes.ims.ims - INFO - ellis started in 261.04 sec 2020-08-15 02:23:48,511 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 28, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'cassandra-76f5c4d86c-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '76f5c4d86c', 'service': 'cassandra'}, 'managed_fields': None, 'name': 'cassandra-76f5c4d86c-9dr6w', 'namespace': 'ims-wkr7p', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'cassandra-76f5c4d86c', 'uid': 'cb195f9e-a380-4d8c-b509-78f5d1629b39'}], 'resource_version': '5020240', 'self_link': '/api/v1/namespaces/ims-wkr7p/pods/cassandra-76f5c4d86c-9dr6w', 'uid': '12c86e40-a6d7-48f9-a42a-ec6fe65b43d8'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-cassandra:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 ' '9160']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 600, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'cassandra', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7001, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 9042, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 9160, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 ' '9160']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-v6bqj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup etcd; do echo ' 'waiting for etcd to start ...; ' 'sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-etcd', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-v6bqj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'iruya-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-v6bqj', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-v6bqj'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 20, 22, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 21, 30, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 21, 30, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 28, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://0cb13f64de6d1330b7d021120e09aed79eaf5ec375804adcf2ff4601be24546f', 'image': 'docker.io/ollivier/clearwater-cassandra:latest', 'image_id': 'docker.io/ollivier/clearwater-cassandra@sha256:232be9c5a4400e4c5e0932fde50af8f379e3e9ddd4d3f28da6ec78c86f6ed9f6', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'cassandra', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 8, 15, 2, 20, 26, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.5', 'init_container_statuses': [{'container_id': 'containerd://73d366bcd7a123c4aec72e4d50fa0640d27672efb602ed1ce5c96d5bd3f90d9d', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-etcd', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://73d366bcd7a123c4aec72e4d50fa0640d27672efb602ed1ce5c96d5bd3f90d9d', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 8, 15, 2, 20, 20, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 8, 15, 2, 19, 48, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.10', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 8, 15, 2, 19, 28, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'cassandra-76f5c4d86c-9dr6w', 'generateName': 'cassandra-76f5c4d86c-', 'namespace': 'ims-wkr7p', 'selfLink': '/api/v1/namespaces/ims-wkr7p/pods/cassandra-76f5c4d86c-9dr6w', 'uid': '12c86e40-a6d7-48f9-a42a-ec6fe65b43d8', 'resourceVersion': '5020240', 'creationTimestamp': '2020-08-15T02:19:28Z', 'labels': {'pod-template-hash': '76f5c4d86c', 'service': 'cassandra'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'cassandra-76f5c4d86c', 'uid': 'cb195f9e-a380-4d8c-b509-78f5d1629b39', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-v6bqj', 'secret': {'secretName': 'default-token-v6bqj', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-etcd', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup etcd; do echo waiting for etcd to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-v6bqj', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'cassandra', 'image': 'ollivier/clearwater-cassandra:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7001, 'protocol': 'TCP'}, {'containerPort': 9042, 'protocol': 'TCP'}, {'containerPort': 9160, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'default-token-v6bqj', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 9160']}, 'initialDelaySeconds': 600, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '7000 9042 9160']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:20:22Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:21:30Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:21:30Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:19:28Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.10', 'startTime': '2020-08-15T02:19:28Z', 'initContainerStatuses': [{'name': 'wait-on-etcd', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-08-15T02:19:48Z', 'finishedAt': '2020-08-15T02:20:20Z', 'containerID': 'containerd://73d366bcd7a123c4aec72e4d50fa0640d27672efb602ed1ce5c96d5bd3f90d9d'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://73d366bcd7a123c4aec72e4d50fa0640d27672efb602ed1ce5c96d5bd3f90d9d'}], 'containerStatuses': [{'name': 'cassandra', 'state': {'running': {'startedAt': '2020-08-15T02:20:26Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-cassandra:latest', 'imageID': 'docker.io/ollivier/clearwater-cassandra@sha256:232be9c5a4400e4c5e0932fde50af8f379e3e9ddd4d3f28da6ec78c86f6ed9f6', 'containerID': 'containerd://0cb13f64de6d1330b7d021120e09aed79eaf5ec375804adcf2ff4601be24546f'}], 'qosClass': 'BestEffort'}}} 2020-08-15 02:23:48,776 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 32, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'homestead-prov-756c8bff5d-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '756c8bff5d', 'service': 'homestead-prov', 'snmp': 'enabled'}, 'managed_fields': None, 'name': 'homestead-prov-756c8bff5d-gfw46', 'namespace': 'ims-wkr7p', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'homestead-prov-756c8bff5d', 'uid': '0edc6c59-5161-441e-abf8-e9c1c38d5c8b'}], 'resource_version': '5020569', 'self_link': '/api/v1/namespaces/ims-wkr7p/pods/homestead-prov-756c8bff5d-gfw46', 'uid': 'c267d08f-d000-4052-8704-0aab0ebffc86'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead-prov:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead-prov', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8889, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-v6bqj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup homestead; do echo ' 'waiting for homestead to start ' '...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-v6bqj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'iruya-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-v6bqj', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-v6bqj'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 23, 10, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 23, 23, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 23, 23, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 32, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://817462777785c4755d6c05bd605e8a1b94ede17dbea4c1c65c507ca46fd490d3', 'image': 'docker.io/ollivier/clearwater-homestead-prov:latest', 'image_id': 'docker.io/ollivier/clearwater-homestead-prov@sha256:0b4d47a5161ecb6b44f6a479a27522b802096a2deea049cd6f3c01a62b585318', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'homestead-prov', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 8, 15, 2, 23, 13, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.5', 'init_container_statuses': [{'container_id': 'containerd://5bd5aa95563e7731a4f307bb3c1efc3c9c2c7577eb02e6f263acd9a738cb80d9', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-homestead', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://5bd5aa95563e7731a4f307bb3c1efc3c9c2c7577eb02e6f263acd9a738cb80d9', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 8, 15, 2, 23, 9, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 8, 15, 2, 19, 50, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.15', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 8, 15, 2, 19, 33, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'homestead-prov-756c8bff5d-gfw46', 'generateName': 'homestead-prov-756c8bff5d-', 'namespace': 'ims-wkr7p', 'selfLink': '/api/v1/namespaces/ims-wkr7p/pods/homestead-prov-756c8bff5d-gfw46', 'uid': 'c267d08f-d000-4052-8704-0aab0ebffc86', 'resourceVersion': '5020569', 'creationTimestamp': '2020-08-15T02:19:32Z', 'labels': {'pod-template-hash': '756c8bff5d', 'service': 'homestead-prov', 'snmp': 'enabled'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'homestead-prov-756c8bff5d', 'uid': '0edc6c59-5161-441e-abf8-e9c1c38d5c8b', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-v6bqj', 'secret': {'secretName': 'default-token-v6bqj', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-homestead', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-v6bqj', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead-prov', 'image': 'ollivier/clearwater-homestead-prov:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8889, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'default-token-v6bqj', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/clearwater/bin/poll_homestead-prov.sh']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:23:10Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:23:23Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:23:23Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:19:32Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.15', 'startTime': '2020-08-15T02:19:33Z', 'initContainerStatuses': [{'name': 'wait-on-homestead', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-08-15T02:19:50Z', 'finishedAt': '2020-08-15T02:23:09Z', 'containerID': 'containerd://5bd5aa95563e7731a4f307bb3c1efc3c9c2c7577eb02e6f263acd9a738cb80d9'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://5bd5aa95563e7731a4f307bb3c1efc3c9c2c7577eb02e6f263acd9a738cb80d9'}], 'containerStatuses': [{'name': 'homestead-prov', 'state': {'running': {'startedAt': '2020-08-15T02:23:13Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-homestead-prov:latest', 'imageID': 'docker.io/ollivier/clearwater-homestead-prov@sha256:0b4d47a5161ecb6b44f6a479a27522b802096a2deea049cd6f3c01a62b585318', 'containerID': 'containerd://817462777785c4755d6c05bd605e8a1b94ede17dbea4c1c65c507ca46fd490d3'}], 'qosClass': 'BestEffort'}}} 2020-08-15 02:23:49,025 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 29, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'chronos-687b9884c5-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '687b9884c5', 'service': 'chronos'}, 'managed_fields': None, 'name': 'chronos-687b9884c5-2l8pz', 'namespace': 'ims-wkr7p', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'chronos-687b9884c5', 'uid': 'adb43921-660a-48d2-a43f-7df6f53b111c'}], 'resource_version': '5020360', 'self_link': '/api/v1/namespaces/ims-wkr7p/pods/chronos-687b9884c5-2l8pz', 'uid': '5406deab-3922-4272-b411-4233e877cab1'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-chronos:latest', 'image_pull_policy': 'Always', 'lifecycle': {'post_start': None, 'pre_stop': {'_exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}, 'http_get': None, 'tcp_socket': None}}, 'liveness_probe': {'_exec': None, 'failure_threshold': 9, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7253}, 'timeout_seconds': 1}, 'name': 'chronos', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7253, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7253}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/chronos', 'mount_propagation': None, 'name': 'chronoslogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-v6bqj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/chronos/chronos_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/chronos', 'mount_propagation': None, 'name': 'chronoslogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-v6bqj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup cassandra; do echo ' 'waiting for cassandra to start ' '...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-v6bqj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'iruya-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 120, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'chronoslogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}, {'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-v6bqj', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-v6bqj'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 21, 43, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 22, 4, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 22, 4, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 29, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://e24ab3d910ff15f51d57434f8c34bf252ee11054f41830891a48331be8869f6d', 'image': 'docker.io/ollivier/clearwater-chronos:latest', 'image_id': 'docker.io/ollivier/clearwater-chronos@sha256:3e838bae03946022eae06e3d343167d4b28507909e9c17e1bf574a23b423f83d', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'chronos', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 8, 15, 2, 21, 52, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}, {'container_id': 'containerd://0178a6f30e6cad7b32aa99a4425c1e4d840af5b2f1d403cfc7df06248314a7d6', 'image': 'docker.io/library/busybox:latest', 'image_id': 'docker.io/library/busybox@sha256:4f47c01fa91355af2865ac10fef5bf6ec9c7f42ad2321377c21e844427972977', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'tailer', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 8, 15, 2, 21, 57, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.5', 'init_container_statuses': [{'container_id': 'containerd://1ff90a0f20e1566b8b6e42293916f84b87c3c50dc4ad2dca556afbfb487e010b', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-cassandra', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://1ff90a0f20e1566b8b6e42293916f84b87c3c50dc4ad2dca556afbfb487e010b', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 8, 15, 2, 21, 42, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 8, 15, 2, 19, 50, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.11', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 8, 15, 2, 19, 29, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'chronos-687b9884c5-2l8pz', 'generateName': 'chronos-687b9884c5-', 'namespace': 'ims-wkr7p', 'selfLink': '/api/v1/namespaces/ims-wkr7p/pods/chronos-687b9884c5-2l8pz', 'uid': '5406deab-3922-4272-b411-4233e877cab1', 'resourceVersion': '5020360', 'creationTimestamp': '2020-08-15T02:19:29Z', 'labels': {'pod-template-hash': '687b9884c5', 'service': 'chronos'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'chronos-687b9884c5', 'uid': 'adb43921-660a-48d2-a43f-7df6f53b111c', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'chronoslogs', 'emptyDir': {}}, {'name': 'default-token-v6bqj', 'secret': {'secretName': 'default-token-v6bqj', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-v6bqj', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'chronos', 'image': 'ollivier/clearwater-chronos:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7253, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'chronoslogs', 'mountPath': '/var/log/chronos'}, {'name': 'default-token-v6bqj', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'tcpSocket': {'port': 7253}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 9}, 'readinessProbe': {'tcpSocket': {'port': 7253}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'lifecycle': {'preStop': {'exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}}}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/chronos/chronos_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'chronoslogs', 'mountPath': '/var/log/chronos'}, {'name': 'default-token-v6bqj', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 120, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:21:43Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:22:04Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:22:04Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:19:29Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.11', 'startTime': '2020-08-15T02:19:29Z', 'initContainerStatuses': [{'name': 'wait-on-cassandra', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-08-15T02:19:50Z', 'finishedAt': '2020-08-15T02:21:42Z', 'containerID': 'containerd://1ff90a0f20e1566b8b6e42293916f84b87c3c50dc4ad2dca556afbfb487e010b'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://1ff90a0f20e1566b8b6e42293916f84b87c3c50dc4ad2dca556afbfb487e010b'}], 'containerStatuses': [{'name': 'chronos', 'state': {'running': {'startedAt': '2020-08-15T02:21:52Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-chronos:latest', 'imageID': 'docker.io/ollivier/clearwater-chronos@sha256:3e838bae03946022eae06e3d343167d4b28507909e9c17e1bf574a23b423f83d', 'containerID': 'containerd://e24ab3d910ff15f51d57434f8c34bf252ee11054f41830891a48331be8869f6d'}, {'name': 'tailer', 'state': {'running': {'startedAt': '2020-08-15T02:21:57Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:latest', 'imageID': 'docker.io/library/busybox@sha256:4f47c01fa91355af2865ac10fef5bf6ec9c7f42ad2321377c21e844427972977', 'containerID': 'containerd://0178a6f30e6cad7b32aa99a4425c1e4d840af5b2f1d403cfc7df06248314a7d6'}], 'qosClass': 'BestEffort'}}} 2020-08-15 02:23:49,324 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 30, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'homer-74dd4556d9-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '74dd4556d9', 'service': 'homer'}, 'managed_fields': None, 'name': 'homer-74dd4556d9-hqgmj', 'namespace': 'ims-wkr7p', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'homer-74dd4556d9', 'uid': 'b126a2b3-6c49-4291-b8dd-0c7ff0305d9e'}], 'resource_version': '5020367', 'self_link': '/api/v1/namespaces/ims-wkr7p/pods/homer-74dd4556d9-hqgmj', 'uid': '191941b9-aa2c-464c-ae05-d222cb9c84af'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homer:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'name': 'homer', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 7888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 7888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-v6bqj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup cassandra; do echo ' 'waiting for cassandra to start ' '...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-v6bqj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'iruya-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-v6bqj', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-v6bqj'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 21, 42, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 22, 4, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 22, 4, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 31, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://7f020765829a1eee210810c315ce24388d5ba05ae1d7b2bb257676c979abdd06', 'image': 'docker.io/ollivier/clearwater-homer:latest', 'image_id': 'docker.io/ollivier/clearwater-homer@sha256:257ef9011d4ff30771c0c48ef7e3b16926dce88c17d4435953f433fa9e0d731a', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'homer', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 8, 15, 2, 21, 49, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.5', 'init_container_statuses': [{'container_id': 'containerd://34dd19348d4f5021de70fba555ab62b99beb6a9505010503e4d11202899a787f', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-cassandra', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://34dd19348d4f5021de70fba555ab62b99beb6a9505010503e4d11202899a787f', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 8, 15, 2, 21, 40, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 8, 15, 2, 19, 50, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.14', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 8, 15, 2, 19, 31, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'homer-74dd4556d9-hqgmj', 'generateName': 'homer-74dd4556d9-', 'namespace': 'ims-wkr7p', 'selfLink': '/api/v1/namespaces/ims-wkr7p/pods/homer-74dd4556d9-hqgmj', 'uid': '191941b9-aa2c-464c-ae05-d222cb9c84af', 'resourceVersion': '5020367', 'creationTimestamp': '2020-08-15T02:19:30Z', 'labels': {'pod-template-hash': '74dd4556d9', 'service': 'homer'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'homer-74dd4556d9', 'uid': 'b126a2b3-6c49-4291-b8dd-0c7ff0305d9e', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-v6bqj', 'secret': {'secretName': 'default-token-v6bqj', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-v6bqj', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homer', 'image': 'ollivier/clearwater-homer:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 7888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'default-token-v6bqj', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'tcpSocket': {'port': 7888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 7888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:21:42Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:22:04Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:22:04Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:19:31Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.14', 'startTime': '2020-08-15T02:19:31Z', 'initContainerStatuses': [{'name': 'wait-on-cassandra', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-08-15T02:19:50Z', 'finishedAt': '2020-08-15T02:21:40Z', 'containerID': 'containerd://34dd19348d4f5021de70fba555ab62b99beb6a9505010503e4d11202899a787f'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://34dd19348d4f5021de70fba555ab62b99beb6a9505010503e4d11202899a787f'}], 'containerStatuses': [{'name': 'homer', 'state': {'running': {'startedAt': '2020-08-15T02:21:49Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-homer:latest', 'imageID': 'docker.io/ollivier/clearwater-homer@sha256:257ef9011d4ff30771c0c48ef7e3b16926dce88c17d4435953f433fa9e0d731a', 'containerID': 'containerd://7f020765829a1eee210810c315ce24388d5ba05ae1d7b2bb257676c979abdd06'}], 'qosClass': 'BestEffort'}}} 2020-08-15 02:23:49,551 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 30, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'etcd-5cbf55c8c-', 'generation': None, 'initializers': None, 'labels': {'instance-type': 'etcd-pod', 'pod-template-hash': '5cbf55c8c'}, 'managed_fields': None, 'name': 'etcd-5cbf55c8c-xkxx7', 'namespace': 'ims-wkr7p', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'etcd-5cbf55c8c', 'uid': 'b1b3d62f-017a-4c97-a210-1902870f935d'}], 'resource_version': '5020031', 'self_link': '/api/v1/namespaces/ims-wkr7p/pods/etcd-5cbf55c8c-xkxx7', 'uid': 'fdc5375f-c83c-4b85-a074-cc4236cce95e'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': ['--name', '$(MY_POD_NAME)', '--advertise-client-urls', 'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', '--listen-client-urls', 'http://0.0.0.0:2379,http://0.0.0.0:4001', '--initial-advertise-peer-urls', 'http://$(MY_POD_IP):2380', '--listen-peer-urls', 'http://0.0.0.0:2380', '--initial-cluster', '$(MY_POD_NAME)=http://$(MY_POD_IP):2380', '--initial-cluster-state', 'new'], 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}, {'name': 'MY_POD_NAME', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'metadata.name'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': None, 'image': 'quay.io/coreos/etcd:v2.2.5', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 300, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 4001}, 'timeout_seconds': 1}, 'name': 'etcd', 'ports': [{'container_port': 2379, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 2380, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 4001, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 4001}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-v6bqj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': None, 'node_name': 'iruya-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-v6bqj', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-v6bqj'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 30, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 52, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 52, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 30, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://032ec14596bd01d40b899ccb91146a4fd90e413c0f484857a442f16c6fd4cf3f', 'image': 'quay.io/coreos/etcd:v2.2.5', 'image_id': 'sha256:66590e2dd05422771324d8ffe9ad35165ba35db0842ac5e0f1668c2d56733860', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'etcd', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 8, 15, 2, 19, 50, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.5', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.13', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 8, 15, 2, 19, 30, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'etcd-5cbf55c8c-xkxx7', 'generateName': 'etcd-5cbf55c8c-', 'namespace': 'ims-wkr7p', 'selfLink': '/api/v1/namespaces/ims-wkr7p/pods/etcd-5cbf55c8c-xkxx7', 'uid': 'fdc5375f-c83c-4b85-a074-cc4236cce95e', 'resourceVersion': '5020031', 'creationTimestamp': '2020-08-15T02:19:30Z', 'labels': {'instance-type': 'etcd-pod', 'pod-template-hash': '5cbf55c8c'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'etcd-5cbf55c8c', 'uid': 'b1b3d62f-017a-4c97-a210-1902870f935d', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-v6bqj', 'secret': {'secretName': 'default-token-v6bqj', 'defaultMode': 420}}], 'containers': [{'name': 'etcd', 'image': 'quay.io/coreos/etcd:v2.2.5', 'args': ['--name', '$(MY_POD_NAME)', '--advertise-client-urls', 'http://$(MY_POD_IP):2379,http://$(MY_POD_IP):4001', '--listen-client-urls', 'http://0.0.0.0:2379,http://0.0.0.0:4001', '--initial-advertise-peer-urls', 'http://$(MY_POD_IP):2380', '--listen-peer-urls', 'http://0.0.0.0:2380', '--initial-cluster', '$(MY_POD_NAME)=http://$(MY_POD_IP):2380', '--initial-cluster-state', 'new'], 'ports': [{'containerPort': 2379, 'protocol': 'TCP'}, {'containerPort': 2380, 'protocol': 'TCP'}, {'containerPort': 4001, 'protocol': 'TCP'}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}, {'name': 'MY_POD_NAME', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'metadata.name'}}}], 'resources': {}, 'volumeMounts': [{'name': 'default-token-v6bqj', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'tcpSocket': {'port': 4001}, 'initialDelaySeconds': 300, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 4001}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:19:30Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:19:52Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:19:52Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:19:30Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.13', 'startTime': '2020-08-15T02:19:30Z', 'containerStatuses': [{'name': 'etcd', 'state': {'running': {'startedAt': '2020-08-15T02:19:50Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'quay.io/coreos/etcd:v2.2.5', 'imageID': 'sha256:66590e2dd05422771324d8ffe9ad35165ba35db0842ac5e0f1668c2d56733860', 'containerID': 'containerd://032ec14596bd01d40b899ccb91146a4fd90e413c0f484857a442f16c6fd4cf3f'}], 'qosClass': 'BestEffort'}}} 2020-08-15 02:23:49,760 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 28, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'bono-5cdb7bfcdd-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '5cdb7bfcdd', 'service': 'bono', 'snmp': 'enabled'}, 'managed_fields': None, 'name': 'bono-5cdb7bfcdd-9nkvv', 'namespace': 'ims-wkr7p', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'bono-5cdb7bfcdd', 'uid': '5c98d03a-767d-4b5a-b4e0-e2daa3299718'}], 'resource_version': '5020629', 'self_link': '/api/v1/namespaces/ims-wkr7p/pods/bono-5cdb7bfcdd-9nkvv', 'uid': '687bde9c-f82b-4472-bc71-9369fd55fa1b'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-bono:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 ' '5062']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'bono', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 3478, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5060, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5062, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 5060, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'UDP'}, {'container_port': 5062, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'UDP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 ' '5062']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/bono', 'mount_propagation': None, 'name': 'bonologs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-v6bqj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/bono/bono_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/bono', 'mount_propagation': None, 'name': 'bonologs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-v6bqj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup sprout; do echo ' 'waiting for sprout to start ...; ' 'sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-v6bqj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'bonologs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}, {'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-v6bqj', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-v6bqj'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 23, 27, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 23, 39, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 23, 39, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 28, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://3ab0cc7fddc50f4e154574702c7ea3683b577eab683d40162ca37797e7174d1f', 'image': 'docker.io/ollivier/clearwater-bono:latest', 'image_id': 'docker.io/ollivier/clearwater-bono@sha256:95d9d53fc68c24deb2095b7b91aa7e53090f99e9c1d5c43dcf5d9a6fb8a8cdc2', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'bono', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 8, 15, 2, 23, 31, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}, {'container_id': 'containerd://790118e80519e92fdc0ef6686194e3339f6f9cf67fa42d585c1c26e904f7c40b', 'image': 'docker.io/library/busybox:latest', 'image_id': 'docker.io/library/busybox@sha256:4f47c01fa91355af2865ac10fef5bf6ec9c7f42ad2321377c21e844427972977', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'tailer', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 8, 15, 2, 23, 34, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.7', 'init_container_statuses': [{'container_id': 'containerd://1df4621d752b6d2d5c62aede85ec8d5023ddd9d9baa3fb3f4c671fe69185658d', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-sprout', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://1df4621d752b6d2d5c62aede85ec8d5023ddd9d9baa3fb3f4c671fe69185658d', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 8, 15, 2, 23, 26, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 8, 15, 2, 19, 37, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.67', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 8, 15, 2, 19, 28, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'bono-5cdb7bfcdd-9nkvv', 'generateName': 'bono-5cdb7bfcdd-', 'namespace': 'ims-wkr7p', 'selfLink': '/api/v1/namespaces/ims-wkr7p/pods/bono-5cdb7bfcdd-9nkvv', 'uid': '687bde9c-f82b-4472-bc71-9369fd55fa1b', 'resourceVersion': '5020629', 'creationTimestamp': '2020-08-15T02:19:28Z', 'labels': {'pod-template-hash': '5cdb7bfcdd', 'service': 'bono', 'snmp': 'enabled'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'bono-5cdb7bfcdd', 'uid': '5c98d03a-767d-4b5a-b4e0-e2daa3299718', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'bonologs', 'emptyDir': {}}, {'name': 'default-token-v6bqj', 'secret': {'secretName': 'default-token-v6bqj', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-v6bqj', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'bono', 'image': 'ollivier/clearwater-bono:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 3478, 'protocol': 'TCP'}, {'containerPort': 5060, 'protocol': 'TCP'}, {'containerPort': 5062, 'protocol': 'TCP'}, {'containerPort': 5060, 'protocol': 'UDP'}, {'containerPort': 5062, 'protocol': 'UDP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'bonologs', 'mountPath': '/var/log/bono'}, {'name': 'default-token-v6bqj', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 5062']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '3478 5060 5062']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/bono/bono_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'bonologs', 'mountPath': '/var/log/bono'}, {'name': 'default-token-v6bqj', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:23:27Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:23:39Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:23:39Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:19:28Z'}], 'hostIP': '172.18.0.7', 'podIP': '10.244.2.67', 'startTime': '2020-08-15T02:19:28Z', 'initContainerStatuses': [{'name': 'wait-on-sprout', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-08-15T02:19:37Z', 'finishedAt': '2020-08-15T02:23:26Z', 'containerID': 'containerd://1df4621d752b6d2d5c62aede85ec8d5023ddd9d9baa3fb3f4c671fe69185658d'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://1df4621d752b6d2d5c62aede85ec8d5023ddd9d9baa3fb3f4c671fe69185658d'}], 'containerStatuses': [{'name': 'bono', 'state': {'running': {'startedAt': '2020-08-15T02:23:31Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-bono:latest', 'imageID': 'docker.io/ollivier/clearwater-bono@sha256:95d9d53fc68c24deb2095b7b91aa7e53090f99e9c1d5c43dcf5d9a6fb8a8cdc2', 'containerID': 'containerd://3ab0cc7fddc50f4e154574702c7ea3683b577eab683d40162ca37797e7174d1f'}, {'name': 'tailer', 'state': {'running': {'startedAt': '2020-08-15T02:23:34Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:latest', 'imageID': 'docker.io/library/busybox@sha256:4f47c01fa91355af2865ac10fef5bf6ec9c7f42ad2321377c21e844427972977', 'containerID': 'containerd://790118e80519e92fdc0ef6686194e3339f6f9cf67fa42d585c1c26e904f7c40b'}], 'qosClass': 'BestEffort'}}} 2020-08-15 02:23:50,084 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 29, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'ellis-57b84b6dd7-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '57b84b6dd7', 'service': 'ellis'}, 'managed_fields': None, 'name': 'ellis-57b84b6dd7-j469b', 'namespace': 'ims-wkr7p', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'ellis-57b84b6dd7', 'uid': '909a1360-9ee5-44d7-92fb-2f0444b5d06c'}], 'resource_version': '5020650', 'self_link': '/api/v1/namespaces/ims-wkr7p/pods/ellis-57b84b6dd7-j469b', 'uid': 'a679f6a9-349f-4bcc-a4ea-aa440b1230c5'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-ellis:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 80}, 'timeout_seconds': 1}, 'name': 'ellis', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 80, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 80}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-v6bqj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup homestead-prov; do ' 'echo waiting for homestead-prov to ' 'start ...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead-prov', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-v6bqj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until nslookup sprout; do echo ' 'waiting for sprout to start ...; ' 'sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-sprout', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-v6bqj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'iruya-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-v6bqj', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-v6bqj'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 23, 32, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 23, 48, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 23, 48, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 29, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://e15565e8d6f78a64d15dbab878f6c708337e8b7ea0f39f1bc64f01fcb784da68', 'image': 'docker.io/ollivier/clearwater-ellis:latest', 'image_id': 'docker.io/ollivier/clearwater-ellis@sha256:28557b896e190c72f02121314ca7c9abaca30f91a733b566b2c44b761e5a252c', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'ellis', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 8, 15, 2, 23, 36, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.5', 'init_container_statuses': [{'container_id': 'containerd://938afb49d7ee3322cbc21db9f45d232c50c975f10bbc70d604cd6ebb0b5af39c', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-homestead-prov', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://938afb49d7ee3322cbc21db9f45d232c50c975f10bbc70d604cd6ebb0b5af39c', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 8, 15, 2, 23, 26, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 8, 15, 2, 19, 49, tzinfo=tzlocal())}, 'waiting': None}}, {'container_id': 'containerd://b3090e394da212ca8908aa32609e873c1363372a00aa0027d202ffbb25531631', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-sprout', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://b3090e394da212ca8908aa32609e873c1363372a00aa0027d202ffbb25531631', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 8, 15, 2, 23, 30, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 8, 15, 2, 23, 30, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.12', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 8, 15, 2, 19, 30, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'ellis-57b84b6dd7-j469b', 'generateName': 'ellis-57b84b6dd7-', 'namespace': 'ims-wkr7p', 'selfLink': '/api/v1/namespaces/ims-wkr7p/pods/ellis-57b84b6dd7-j469b', 'uid': 'a679f6a9-349f-4bcc-a4ea-aa440b1230c5', 'resourceVersion': '5020650', 'creationTimestamp': '2020-08-15T02:19:29Z', 'labels': {'pod-template-hash': '57b84b6dd7', 'service': 'ellis'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'ellis-57b84b6dd7', 'uid': '909a1360-9ee5-44d7-92fb-2f0444b5d06c', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'default-token-v6bqj', 'secret': {'secretName': 'default-token-v6bqj', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-homestead-prov', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead-prov; do echo waiting for homestead-prov to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-v6bqj', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-sprout', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup sprout; do echo waiting for sprout to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-v6bqj', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'ellis', 'image': 'ollivier/clearwater-ellis:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 80, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'default-token-v6bqj', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'tcpSocket': {'port': 80}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 80}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:23:32Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:23:48Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:23:48Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:19:29Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.12', 'startTime': '2020-08-15T02:19:30Z', 'initContainerStatuses': [{'name': 'wait-on-homestead-prov', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-08-15T02:19:49Z', 'finishedAt': '2020-08-15T02:23:26Z', 'containerID': 'containerd://938afb49d7ee3322cbc21db9f45d232c50c975f10bbc70d604cd6ebb0b5af39c'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://938afb49d7ee3322cbc21db9f45d232c50c975f10bbc70d604cd6ebb0b5af39c'}, {'name': 'wait-on-sprout', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-08-15T02:23:30Z', 'finishedAt': '2020-08-15T02:23:30Z', 'containerID': 'containerd://b3090e394da212ca8908aa32609e873c1363372a00aa0027d202ffbb25531631'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://b3090e394da212ca8908aa32609e873c1363372a00aa0027d202ffbb25531631'}], 'containerStatuses': [{'name': 'ellis', 'state': {'running': {'startedAt': '2020-08-15T02:23:36Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-ellis:latest', 'imageID': 'docker.io/ollivier/clearwater-ellis@sha256:28557b896e190c72f02121314ca7c9abaca30f91a733b566b2c44b761e5a252c', 'containerID': 'containerd://e15565e8d6f78a64d15dbab878f6c708337e8b7ea0f39f1bc64f01fcb784da68'}], 'qosClass': 'BestEffort'}}} 2020-08-15 02:23:50,359 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 28, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'astaire-5ddcdd6b7f-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '5ddcdd6b7f', 'service': 'astaire'}, 'managed_fields': None, 'name': 'astaire-5ddcdd6b7f-g9xb5', 'namespace': 'ims-wkr7p', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'astaire-5ddcdd6b7f', 'uid': 'bf062ccc-4940-485c-80dd-c0fef3e594ca'}], 'resource_version': '5020438', 'self_link': '/api/v1/namespaces/ims-wkr7p/pods/astaire-5ddcdd6b7f-g9xb5', 'uid': '410db19c-5625-45d9-b7bc-57af57e8a324'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-astaire:latest', 'image_pull_policy': 'Always', 'lifecycle': {'post_start': None, 'pre_stop': {'_exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}, 'http_get': None, 'tcp_socket': None}}, 'liveness_probe': {'_exec': None, 'failure_threshold': 9, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 11311}, 'timeout_seconds': 1}, 'name': 'astaire', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 11211, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 11311, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 11311}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/astaire', 'mount_propagation': None, 'name': 'astairelogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-v6bqj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/astaire/astaire_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/astaire', 'mount_propagation': None, 'name': 'astairelogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-v6bqj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup cassandra; do echo ' 'waiting for cassandra to start ' '...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-v6bqj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'iruya-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 120, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'astairelogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}, {'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-v6bqj', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-v6bqj'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 21, 41, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 22, 34, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 22, 34, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 28, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://764c29b9b59551d4b2df71b5cbcef89dfed8fbc2fd70cc66ea9f6672c7be2cc5', 'image': 'docker.io/ollivier/clearwater-astaire:latest', 'image_id': 'docker.io/ollivier/clearwater-astaire@sha256:eb85c150a60609d7b22b70b99d6a1a7a1c035fd64e30cca203a8b8d167bb7938', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'astaire', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 8, 15, 2, 21, 48, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}, {'container_id': 'containerd://c4f530881626d842eb6bc119f1d6f4a8e6526433489d1dc7c264ae4af5987501', 'image': 'docker.io/library/busybox:latest', 'image_id': 'docker.io/library/busybox@sha256:4f47c01fa91355af2865ac10fef5bf6ec9c7f42ad2321377c21e844427972977', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'tailer', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 8, 15, 2, 21, 55, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.5', 'init_container_statuses': [{'container_id': 'containerd://719503a00eaa1f3b6c885e87ad83932bca7af6c5ffd6adfdb9dbaaf41869b467', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-cassandra', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://719503a00eaa1f3b6c885e87ad83932bca7af6c5ffd6adfdb9dbaaf41869b467', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 8, 15, 2, 21, 40, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 8, 15, 2, 19, 38, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.9', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 8, 15, 2, 19, 28, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'astaire-5ddcdd6b7f-g9xb5', 'generateName': 'astaire-5ddcdd6b7f-', 'namespace': 'ims-wkr7p', 'selfLink': '/api/v1/namespaces/ims-wkr7p/pods/astaire-5ddcdd6b7f-g9xb5', 'uid': '410db19c-5625-45d9-b7bc-57af57e8a324', 'resourceVersion': '5020438', 'creationTimestamp': '2020-08-15T02:19:28Z', 'labels': {'pod-template-hash': '5ddcdd6b7f', 'service': 'astaire'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'astaire-5ddcdd6b7f', 'uid': 'bf062ccc-4940-485c-80dd-c0fef3e594ca', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'astairelogs', 'emptyDir': {}}, {'name': 'default-token-v6bqj', 'secret': {'secretName': 'default-token-v6bqj', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-v6bqj', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'astaire', 'image': 'ollivier/clearwater-astaire:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 11211, 'protocol': 'TCP'}, {'containerPort': 11311, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'astairelogs', 'mountPath': '/var/log/astaire'}, {'name': 'default-token-v6bqj', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'tcpSocket': {'port': 11311}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 9}, 'readinessProbe': {'tcpSocket': {'port': 11311}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'lifecycle': {'preStop': {'exec': {'command': ['/bin/bash', '-c', '/usr/bin/pre-stop']}}}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/astaire/astaire_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'astairelogs', 'mountPath': '/var/log/astaire'}, {'name': 'default-token-v6bqj', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 120, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:21:41Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:22:34Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:22:34Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:19:28Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.9', 'startTime': '2020-08-15T02:19:28Z', 'initContainerStatuses': [{'name': 'wait-on-cassandra', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-08-15T02:19:38Z', 'finishedAt': '2020-08-15T02:21:40Z', 'containerID': 'containerd://719503a00eaa1f3b6c885e87ad83932bca7af6c5ffd6adfdb9dbaaf41869b467'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://719503a00eaa1f3b6c885e87ad83932bca7af6c5ffd6adfdb9dbaaf41869b467'}], 'containerStatuses': [{'name': 'astaire', 'state': {'running': {'startedAt': '2020-08-15T02:21:48Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-astaire:latest', 'imageID': 'docker.io/ollivier/clearwater-astaire@sha256:eb85c150a60609d7b22b70b99d6a1a7a1c035fd64e30cca203a8b8d167bb7938', 'containerID': 'containerd://764c29b9b59551d4b2df71b5cbcef89dfed8fbc2fd70cc66ea9f6672c7be2cc5'}, {'name': 'tailer', 'state': {'running': {'startedAt': '2020-08-15T02:21:55Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:latest', 'imageID': 'docker.io/library/busybox@sha256:4f47c01fa91355af2865ac10fef5bf6ec9c7f42ad2321377c21e844427972977', 'containerID': 'containerd://c4f530881626d842eb6bc119f1d6f4a8e6526433489d1dc7c264ae4af5987501'}], 'qosClass': 'BestEffort'}}} 2020-08-15 02:23:50,678 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 33, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'sprout-686cc64cfb-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '686cc64cfb', 'service': 'sprout', 'snmp': 'enabled'}, 'managed_fields': None, 'name': 'sprout-686cc64cfb-jf9h8', 'namespace': 'ims-wkr7p', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'sprout-686cc64cfb', 'uid': '3995adfa-3f08-4399-8ca1-32b91dac08c7'}], 'resource_version': '5020565', 'self_link': '/api/v1/namespaces/ims-wkr7p/pods/sprout-686cc64cfb-jf9h8', 'uid': 'cc71fd7e-1c5c-4395-b612-faf56f3e7e28'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-sprout:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 3, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'sprout', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 ' '5054']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-v6bqj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/sprout', 'mount_propagation': None, 'name': 'sproutlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-v6bqj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup ralf; do echo ' 'waiting for ralf to start ...; ' 'sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-ralf', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-v6bqj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until nslookup chronos; do echo ' 'waiting for chronos to start ...; ' 'sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-chronos', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-v6bqj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until nslookup homestead; do echo ' 'waiting for homestead to start ' '...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-homestead', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-v6bqj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'iruya-worker', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'sproutlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}, {'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-v6bqj', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-v6bqj'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 23, 14, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 23, 22, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 23, 22, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 33, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://0db75ca1e4af3ff55b294453521f3bc2ff0c83ab44ded4151400c4f53df21975', 'image': 'docker.io/ollivier/clearwater-sprout:latest', 'image_id': 'docker.io/ollivier/clearwater-sprout@sha256:861863a8f603b8851858fcb66492d5fa8af26e14ec84a26da5d75fe762b144b2', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'sprout', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 8, 15, 2, 23, 17, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}, {'container_id': 'containerd://a0aa278e4894a23008272d43cfa80f62f701724fc34b77b9b0cbc39bb716574b', 'image': 'docker.io/library/busybox:latest', 'image_id': 'docker.io/library/busybox@sha256:4f47c01fa91355af2865ac10fef5bf6ec9c7f42ad2321377c21e844427972977', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'tailer', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 8, 15, 2, 23, 20, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.5', 'init_container_statuses': [{'container_id': 'containerd://251b6dbf5e45284b69aa1787ee560b98deed2876584f90d81e041918b05f1c29', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-ralf', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://251b6dbf5e45284b69aa1787ee560b98deed2876584f90d81e041918b05f1c29', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 8, 15, 2, 22, 1, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 8, 15, 2, 19, 50, tzinfo=tzlocal())}, 'waiting': None}}, {'container_id': 'containerd://95b1773bbd0b520f11fa53274c3e9a7892d78be4d7464cf169047c13915632bf', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-chronos', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://95b1773bbd0b520f11fa53274c3e9a7892d78be4d7464cf169047c13915632bf', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 8, 15, 2, 22, 5, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 8, 15, 2, 22, 5, tzinfo=tzlocal())}, 'waiting': None}}, {'container_id': 'containerd://97ea51f05425911134d512ac6ed2a422cfb9148ea3d45fbc450f44236f57a88b', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-homestead', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://97ea51f05425911134d512ac6ed2a422cfb9148ea3d45fbc450f44236f57a88b', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 8, 15, 2, 23, 12, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 8, 15, 2, 22, 8, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.1.16', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 8, 15, 2, 19, 39, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'sprout-686cc64cfb-jf9h8', 'generateName': 'sprout-686cc64cfb-', 'namespace': 'ims-wkr7p', 'selfLink': '/api/v1/namespaces/ims-wkr7p/pods/sprout-686cc64cfb-jf9h8', 'uid': 'cc71fd7e-1c5c-4395-b612-faf56f3e7e28', 'resourceVersion': '5020565', 'creationTimestamp': '2020-08-15T02:19:33Z', 'labels': {'pod-template-hash': '686cc64cfb', 'service': 'sprout', 'snmp': 'enabled'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'sprout-686cc64cfb', 'uid': '3995adfa-3f08-4399-8ca1-32b91dac08c7', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'sproutlogs', 'emptyDir': {}}, {'name': 'default-token-v6bqj', 'secret': {'secretName': 'default-token-v6bqj', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-ralf', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup ralf; do echo waiting for ralf to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-v6bqj', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-chronos', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup chronos; do echo waiting for chronos to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-v6bqj', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-homestead', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup homestead; do echo waiting for homestead to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-v6bqj', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'sprout', 'image': 'ollivier/clearwater-sprout:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}, {'name': 'default-token-v6bqj', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 3, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '5052 5054']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/sprout/sprout_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'sproutlogs', 'mountPath': '/var/log/sprout'}, {'name': 'default-token-v6bqj', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:23:14Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:23:22Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:23:22Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:19:33Z'}], 'hostIP': '172.18.0.5', 'podIP': '10.244.1.16', 'startTime': '2020-08-15T02:19:39Z', 'initContainerStatuses': [{'name': 'wait-on-ralf', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-08-15T02:19:50Z', 'finishedAt': '2020-08-15T02:22:01Z', 'containerID': 'containerd://251b6dbf5e45284b69aa1787ee560b98deed2876584f90d81e041918b05f1c29'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://251b6dbf5e45284b69aa1787ee560b98deed2876584f90d81e041918b05f1c29'}, {'name': 'wait-on-chronos', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-08-15T02:22:05Z', 'finishedAt': '2020-08-15T02:22:05Z', 'containerID': 'containerd://95b1773bbd0b520f11fa53274c3e9a7892d78be4d7464cf169047c13915632bf'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://95b1773bbd0b520f11fa53274c3e9a7892d78be4d7464cf169047c13915632bf'}, {'name': 'wait-on-homestead', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-08-15T02:22:08Z', 'finishedAt': '2020-08-15T02:23:12Z', 'containerID': 'containerd://97ea51f05425911134d512ac6ed2a422cfb9148ea3d45fbc450f44236f57a88b'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://97ea51f05425911134d512ac6ed2a422cfb9148ea3d45fbc450f44236f57a88b'}], 'containerStatuses': [{'name': 'sprout', 'state': {'running': {'startedAt': '2020-08-15T02:23:17Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-sprout:latest', 'imageID': 'docker.io/ollivier/clearwater-sprout@sha256:861863a8f603b8851858fcb66492d5fa8af26e14ec84a26da5d75fe762b144b2', 'containerID': 'containerd://0db75ca1e4af3ff55b294453521f3bc2ff0c83ab44ded4151400c4f53df21975'}, {'name': 'tailer', 'state': {'running': {'startedAt': '2020-08-15T02:23:20Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:latest', 'imageID': 'docker.io/library/busybox@sha256:4f47c01fa91355af2865ac10fef5bf6ec9c7f42ad2321377c21e844427972977', 'containerID': 'containerd://a0aa278e4894a23008272d43cfa80f62f701724fc34b77b9b0cbc39bb716574b'}], 'qosClass': 'BestEffort'}}} 2020-08-15 02:23:51,025 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 23, 48, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'live-test', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5020655', 'self_link': '/api/v1/namespaces/ims-wkr7p/pods/live-test', 'uid': '1e1081e7-55ae-4009-9e90-c4562d8809b6'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': ['rake', 'test[ims-wkr7p.svc.cluster.local]', 'PROXY=bono.ims-wkr7p.svc.cluster.local', 'ELLIS=ellis.ims-wkr7p.svc.cluster.local', 'SIGNUP_CODE=secret', '--trace'], 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-v6bqj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Never', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-v6bqj', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-v6bqj'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 23, 48, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': None, 'host_ip': None, 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Pending', 'pod_ip': None, 'qos_class': 'BestEffort', 'reason': None, 'start_time': None}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test', 'namespace': 'ims-wkr7p', 'selfLink': '/api/v1/namespaces/ims-wkr7p/pods/live-test', 'uid': '1e1081e7-55ae-4009-9e90-c4562d8809b6', 'resourceVersion': '5020655', 'creationTimestamp': '2020-08-15T02:23:48Z'}, 'spec': {'volumes': [{'name': 'default-token-v6bqj', 'secret': {'secretName': 'default-token-v6bqj', 'defaultMode': 420}}], 'containers': [{'name': 'live-test', 'image': 'ollivier/clearwater-live-test:latest', 'command': ['rake', 'test[ims-wkr7p.svc.cluster.local]', 'PROXY=bono.ims-wkr7p.svc.cluster.local', 'ELLIS=ellis.ims-wkr7p.svc.cluster.local', 'SIGNUP_CODE=secret', '--trace'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-v6bqj', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Never', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Pending', 'conditions': [{'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:23:48Z'}], 'qosClass': 'BestEffort'}}} 2020-08-15 02:23:51,195 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 31, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'homestead-57586d6cdc-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '57586d6cdc', 'service': 'homestead', 'snmp': 'enabled'}, 'managed_fields': None, 'name': 'homestead-57586d6cdc-4xhxp', 'namespace': 'ims-wkr7p', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'homestead-57586d6cdc', 'uid': 'd93a011d-821c-47b9-ad39-274a4b7eaea9'}], 'resource_version': '5020512', 'self_link': '/api/v1/namespaces/ims-wkr7p/pods/homestead-57586d6cdc-4xhxp', 'uid': '00d4894d-740a-4153-97fb-1cee0cf62edd'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-homestead:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 60, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'name': 'homestead', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 8888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': None, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/homestead', 'mount_propagation': None, 'name': 'homesteadlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-v6bqj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/homestead/homestead_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/homestead', 'mount_propagation': None, 'name': 'homesteadlogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-v6bqj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup cassandra; do echo ' 'waiting for cassandra to start ' '...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-v6bqj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['sh', '-c', 'until nslookup astaire; do echo ' 'waiting for astaire to start ...; ' 'sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-astaire', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-v6bqj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'homesteadlogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}, {'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-v6bqj', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-v6bqj'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 22, 48, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 23, 5, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 23, 5, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 31, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://ee843414cb4913eb39fbb19a4f986e55898af4474400c29cc81d3ea3cbadbf1a', 'image': 'docker.io/ollivier/clearwater-homestead:latest', 'image_id': 'docker.io/ollivier/clearwater-homestead@sha256:98347f9bf0eaf79649590e3fa0ea8d1938ae50d7703e8f9c171f0d74520ac7fb', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'homestead', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 8, 15, 2, 22, 52, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}, {'container_id': 'containerd://f92ae77fa416d927924d5025ae71b6bd40641688c5ff55f6eb5b9b73c6639f05', 'image': 'docker.io/library/busybox:latest', 'image_id': 'docker.io/library/busybox@sha256:4f47c01fa91355af2865ac10fef5bf6ec9c7f42ad2321377c21e844427972977', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'tailer', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 8, 15, 2, 22, 55, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.7', 'init_container_statuses': [{'container_id': 'containerd://6cd8ba7ee60f76eb4673858d7731e30e6df35fca3b2836b62685aafc36545cca', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-cassandra', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://6cd8ba7ee60f76eb4673858d7731e30e6df35fca3b2836b62685aafc36545cca', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 8, 15, 2, 21, 40, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 8, 15, 2, 19, 48, tzinfo=tzlocal())}, 'waiting': None}}, {'container_id': 'containerd://5ae505423d0456b5d762e1e516c504bee136a6abe549a2c91999886176169017', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-astaire', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://5ae505423d0456b5d762e1e516c504bee136a6abe549a2c91999886176169017', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 8, 15, 2, 22, 47, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 8, 15, 2, 21, 46, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.68', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 8, 15, 2, 19, 33, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'homestead-57586d6cdc-4xhxp', 'generateName': 'homestead-57586d6cdc-', 'namespace': 'ims-wkr7p', 'selfLink': '/api/v1/namespaces/ims-wkr7p/pods/homestead-57586d6cdc-4xhxp', 'uid': '00d4894d-740a-4153-97fb-1cee0cf62edd', 'resourceVersion': '5020512', 'creationTimestamp': '2020-08-15T02:19:31Z', 'labels': {'pod-template-hash': '57586d6cdc', 'service': 'homestead', 'snmp': 'enabled'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'homestead-57586d6cdc', 'uid': 'd93a011d-821c-47b9-ad39-274a4b7eaea9', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'homesteadlogs', 'emptyDir': {}}, {'name': 'default-token-v6bqj', 'secret': {'secretName': 'default-token-v6bqj', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-v6bqj', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}, {'name': 'wait-on-astaire', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup astaire; do echo waiting for astaire to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-v6bqj', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'homestead', 'image': 'ollivier/clearwater-homestead:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 8888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'homesteadlogs', 'mountPath': '/var/log/homestead'}, {'name': 'default-token-v6bqj', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'initialDelaySeconds': 60, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'exec': {'command': ['/bin/bash', '/usr/share/kubernetes/liveness.sh', '8888']}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/homestead/homestead_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'homesteadlogs', 'mountPath': '/var/log/homestead'}, {'name': 'default-token-v6bqj', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:22:48Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:23:05Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:23:05Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:19:31Z'}], 'hostIP': '172.18.0.7', 'podIP': '10.244.2.68', 'startTime': '2020-08-15T02:19:33Z', 'initContainerStatuses': [{'name': 'wait-on-cassandra', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-08-15T02:19:48Z', 'finishedAt': '2020-08-15T02:21:40Z', 'containerID': 'containerd://6cd8ba7ee60f76eb4673858d7731e30e6df35fca3b2836b62685aafc36545cca'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://6cd8ba7ee60f76eb4673858d7731e30e6df35fca3b2836b62685aafc36545cca'}, {'name': 'wait-on-astaire', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-08-15T02:21:46Z', 'finishedAt': '2020-08-15T02:22:47Z', 'containerID': 'containerd://5ae505423d0456b5d762e1e516c504bee136a6abe549a2c91999886176169017'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://5ae505423d0456b5d762e1e516c504bee136a6abe549a2c91999886176169017'}], 'containerStatuses': [{'name': 'homestead', 'state': {'running': {'startedAt': '2020-08-15T02:22:52Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-homestead:latest', 'imageID': 'docker.io/ollivier/clearwater-homestead@sha256:98347f9bf0eaf79649590e3fa0ea8d1938ae50d7703e8f9c171f0d74520ac7fb', 'containerID': 'containerd://ee843414cb4913eb39fbb19a4f986e55898af4474400c29cc81d3ea3cbadbf1a'}, {'name': 'tailer', 'state': {'running': {'startedAt': '2020-08-15T02:22:55Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:latest', 'imageID': 'docker.io/library/busybox@sha256:4f47c01fa91355af2865ac10fef5bf6ec9c7f42ad2321377c21e844427972977', 'containerID': 'containerd://f92ae77fa416d927924d5025ae71b6bd40641688c5ff55f6eb5b9b73c6639f05'}], 'qosClass': 'BestEffort'}}} 2020-08-15 02:23:51,635 - functest_kubernetes.ims.ims - DEBUG - {'type': 'ADDED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 19, 33, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'ralf-57c4654cb8-', 'generation': None, 'initializers': None, 'labels': {'pod-template-hash': '57c4654cb8', 'service': 'ralf', 'snmp': 'enabled'}, 'managed_fields': None, 'name': 'ralf-57c4654cb8-jht4z', 'namespace': 'ims-wkr7p', 'owner_references': [{'api_version': 'apps/v1', 'block_owner_deletion': True, 'controller': True, 'kind': 'ReplicaSet', 'name': 'ralf-57c4654cb8', 'uid': 'f14969be-4ba7-4faa-a465-53f2d6391dd4'}], 'resource_version': '5020348', 'self_link': '/api/v1/namespaces/ims-wkr7p/pods/ralf-57c4654cb8-jht4z', 'uid': '1ecbf1b0-e399-4156-8d09-1f035f280704'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': None, 'env': [{'name': 'MY_POD_IP', 'value': None, 'value_from': {'config_map_key_ref': None, 'field_ref': {'api_version': 'v1', 'field_path': 'status.podIP'}, 'resource_field_ref': None, 'secret_key_ref': None}}], 'env_from': [{'config_map_ref': {'name': 'env-vars', 'optional': None}, 'prefix': None, 'secret_ref': None}], 'image': 'ollivier/clearwater-ralf:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': 30, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'name': 'ralf', 'ports': [{'container_port': 22, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}, {'container_port': 10888, 'host_ip': None, 'host_port': None, 'name': None, 'protocol': 'TCP'}], 'readiness_probe': {'_exec': None, 'failure_threshold': 3, 'http_get': None, 'initial_delay_seconds': None, 'period_seconds': 10, 'success_threshold': 1, 'tcp_socket': {'host': None, 'port': 10888}, 'timeout_seconds': 1}, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-v6bqj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}, {'args': None, 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'env': None, 'env_from': None, 'image': 'busybox', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'tailer', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/log/ralf', 'mount_propagation': None, 'name': 'ralflogs', 'read_only': None, 'sub_path': None, 'sub_path_expr': None}, {'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-v6bqj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': [{'name': None}], 'init_containers': [{'args': None, 'command': ['sh', '-c', 'until nslookup cassandra; do echo ' 'waiting for cassandra to start ' '...; sleep 2; done'], 'env': None, 'env_from': None, 'image': 'busybox:1.28', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'wait-on-cassandra', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-v6bqj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Always', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': {'medium': None, 'size_limit': None}, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'ralflogs', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': None, 'storageos': None, 'vsphere_volume': None}, {'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-v6bqj', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-v6bqj'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 21, 41, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 22, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 22, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 19, 33, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://4b1ff46111f18a9d611c2bfd8a51a430ef58f1259bec936cd0b9fdbbb6c991ea', 'image': 'docker.io/ollivier/clearwater-ralf:latest', 'image_id': 'docker.io/ollivier/clearwater-ralf@sha256:adfa3978f2c94734010c014a2be7db9bc328419e0a205904543a86cd0719bd1a', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'ralf', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 8, 15, 2, 21, 48, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}, {'container_id': 'containerd://ae79981fc206d955331c6204bfeca9b13e5fac3c02098e80fa61a18aefa35682', 'image': 'docker.io/library/busybox:latest', 'image_id': 'docker.io/library/busybox@sha256:4f47c01fa91355af2865ac10fef5bf6ec9c7f42ad2321377c21e844427972977', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'tailer', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 8, 15, 2, 21, 53, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.7', 'init_container_statuses': [{'container_id': 'containerd://d8b3e16a993a3cd56d77d5f34c6ec94c5d8f0d210fc0e337c9dee11e27c3a49f', 'image': 'docker.io/library/busybox:1.28', 'image_id': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'wait-on-cassandra', 'ready': True, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://d8b3e16a993a3cd56d77d5f34c6ec94c5d8f0d210fc0e337c9dee11e27c3a49f', 'exit_code': 0, 'finished_at': datetime.datetime(2020, 8, 15, 2, 21, 40, tzinfo=tzlocal()), 'message': None, 'reason': 'Completed', 'signal': None, 'started_at': datetime.datetime(2020, 8, 15, 2, 19, 47, tzinfo=tzlocal())}, 'waiting': None}}], 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.69', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 8, 15, 2, 19, 35, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'ralf-57c4654cb8-jht4z', 'generateName': 'ralf-57c4654cb8-', 'namespace': 'ims-wkr7p', 'selfLink': '/api/v1/namespaces/ims-wkr7p/pods/ralf-57c4654cb8-jht4z', 'uid': '1ecbf1b0-e399-4156-8d09-1f035f280704', 'resourceVersion': '5020348', 'creationTimestamp': '2020-08-15T02:19:33Z', 'labels': {'pod-template-hash': '57c4654cb8', 'service': 'ralf', 'snmp': 'enabled'}, 'ownerReferences': [{'apiVersion': 'apps/v1', 'kind': 'ReplicaSet', 'name': 'ralf-57c4654cb8', 'uid': 'f14969be-4ba7-4faa-a465-53f2d6391dd4', 'controller': True, 'blockOwnerDeletion': True}]}, 'spec': {'volumes': [{'name': 'ralflogs', 'emptyDir': {}}, {'name': 'default-token-v6bqj', 'secret': {'secretName': 'default-token-v6bqj', 'defaultMode': 420}}], 'initContainers': [{'name': 'wait-on-cassandra', 'image': 'busybox:1.28', 'command': ['sh', '-c', 'until nslookup cassandra; do echo waiting for cassandra to start ...; sleep 2; done'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-v6bqj', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'IfNotPresent'}], 'containers': [{'name': 'ralf', 'image': 'ollivier/clearwater-ralf:latest', 'ports': [{'containerPort': 22, 'protocol': 'TCP'}, {'containerPort': 10888, 'protocol': 'TCP'}], 'envFrom': [{'configMapRef': {'name': 'env-vars'}}], 'env': [{'name': 'MY_POD_IP', 'valueFrom': {'fieldRef': {'apiVersion': 'v1', 'fieldPath': 'status.podIP'}}}], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}, {'name': 'default-token-v6bqj', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'livenessProbe': {'tcpSocket': {'port': 10888}, 'initialDelaySeconds': 30, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'readinessProbe': {'tcpSocket': {'port': 10888}, 'timeoutSeconds': 1, 'periodSeconds': 10, 'successThreshold': 1, 'failureThreshold': 3}, 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}, {'name': 'tailer', 'image': 'busybox', 'command': ['tail', '-F', '/var/log/ralf/ralf_current.txt'], 'resources': {}, 'volumeMounts': [{'name': 'ralflogs', 'mountPath': '/var/log/ralf'}, {'name': 'default-token-v6bqj', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Always', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'imagePullSecrets': [{}], 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:21:41Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:22:00Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:22:00Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:19:33Z'}], 'hostIP': '172.18.0.7', 'podIP': '10.244.2.69', 'startTime': '2020-08-15T02:19:35Z', 'initContainerStatuses': [{'name': 'wait-on-cassandra', 'state': {'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': '2020-08-15T02:19:47Z', 'finishedAt': '2020-08-15T02:21:40Z', 'containerID': 'containerd://d8b3e16a993a3cd56d77d5f34c6ec94c5d8f0d210fc0e337c9dee11e27c3a49f'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:1.28', 'imageID': 'docker.io/library/busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47', 'containerID': 'containerd://d8b3e16a993a3cd56d77d5f34c6ec94c5d8f0d210fc0e337c9dee11e27c3a49f'}], 'containerStatuses': [{'name': 'ralf', 'state': {'running': {'startedAt': '2020-08-15T02:21:48Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-ralf:latest', 'imageID': 'docker.io/ollivier/clearwater-ralf@sha256:adfa3978f2c94734010c014a2be7db9bc328419e0a205904543a86cd0719bd1a', 'containerID': 'containerd://4b1ff46111f18a9d611c2bfd8a51a430ef58f1259bec936cd0b9fdbbb6c991ea'}, {'name': 'tailer', 'state': {'running': {'startedAt': '2020-08-15T02:21:53Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/library/busybox:latest', 'imageID': 'docker.io/library/busybox@sha256:4f47c01fa91355af2865ac10fef5bf6ec9c7f42ad2321377c21e844427972977', 'containerID': 'containerd://ae79981fc206d955331c6204bfeca9b13e5fac3c02098e80fa61a18aefa35682'}], 'qosClass': 'BestEffort'}}} 2020-08-15 02:23:51,926 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 23, 48, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'live-test', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5020657', 'self_link': '/api/v1/namespaces/ims-wkr7p/pods/live-test', 'uid': '1e1081e7-55ae-4009-9e90-c4562d8809b6'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': ['rake', 'test[ims-wkr7p.svc.cluster.local]', 'PROXY=bono.ims-wkr7p.svc.cluster.local', 'ELLIS=ellis.ims-wkr7p.svc.cluster.local', 'SIGNUP_CODE=secret', '--trace'], 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-v6bqj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Never', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-v6bqj', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-v6bqj'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 23, 48, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 23, 48, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 23, 48, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 23, 48, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_id': '', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'live-test', 'ready': False, 'restart_count': 0, 'state': {'running': None, 'terminated': None, 'waiting': {'message': None, 'reason': 'ContainerCreating'}}}], 'host_ip': '172.18.0.7', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Pending', 'pod_ip': None, 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 8, 15, 2, 23, 48, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test', 'namespace': 'ims-wkr7p', 'selfLink': '/api/v1/namespaces/ims-wkr7p/pods/live-test', 'uid': '1e1081e7-55ae-4009-9e90-c4562d8809b6', 'resourceVersion': '5020657', 'creationTimestamp': '2020-08-15T02:23:48Z'}, 'spec': {'volumes': [{'name': 'default-token-v6bqj', 'secret': {'secretName': 'default-token-v6bqj', 'defaultMode': 420}}], 'containers': [{'name': 'live-test', 'image': 'ollivier/clearwater-live-test:latest', 'command': ['rake', 'test[ims-wkr7p.svc.cluster.local]', 'PROXY=bono.ims-wkr7p.svc.cluster.local', 'ELLIS=ellis.ims-wkr7p.svc.cluster.local', 'SIGNUP_CODE=secret', '--trace'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-v6bqj', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Never', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Pending', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:23:48Z'}, {'type': 'Ready', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:23:48Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test]'}, {'type': 'ContainersReady', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:23:48Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test]'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:23:48Z'}], 'hostIP': '172.18.0.7', 'startTime': '2020-08-15T02:23:48Z', 'containerStatuses': [{'name': 'live-test', 'state': {'waiting': {'reason': 'ContainerCreating'}}, 'lastState': {}, 'ready': False, 'restartCount': 0, 'image': 'ollivier/clearwater-live-test:latest', 'imageID': ''}], 'qosClass': 'BestEffort'}}} 2020-08-15 02:23:53,110 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 23, 48, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'live-test', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5020670', 'self_link': '/api/v1/namespaces/ims-wkr7p/pods/live-test', 'uid': '1e1081e7-55ae-4009-9e90-c4562d8809b6'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': ['rake', 'test[ims-wkr7p.svc.cluster.local]', 'PROXY=bono.ims-wkr7p.svc.cluster.local', 'ELLIS=ellis.ims-wkr7p.svc.cluster.local', 'SIGNUP_CODE=secret', '--trace'], 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-v6bqj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Never', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-v6bqj', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-v6bqj'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 23, 48, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 23, 53, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 23, 53, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 23, 48, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://625ab4f88f6a6f407f3b9168cad0cb6eb1b59e56f6379f3dc0f62bf6c5ef956f', 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'image_id': 'docker.io/ollivier/clearwater-live-test@sha256:77e928c23a5942aa681646be96dfb5897efe17b1e8676e8e94003ad08891b881', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'live-test', 'ready': True, 'restart_count': 0, 'state': {'running': {'started_at': datetime.datetime(2020, 8, 15, 2, 23, 52, tzinfo=tzlocal())}, 'terminated': None, 'waiting': None}}], 'host_ip': '172.18.0.7', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Running', 'pod_ip': '10.244.2.70', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 8, 15, 2, 23, 48, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test', 'namespace': 'ims-wkr7p', 'selfLink': '/api/v1/namespaces/ims-wkr7p/pods/live-test', 'uid': '1e1081e7-55ae-4009-9e90-c4562d8809b6', 'resourceVersion': '5020670', 'creationTimestamp': '2020-08-15T02:23:48Z'}, 'spec': {'volumes': [{'name': 'default-token-v6bqj', 'secret': {'secretName': 'default-token-v6bqj', 'defaultMode': 420}}], 'containers': [{'name': 'live-test', 'image': 'ollivier/clearwater-live-test:latest', 'command': ['rake', 'test[ims-wkr7p.svc.cluster.local]', 'PROXY=bono.ims-wkr7p.svc.cluster.local', 'ELLIS=ellis.ims-wkr7p.svc.cluster.local', 'SIGNUP_CODE=secret', '--trace'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-v6bqj', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Never', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Running', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:23:48Z'}, {'type': 'Ready', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:23:53Z'}, {'type': 'ContainersReady', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:23:53Z'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:23:48Z'}], 'hostIP': '172.18.0.7', 'podIP': '10.244.2.70', 'startTime': '2020-08-15T02:23:48Z', 'containerStatuses': [{'name': 'live-test', 'state': {'running': {'startedAt': '2020-08-15T02:23:52Z'}}, 'lastState': {}, 'ready': True, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'imageID': 'docker.io/ollivier/clearwater-live-test@sha256:77e928c23a5942aa681646be96dfb5897efe17b1e8676e8e94003ad08891b881', 'containerID': 'containerd://625ab4f88f6a6f407f3b9168cad0cb6eb1b59e56f6379f3dc0f62bf6c5ef956f'}], 'qosClass': 'BestEffort'}}} 2020-08-15 02:23:55,121 - functest_kubernetes.ims.ims - DEBUG - {'type': 'MODIFIED', 'object': {'api_version': 'v1', 'kind': 'Pod', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 8, 15, 2, 23, 48, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': None, 'name': 'live-test', 'namespace': 'ims-wkr7p', 'owner_references': None, 'resource_version': '5020675', 'self_link': '/api/v1/namespaces/ims-wkr7p/pods/live-test', 'uid': '1e1081e7-55ae-4009-9e90-c4562d8809b6'}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': None, 'command': ['rake', 'test[ims-wkr7p.svc.cluster.local]', 'PROXY=bono.ims-wkr7p.svc.cluster.local', 'ELLIS=ellis.ims-wkr7p.svc.cluster.local', 'SIGNUP_CODE=secret', '--trace'], 'env': None, 'env_from': None, 'image': 'ollivier/clearwater-live-test:latest', 'image_pull_policy': 'Always', 'lifecycle': None, 'liveness_probe': None, 'name': 'live-test', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount', 'mount_propagation': None, 'name': 'default-token-v6bqj', 'read_only': True, 'sub_path': None, 'sub_path_expr': None}], 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': True, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': 'iruya-worker2', 'node_selector': None, 'priority': 0, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Never', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None}, 'service_account': 'default', 'service_account_name': 'default', 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': [{'effect': 'NoExecute', 'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}, {'effect': 'NoExecute', 'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'toleration_seconds': 300, 'value': None}], 'volumes': [{'aws_elastic_block_store': None, 'azure_disk': None, 'azure_file': None, 'cephfs': None, 'cinder': None, 'config_map': None, 'csi': None, 'downward_api': None, 'empty_dir': None, 'fc': None, 'flex_volume': None, 'flocker': None, 'gce_persistent_disk': None, 'git_repo': None, 'glusterfs': None, 'host_path': None, 'iscsi': None, 'name': 'default-token-v6bqj', 'nfs': None, 'persistent_volume_claim': None, 'photon_persistent_disk': None, 'portworx_volume': None, 'projected': None, 'quobyte': None, 'rbd': None, 'scale_io': None, 'secret': {'default_mode': 420, 'items': None, 'optional': None, 'secret_name': 'default-token-v6bqj'}, 'storageos': None, 'vsphere_volume': None}]}, 'status': {'conditions': [{'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 23, 48, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'Initialized'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 23, 55, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'Ready'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 23, 55, tzinfo=tzlocal()), 'message': 'containers with unready status: ' '[live-test]', 'reason': 'ContainersNotReady', 'status': 'False', 'type': 'ContainersReady'}, {'last_probe_time': None, 'last_transition_time': datetime.datetime(2020, 8, 15, 2, 23, 48, tzinfo=tzlocal()), 'message': None, 'reason': None, 'status': 'True', 'type': 'PodScheduled'}], 'container_statuses': [{'container_id': 'containerd://625ab4f88f6a6f407f3b9168cad0cb6eb1b59e56f6379f3dc0f62bf6c5ef956f', 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'image_id': 'docker.io/ollivier/clearwater-live-test@sha256:77e928c23a5942aa681646be96dfb5897efe17b1e8676e8e94003ad08891b881', 'last_state': {'running': None, 'terminated': None, 'waiting': None}, 'name': 'live-test', 'ready': False, 'restart_count': 0, 'state': {'running': None, 'terminated': {'container_id': 'containerd://625ab4f88f6a6f407f3b9168cad0cb6eb1b59e56f6379f3dc0f62bf6c5ef956f', 'exit_code': 1, 'finished_at': datetime.datetime(2020, 8, 15, 2, 23, 54, tzinfo=tzlocal()), 'message': None, 'reason': 'Error', 'signal': None, 'started_at': datetime.datetime(2020, 8, 15, 2, 23, 52, tzinfo=tzlocal())}, 'waiting': None}}], 'host_ip': '172.18.0.7', 'init_container_statuses': None, 'message': None, 'nominated_node_name': None, 'phase': 'Failed', 'pod_ip': '10.244.2.70', 'qos_class': 'BestEffort', 'reason': None, 'start_time': datetime.datetime(2020, 8, 15, 2, 23, 48, tzinfo=tzlocal())}}, 'raw_object': {'kind': 'Pod', 'apiVersion': 'v1', 'metadata': {'name': 'live-test', 'namespace': 'ims-wkr7p', 'selfLink': '/api/v1/namespaces/ims-wkr7p/pods/live-test', 'uid': '1e1081e7-55ae-4009-9e90-c4562d8809b6', 'resourceVersion': '5020675', 'creationTimestamp': '2020-08-15T02:23:48Z'}, 'spec': {'volumes': [{'name': 'default-token-v6bqj', 'secret': {'secretName': 'default-token-v6bqj', 'defaultMode': 420}}], 'containers': [{'name': 'live-test', 'image': 'ollivier/clearwater-live-test:latest', 'command': ['rake', 'test[ims-wkr7p.svc.cluster.local]', 'PROXY=bono.ims-wkr7p.svc.cluster.local', 'ELLIS=ellis.ims-wkr7p.svc.cluster.local', 'SIGNUP_CODE=secret', '--trace'], 'resources': {}, 'volumeMounts': [{'name': 'default-token-v6bqj', 'readOnly': True, 'mountPath': '/var/run/secrets/kubernetes.io/serviceaccount'}], 'terminationMessagePath': '/dev/termination-log', 'terminationMessagePolicy': 'File', 'imagePullPolicy': 'Always'}], 'restartPolicy': 'Never', 'terminationGracePeriodSeconds': 30, 'dnsPolicy': 'ClusterFirst', 'serviceAccountName': 'default', 'serviceAccount': 'default', 'nodeName': 'iruya-worker2', 'securityContext': {}, 'schedulerName': 'default-scheduler', 'tolerations': [{'key': 'node.kubernetes.io/not-ready', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}, {'key': 'node.kubernetes.io/unreachable', 'operator': 'Exists', 'effect': 'NoExecute', 'tolerationSeconds': 300}], 'priority': 0, 'enableServiceLinks': True}, 'status': {'phase': 'Failed', 'conditions': [{'type': 'Initialized', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:23:48Z'}, {'type': 'Ready', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:23:55Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test]'}, {'type': 'ContainersReady', 'status': 'False', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:23:55Z', 'reason': 'ContainersNotReady', 'message': 'containers with unready status: [live-test]'}, {'type': 'PodScheduled', 'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': '2020-08-15T02:23:48Z'}], 'hostIP': '172.18.0.7', 'podIP': '10.244.2.70', 'startTime': '2020-08-15T02:23:48Z', 'containerStatuses': [{'name': 'live-test', 'state': {'terminated': {'exitCode': 1, 'reason': 'Error', 'startedAt': '2020-08-15T02:23:52Z', 'finishedAt': '2020-08-15T02:23:54Z', 'containerID': 'containerd://625ab4f88f6a6f407f3b9168cad0cb6eb1b59e56f6379f3dc0f62bf6c5ef956f'}}, 'lastState': {}, 'ready': False, 'restartCount': 0, 'image': 'docker.io/ollivier/clearwater-live-test:latest', 'imageID': 'docker.io/ollivier/clearwater-live-test@sha256:77e928c23a5942aa681646be96dfb5897efe17b1e8676e8e94003ad08891b881', 'containerID': 'containerd://625ab4f88f6a6f407f3b9168cad0cb6eb1b59e56f6379f3dc0f62bf6c5ef956f'}], 'qosClass': 'BestEffort'}}} 2020-08-15 02:23:55,375 - functest_kubernetes.ims.ims - INFO - ** Invoke test (first_time) ** Execute test /usr/lib/ruby/gems/2.6.0/gems/httpi-2.4.0/lib/httpi/auth/ssl.rb:13: warning: constant OpenSSL::SSL::SSLContext::METHODS is deprecated Basic Call - Mainline (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/basic-call.rb:19:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Basic Call - SDP (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/basic-call.rb:82:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Basic Call - Tel URIs (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/basic-call.rb:137:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Basic Call - Unknown number (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/basic-call.rb:178:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Basic Call - Rejected by remote endpoint (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/basic-call.rb:202:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Basic Call - Messages - Pager model (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/basic-call.rb:237:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Basic Call - Pracks (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/basic-call.rb:267:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Basic Registration (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/basic-register.rb:11:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Emergency Registration (TCP) - Skipped (Not running with emergency registrations) - Call with EMERGENCY_REG=Y to run test Multiple Identities (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/basic-register.rb:65:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Call Barring - Outbound Rejection (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/call-barring.rb:13:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Call Barring - Allow non-international call (TCP) - Skipped (No PSTN support) - Call with PSTN=true to run test Call Barring - Reject international call (TCP) - Skipped (No PSTN support) - Call with PSTN=true to run test Call Barring - Inbound Rejection (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/call-barring.rb:130:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Call Diversion AS - Unconditional (TCP) - Skipped (No Call Diversion AS hostname provided) - Call with CDIV_AS= Call Diversion AS - Busy (TCP) - Skipped (No Call Diversion AS hostname provided) - Call with CDIV_AS= Call Diversion AS - No answer (TCP) - Skipped (No Call Diversion AS hostname provided) - Call with CDIV_AS= Call Diversion - Not registered (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/call-diversion.rb:80:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Call Diversion - Not reachable (not registered) (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/call-diversion.rb:101:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Call Diversion - Not reachable (408) (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/call-diversion.rb:124:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Call Diversion - Not reachable (503) (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/call-diversion.rb:159:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Call Diversion - Not reachable (500) (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/call-diversion.rb:193:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Call Diversion - Busy (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/call-diversion.rb:227:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Call Diversion - Unconditional (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/call-diversion.rb:258:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Call Diversion - No answer (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/call-diversion.rb:289:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Call Diversion - Bad target URI (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/call-diversion.rb:355:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Call Diversion - Audio-only call (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/call-diversion.rb:384:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Call Diversion - Audio-video call (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/call-diversion.rb:418:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Call Forking - Mainline (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/call-forking.rb:13:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Call Forking - Endpoint offline (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/call-forking.rb:108:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Call Forking - Endpoint offline while ringing (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/call-forking.rb:183:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Call Waiting - Accepted (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/call-waiting.rb:13:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Call Waiting - Cancelled (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/call-waiting.rb:123:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' CANCEL - Mainline (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/cancel.rb:13:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Filtering - Accept-Contact (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/contact-filtering.rb:12:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Accept-Contact with response (SFR 511195) (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/contact-filtering.rb:44:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Filtering - Accept-Contact no match (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/contact-filtering.rb:91:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Filtering - Accept-Contact negated match (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/contact-filtering.rb:118:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Filtering - RFC3841 example (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/contact-filtering.rb:152:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Filtering - Reject-Contact no match (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/contact-filtering.rb:236:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Filtering - Reject-Contact match (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/contact-filtering.rb:269:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Gemini - INVITE - VoIP device answers (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Mobile device answers (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - VoIP device rejects (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Mobile device rejects (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Mobile device rejects with a 480 (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Both reject, choose mobile response (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Both reject, choose VoIP response (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Successful call with GR (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Failed call with GR (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Successful call with Accept-Contact (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - INVITE - Failed call with Accept-Contact (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - SUBSCRIBE - Mobile Notifies (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= Gemini - SUBSCRIBE - Joint 408 (TCP) - Skipped (No gemini hostname provided) - Call with GEMINI= GRUU - REGISTER - two bindings with and without GRUU (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/gruu.rb:29:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' GRUU - REGISTER - binding suggested GRUU (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/gruu.rb:48:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' GRUU - REGISTER - instance ID requires escaping (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/gruu.rb:69:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' GRUU - REGISTER - three bindings with GRUUs (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/gruu.rb:84:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' GRUU - Call - first endpoint GRUU as target (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/gruu.rb:106:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' GRUU - Call - second endpoint GRUU as target (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/gruu.rb:142:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' GRUU - Call - only GRUU as target (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/gruu.rb:178:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' GRUU - Call - AoR as target (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/gruu.rb:214:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' GRUU - Call - unknown GRUU as target (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/gruu.rb:250:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' GRUU - Call - unknown GRUU as target - no GRUUs assigned (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/gruu.rb:278:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' GRUU - Call - Reject-Contact interop (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/gruu.rb:306:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' GRUU - Call - Accept-Contact interop (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/gruu.rb:336:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' GRUU - Call - AoR with other param as target (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/gruu.rb:375:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' GRUU - Call - GRUU with other param as target (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/gruu.rb:411:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' ISC Interface - Terminating (TCP) - Skipped (No hostname given) - Call with HOST_NAME= ISC Interface - Terminating (UDP AS) (TCP) - Skipped (No hostname given) - Call with HOST_NAME= ISC Interface - Terminating Failed (TCP) - Skipped (No hostname given) - Call with HOST_NAME= ISC Interface - Third-party Registration (TCP) - Skipped (No hostname given) - Call with HOST_NAME= ISC Interface - Third-party Registration - implicit registration (TCP) - Skipped (No hostname given) - Call with HOST_NAME= ISC Interface - Redirect (TCP) - Skipped (No hostname given) - Call with HOST_NAME= ISC Interface - B2BUA (TCP) - Skipped (No hostname given) - Call with HOST_NAME= Live Call - Dial out to a real number (TCP) - Skipped (No live number given) - Call with LIVENUMBER= Memento - Incorrect Password (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Wrong Call List (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Basic Call (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Unknown Number (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Rejected Call (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Cancelled Call (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Privacy Call (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Barred Call (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Memento - Busy Call Forwarding (TCP) - Skipped (No memento hostnames provided) - Call with MEMENTO_SIP= and MEMENTO_HTTP= Nonce-Count - Mainline (TCP) - Skipped (No nonce-count support) - Call with NONCE_COUNT=Y to run test Nonce-Count - Reject Re-Use (TCP) - Skipped (No nonce-count support) - Call with NONCE_COUNT=Y to run test Off-net calls - tel: URI (TCP) - Skipped (No off-net number given) - Call with OFF_NET_TEL= Off-net calls - sip: URI (TCP) - Skipped (No off-net number given) - Call with OFF_NET_TEL= SUBSCRIBE - reg-event (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/subscribe.rb:24:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' SUBSCRIBE - reg-event with a GRUU (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/subscribe.rb:75:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' SUBSCRIBE - Subscription timeout (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/subscribe.rb:112:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' SUBSCRIBE - Registration timeout (TCP) - Skipped (Not running with short registrations) - Call with SHORT_REG=Y to run test Multiple SUBSCRIBErs to one UE's reg-event (TCP) - Failed RuntimeError thrown: - Account creation failed with HTTP code 503, body {"status": 503, "message": "Service Unavailable", "reason": "No available numbers", "detail": {}, "error": true} - /src/vims-test/lib/ellis.rb:193:in `rescue in get_number' - /src/vims-test/lib/ellis.rb:187:in `get_number' - /src/vims-test/lib/ellis.rb:71:in `initialize' - /src/vims-test/lib/test-definition.rb:354:in `new' - /src/vims-test/lib/test-definition.rb:354:in `provision_line' - /src/vims-test/lib/test-definition.rb:181:in `add_endpoint' - /src/vims-test/lib/tests/subscribe.rb:228:in `block in ' - /src/vims-test/lib/test-definition.rb:256:in `run' - /src/vims-test/lib/test-definition.rb:126:in `block (2 levels) in run_all' - /src/vims-test/lib/test-definition.rb:112:in `collect' - /src/vims-test/lib/test-definition.rb:112:in `block in run_all' - /src/vims-test/lib/test-definition.rb:111:in `each' - /src/vims-test/lib/test-definition.rb:111:in `run_all' - /src/vims-test/lib/live-test.rb:23:in `run_tests' - /src/vims-test/Rakefile:18:in `block in ' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:240:in `block in execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:235:in `execute' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:179:in `block in invoke_with_call_chain' - /usr/lib/ruby/2.6.0/monitor.rb:235:in `mon_synchronize' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:172:in `invoke_with_call_chain' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/task.rb:165:in `invoke' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:150:in `invoke_task' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block (2 levels) in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `each' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:106:in `block in top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:115:in `run_with_threads' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:100:in `top_level' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:78:in `block in run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:176:in `standard_exception_handling' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/lib/rake/application.rb:75:in `run' - /usr/lib/ruby/gems/2.6.0/gems/rake-10.4.2/bin/rake:33:in `' - /usr/bin/rake:23:in `load' - /usr/bin/rake:23:in `
' Message - URN URIs (TCP) - Skipped (No hostname given) - Call with HOST_NAME= Message - URN URIs to AS (TCP) - Skipped (No hostname given) - Call with HOST_NAME= 53 failures out of 96 tests run Basic Call - Mainline (TCP) at 2020-08-15 02:23:53 +0000 Basic Call - SDP (TCP) at 2020-08-15 02:23:53 +0000 Basic Call - Tel URIs (TCP) at 2020-08-15 02:23:53 +0000 Basic Call - Unknown number (TCP) at 2020-08-15 02:23:53 +0000 Basic Call - Rejected by remote endpoint (TCP) at 2020-08-15 02:23:53 +0000 Basic Call - Messages - Pager model (TCP) at 2020-08-15 02:23:53 +0000 Basic Call - Pracks (TCP) at 2020-08-15 02:23:53 +0000 Basic Registration (TCP) at 2020-08-15 02:23:53 +0000 Multiple Identities (TCP) at 2020-08-15 02:23:53 +0000 Call Barring - Outbound Rejection (TCP) at 2020-08-15 02:23:53 +0000 Call Barring - Inbound Rejection (TCP) at 2020-08-15 02:23:53 +0000 Call Diversion - Not registered (TCP) at 2020-08-15 02:23:53 +0000 Call Diversion - Not reachable (not registered) (TCP) at 2020-08-15 02:23:53 +0000 Call Diversion - Not reachable (408) (TCP) at 2020-08-15 02:23:53 +0000 Call Diversion - Not reachable (503) (TCP) at 2020-08-15 02:23:53 +0000 Call Diversion - Not reachable (500) (TCP) at 2020-08-15 02:23:53 +0000 Call Diversion - Busy (TCP) at 2020-08-15 02:23:53 +0000 Call Diversion - Unconditional (TCP) at 2020-08-15 02:23:53 +0000 Call Diversion - No answer (TCP) at 2020-08-15 02:23:53 +0000 Call Diversion - Bad target URI (TCP) at 2020-08-15 02:23:53 +0000 Call Diversion - Audio-only call (TCP) at 2020-08-15 02:23:53 +0000 Call Diversion - Audio-video call (TCP) at 2020-08-15 02:23:53 +0000 Call Forking - Mainline (TCP) at 2020-08-15 02:23:53 +0000 Call Forking - Endpoint offline (TCP) at 2020-08-15 02:23:53 +0000 Call Forking - Endpoint offline while ringing (TCP) at 2020-08-15 02:23:53 +0000 Call Waiting - Accepted (TCP) at 2020-08-15 02:23:53 +0000 Call Waiting - Cancelled (TCP) at 2020-08-15 02:23:53 +0000 CANCEL - Mainline (TCP) at 2020-08-15 02:23:53 +0000 Filtering - Accept-Contact (TCP) at 2020-08-15 02:23:53 +0000 Accept-Contact with response (SFR 511195) (TCP) at 2020-08-15 02:23:53 +0000 Filtering - Accept-Contact no match (TCP) at 2020-08-15 02:23:53 +0000 Filtering - Accept-Contact negated match (TCP) at 2020-08-15 02:23:53 +0000 Filtering - RFC3841 example (TCP) at 2020-08-15 02:23:53 +0000 Filtering - Reject-Contact no match (TCP) at 2020-08-15 02:23:53 +0000 Filtering - Reject-Contact match (TCP) at 2020-08-15 02:23:53 +0000 GRUU - REGISTER - two bindings with and without GRUU (TCP) at 2020-08-15 02:23:53 +0000 GRUU - REGISTER - binding suggested GRUU (TCP) at 2020-08-15 02:23:53 +0000 GRUU - REGISTER - instance ID requires escaping (TCP) at 2020-08-15 02:23:53 +0000 GRUU - REGISTER - three bindings with GRUUs (TCP) at 2020-08-15 02:23:53 +0000 GRUU - Call - first endpoint GRUU as target (TCP) at 2020-08-15 02:23:53 +0000 GRUU - Call - second endpoint GRUU as target (TCP) at 2020-08-15 02:23:53 +0000 GRUU - Call - only GRUU as target (TCP) at 2020-08-15 02:23:53 +0000 GRUU - Call - AoR as target (TCP) at 2020-08-15 02:23:53 +0000 GRUU - Call - unknown GRUU as target (TCP) at 2020-08-15 02:23:53 +0000 GRUU - Call - unknown GRUU as target - no GRUUs assigned (TCP) at 2020-08-15 02:23:53 +0000 GRUU - Call - Reject-Contact interop (TCP) at 2020-08-15 02:23:53 +0000 GRUU - Call - Accept-Contact interop (TCP) at 2020-08-15 02:23:53 +0000 GRUU - Call - AoR with other param as target (TCP) at 2020-08-15 02:23:53 +0000 GRUU - Call - GRUU with other param as target (TCP) at 2020-08-15 02:23:53 +0000 SUBSCRIBE - reg-event (TCP) at 2020-08-15 02:23:53 +0000 SUBSCRIBE - reg-event with a GRUU (TCP) at 2020-08-15 02:23:53 +0000 SUBSCRIBE - Subscription timeout (TCP) at 2020-08-15 02:23:53 +0000 Multiple SUBSCRIBErs to one UE's reg-event (TCP) at 2020-08-15 02:23:53 +0000 43 tests skipped Error logs, including Call-IDs of failed calls, are in the 'logfiles' directory 2020-08-15 02:23:55,409 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | k8s_vims | functest | 04:28 | FAIL | +-------------------+------------------+------------------+----------------+ 2020-08-15 02:23:55,490 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_config_map: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'configmaps', 'name': 'env-vars', 'retry_after_seconds': None, 'uid': '149f32ce-cace-4ab8-8d31-aeaa9fe7c7a4'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-08-15 02:23:55,644 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_pod: {'api_version': 'v1', 'code': None, 'details': None, 'kind': 'Pod', 'message': None, 'metadata': {'_continue': None, 'resource_version': '5020678', 'self_link': '/api/v1/namespaces/ims-wkr7p/pods/live-test'}, 'reason': None, 'status': "{'phase': 'Failed', 'conditions': [{'type': 'Initialized', " "'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': " "'2020-08-15T02:23:48Z'}, {'type': 'Ready', 'status': 'False', " "'lastProbeTime': None, 'lastTransitionTime': " "'2020-08-15T02:23:55Z', 'reason': 'ContainersNotReady', 'message': " "'containers with unready status: [live-test]'}, {'type': " "'ContainersReady', 'status': 'False', 'lastProbeTime': None, " "'lastTransitionTime': '2020-08-15T02:23:55Z', 'reason': " "'ContainersNotReady', 'message': 'containers with unready status: " "[live-test]'}, {'type': 'PodScheduled', 'status': 'True', " "'lastProbeTime': None, 'lastTransitionTime': " "'2020-08-15T02:23:48Z'}], 'hostIP': '172.18.0.7', 'podIP': " "'10.244.2.70', 'startTime': '2020-08-15T02:23:48Z', " "'containerStatuses': [{'name': 'live-test', 'state': " "{'terminated': {'exitCode': 1, 'reason': 'Error', 'startedAt': " "'2020-08-15T02:23:52Z', 'finishedAt': '2020-08-15T02:23:54Z', " "'containerID': " "'containerd://625ab4f88f6a6f407f3b9168cad0cb6eb1b59e56f6379f3dc0f62bf6c5ef956f'}}, " "'lastState': {}, 'ready': False, 'restartCount': 0, 'image': " "'docker.io/ollivier/clearwater-live-test:latest', 'imageID': " "'docker.io/ollivier/clearwater-live-test@sha256:77e928c23a5942aa681646be96dfb5897efe17b1e8676e8e94003ad08891b881', " "'containerID': " "'containerd://625ab4f88f6a6f407f3b9168cad0cb6eb1b59e56f6379f3dc0f62bf6c5ef956f'}], " "'qosClass': 'BestEffort'}"} 2020-08-15 02:23:55,836 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'astaire', 'retry_after_seconds': None, 'uid': '10769142-502b-4f28-b931-58790c379eaa'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-08-15 02:23:55,878 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'astaire', 'retry_after_seconds': None, 'uid': 'a6cdeaec-1833-4a47-af6c-f0d967174454'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-08-15 02:23:55,964 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'bono', 'retry_after_seconds': None, 'uid': 'afb32171-4e2c-42ef-9c4e-d4a496a308f5'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-08-15 02:23:56,017 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'bono', 'retry_after_seconds': None, 'uid': 'e78c6514-fb25-45a5-a1c1-f1e5483d3a7c'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-08-15 02:23:56,053 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'cassandra', 'retry_after_seconds': None, 'uid': '382fb138-8b87-4a76-b3d1-b5c31f2720ca'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-08-15 02:23:56,261 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'cassandra', 'retry_after_seconds': None, 'uid': '433a8318-e5d4-4353-bd18-faef872464f4'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-08-15 02:23:56,297 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'chronos', 'retry_after_seconds': None, 'uid': '653f9e3e-8bcd-470b-9fbf-c304b2f96b5e'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-08-15 02:23:56,359 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'chronos', 'retry_after_seconds': None, 'uid': '6a471db0-6127-4ff4-a53e-8ade0a290e85'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-08-15 02:23:56,387 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'ellis', 'retry_after_seconds': None, 'uid': '29b327ff-a49f-47e0-9243-d4fd4c9a18d3'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-08-15 02:23:56,428 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'ellis', 'retry_after_seconds': None, 'uid': '64e6685a-0f05-4be6-87a9-8a1e4f305753'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-08-15 02:23:56,452 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'etcd', 'retry_after_seconds': None, 'uid': 'db370c34-0b02-4623-b012-53f574082cc6'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-08-15 02:23:56,525 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'etcd', 'retry_after_seconds': None, 'uid': 'c6ffebb2-6e31-4c31-a91b-2ad84dbfc888'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-08-15 02:23:56,551 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'homer', 'retry_after_seconds': None, 'uid': 'aca31640-7763-43f1-8dc5-cbb1be599d00'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-08-15 02:23:56,800 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'homer', 'retry_after_seconds': None, 'uid': '858ddf7c-b230-4523-9d80-c2571e0c23f1'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-08-15 02:23:57,183 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'homestead', 'retry_after_seconds': None, 'uid': '4384a8ab-3852-4e40-ab06-def0f26a2d98'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-08-15 02:23:57,851 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'homestead', 'retry_after_seconds': None, 'uid': 'be497854-7c30-4029-ab79-f98eb9c43688'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-08-15 02:23:57,915 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'homestead-prov', 'retry_after_seconds': None, 'uid': '1094bf3d-81e2-463e-90ca-9f3b986ad6c6'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-08-15 02:23:58,661 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'homestead-prov', 'retry_after_seconds': None, 'uid': '3a67171b-f0f7-419a-8453-3439b9284089'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-08-15 02:23:58,806 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'ralf', 'retry_after_seconds': None, 'uid': '31b4d4ef-a03d-48d6-9f1a-e12dde662c6b'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-08-15 02:23:59,325 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'ralf', 'retry_after_seconds': None, 'uid': 'de7d4e10-73a4-4ed9-be4e-99bae7f5bb3f'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-08-15 02:23:59,655 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_deployment: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': 'apps', 'kind': 'deployments', 'name': 'sprout', 'retry_after_seconds': None, 'uid': '99ac4155-92b8-4b61-9665-2b065f69ded8'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-08-15 02:24:00,307 - functest_kubernetes.ims.ims - DEBUG - delete_namespaced_service: {'api_version': 'v1', 'code': None, 'details': {'causes': None, 'group': None, 'kind': 'services', 'name': 'sprout', 'retry_after_seconds': None, 'uid': '49832646-e81b-4c07-9a60-eb7c24b2abfb'}, 'kind': 'Status', 'message': None, 'metadata': {'_continue': None, 'resource_version': None, 'self_link': None}, 'reason': None, 'status': 'Success'} 2020-08-15 02:24:01,009 - functest_kubernetes.ims.ims - DEBUG - delete_namespace: ims-wkr7p 2020-08-15 02:24:02,213 - xtesting.core.testcase - DEBUG - Publishing /var/lib/xtesting/results/functest-kubernetes.log ('text/plain', None)