2020-10-05 11:46:55,484 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+----------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | k8-nosdn-nofeature-noha | | INSTALLER_TYPE | unknown | | BUILD_TAG | 1LHINWOBHSZO | | NODE_NAME | lf-virtual1-4 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/functest- | | | kubernetes/1LHINWOBHSZO/functest-kubernetes-pi- | | | ollivier-functest-kubernetes-security-arm-kali- | | | kube_hunter-run-27 | | HTTP_DST_URL | http://artifacts.opnfv.org/functest- | | | kubernetes/1LHINWOBHSZO/functest-kubernetes-pi- | | | ollivier-functest-kubernetes-security-arm-kali- | | | kube_hunter-run-27 | +-------------------------+----------------------------------------------------------+ 2020-10-05 11:46:55,553 - xtesting.ci.run_tests - DEBUG - No env file /var/lib/xtesting/conf/env_file found 2020-10-05 11:46:55,555 - xtesting.ci.run_tests - DEBUG - Test args: kube_hunter 2020-10-05 11:46:55,689 - xtesting.ci.run_tests - INFO - Loading test case 'kube_hunter'... 2020-10-05 11:46:58,183 - xtesting.ci.run_tests - INFO - Running test case 'kube_hunter'... 2020-10-05 11:46:58,375 - kubernetes.client.rest - DEBUG - response body: {"kind":"Namespace","apiVersion":"v1","metadata":{"name":"kube-hunter-kpc4q","generateName":"kube-hunter-","selfLink":"/api/v1/namespaces/kube-hunter-kpc4q","uid":"ba659acf-e335-4c0f-ac6d-4ebc508cb37a","resourceVersion":"3186993","creationTimestamp":"2020-10-05T11:46:58Z","managedFields":[{"manager":"OpenAPI-Generator","operation":"Update","apiVersion":"v1","time":"2020-10-05T11:46:58Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{}},"f:status":{"f:phase":{}}}}]},"spec":{"finalizers":["kubernetes"]},"status":{"phase":"Active"}} 2020-10-05 11:46:58,389 - functest_kubernetes.security.security - DEBUG - create_namespace: {'api_version': 'v1', 'kind': 'Namespace', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 10, 5, 11, 46, 58, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': 'kube-hunter-', 'generation': None, 'initializers': None, 'labels': None, 'managed_fields': [{'api_version': 'v1', 'fields': None, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': datetime.datetime(2020, 10, 5, 11, 46, 58, tzinfo=tzlocal())}], 'name': 'kube-hunter-kpc4q', 'namespace': None, 'owner_references': None, 'resource_version': '3186993', 'self_link': '/api/v1/namespaces/kube-hunter-kpc4q', 'uid': 'ba659acf-e335-4c0f-ac6d-4ebc508cb37a'}, 'spec': {'finalizers': ['kubernetes']}, 'status': {'phase': 'Active'}} 2020-10-05 11:46:58,609 - kubernetes.client.rest - DEBUG - response body: {"kind":"Job","apiVersion":"batch/v1","metadata":{"name":"kube-hunter","namespace":"kube-hunter-kpc4q","selfLink":"/apis/batch/v1/namespaces/kube-hunter-kpc4q/jobs/kube-hunter","uid":"79083788-3873-4f21-a8ad-7b04e4368412","resourceVersion":"3187002","creationTimestamp":"2020-10-05T11:46:58Z","labels":{"controller-uid":"79083788-3873-4f21-a8ad-7b04e4368412","job-name":"kube-hunter"},"managedFields":[{"manager":"OpenAPI-Generator","operation":"Update","apiVersion":"batch/v1","time":"2020-10-05T11:46:58Z","fieldsType":"FieldsV1","fieldsV1":{"f:spec":{"f:backoffLimit":{},"f:completions":{},"f:parallelism":{},"f:template":{"f:spec":{"f:containers":{"k:{\"name\":\"kube-hunter\"}":{".":{},"f:args":{},"f:command":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}}}]},"spec":{"parallelism":1,"completions":1,"backoffLimit":4,"selector":{"matchLabels":{"controller-uid":"79083788-3873-4f21-a8ad-7b04e4368412"}},"template":{"metadata":{"creationTimestamp":null,"labels":{"controller-uid":"79083788-3873-4f21-a8ad-7b04e4368412","job-name":"kube-hunter"}},"spec":{"containers":[{"name":"kube-hunter","image":"aquasec/kube-hunter:0.3.1","command":["python","kube-hunter.py"],"args":["--pod","--report","json","--statistics"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Never","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","securityContext":{},"schedulerName":"default-scheduler"}}},"status":{}} 2020-10-05 11:46:58,628 - functest_kubernetes.security.security - INFO - Job kube-hunter created 2020-10-05 11:46:58,661 - functest_kubernetes.security.security - DEBUG - create_namespaced_job: {'api_version': 'batch/v1', 'kind': 'Job', 'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': datetime.datetime(2020, 10, 5, 11, 46, 58, tzinfo=tzlocal()), 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'controller-uid': '79083788-3873-4f21-a8ad-7b04e4368412', 'job-name': 'kube-hunter'}, 'managed_fields': [{'api_version': 'batch/v1', 'fields': None, 'manager': 'OpenAPI-Generator', 'operation': 'Update', 'time': datetime.datetime(2020, 10, 5, 11, 46, 58, tzinfo=tzlocal())}], 'name': 'kube-hunter', 'namespace': 'kube-hunter-kpc4q', 'owner_references': None, 'resource_version': '3187002', 'self_link': '/apis/batch/v1/namespaces/kube-hunter-kpc4q/jobs/kube-hunter', 'uid': '79083788-3873-4f21-a8ad-7b04e4368412'}, 'spec': {'active_deadline_seconds': None, 'backoff_limit': 4, 'completions': 1, 'manual_selector': None, 'parallelism': 1, 'selector': {'match_expressions': None, 'match_labels': {'controller-uid': '79083788-3873-4f21-a8ad-7b04e4368412'}}, 'template': {'metadata': {'annotations': None, 'cluster_name': None, 'creation_timestamp': None, 'deletion_grace_period_seconds': None, 'deletion_timestamp': None, 'finalizers': None, 'generate_name': None, 'generation': None, 'initializers': None, 'labels': {'controller-uid': '79083788-3873-4f21-a8ad-7b04e4368412', 'job-name': 'kube-hunter'}, 'managed_fields': None, 'name': None, 'namespace': None, 'owner_references': None, 'resource_version': None, 'self_link': None, 'uid': None}, 'spec': {'active_deadline_seconds': None, 'affinity': None, 'automount_service_account_token': None, 'containers': [{'args': ['--pod', '--report', 'json', '--statistics'], 'command': ['python', 'kube-hunter.py'], 'env': None, 'env_from': None, 'image': 'aquasec/kube-hunter:0.3.1', 'image_pull_policy': 'IfNotPresent', 'lifecycle': None, 'liveness_probe': None, 'name': 'kube-hunter', 'ports': None, 'readiness_probe': None, 'resources': {'limits': None, 'requests': None}, 'security_context': None, 'stdin': None, 'stdin_once': None, 'termination_message_path': '/dev/termination-log', 'termination_message_policy': 'File', 'tty': None, 'volume_devices': None, 'volume_mounts': None, 'working_dir': None}], 'dns_config': None, 'dns_policy': 'ClusterFirst', 'enable_service_links': None, 'host_aliases': None, 'host_ipc': None, 'host_network': None, 'host_pid': None, 'hostname': None, 'image_pull_secrets': None, 'init_containers': None, 'node_name': None, 'node_selector': None, 'preemption_policy': None, 'priority': None, 'priority_class_name': None, 'readiness_gates': None, 'restart_policy': 'Never', 'runtime_class_name': None, 'scheduler_name': 'default-scheduler', 'security_context': {'fs_group': None, 'run_as_group': None, 'run_as_non_root': None, 'run_as_user': None, 'se_linux_options': None, 'supplemental_groups': None, 'sysctls': None, 'windows_options': None}, 'service_account': None, 'service_account_name': None, 'share_process_namespace': None, 'subdomain': None, 'termination_grace_period_seconds': 30, 'tolerations': None, 'volumes': None}}, 'ttl_seconds_after_finished': None}, 'status': {'active': None, 'completion_time': None, 'conditions': None, 'failed': None, 'start_time': None, 'succeeded': None}} 2020-10-05 11:48:35,268 - functest_kubernetes.security.security - INFO - kube-hunter started in 97.08 sec 2020-10-05 11:48:35,539 - kubernetes.client.rest - DEBUG - response body: {"kind":"PodList","apiVersion":"v1","metadata":{"selfLink":"/api/v1/namespaces/kube-hunter-kpc4q/pods","resourceVersion":"3187290"},"items":[{"metadata":{"name":"kube-hunter-j9qbw","generateName":"kube-hunter-","namespace":"kube-hunter-kpc4q","selfLink":"/api/v1/namespaces/kube-hunter-kpc4q/pods/kube-hunter-j9qbw","uid":"bcf60b30-5756-4843-8753-e1bab09ac5bb","resourceVersion":"3187288","creationTimestamp":"2020-10-05T11:46:58Z","labels":{"controller-uid":"79083788-3873-4f21-a8ad-7b04e4368412","job-name":"kube-hunter"},"ownerReferences":[{"apiVersion":"batch/v1","kind":"Job","name":"kube-hunter","uid":"79083788-3873-4f21-a8ad-7b04e4368412","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2020-10-05T11:46:58Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-uid":{},"f:job-name":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"79083788-3873-4f21-a8ad-7b04e4368412\"}":{".":{},"f:apiVersion":{},"f:blockOwnerDeletion":{},"f:controller":{},"f:kind":{},"f:name":{},"f:uid":{}}}},"f:spec":{"f:containers":{"k:{\"name\":\"kube-hunter\"}":{".":{},"f:args":{},"f:command":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}},{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2020-10-05T11:48:34Z","fieldsType":"FieldsV1","fieldsV1":{"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"10.244.1.199\"}":{".":{},"f:ip":{}}},"f:startTime":{}}}}]},"spec":{"volumes":[{"name":"default-token-kbclc","secret":{"secretName":"default-token-kbclc","defaultMode":420}}],"containers":[{"name":"kube-hunter","image":"aquasec/kube-hunter:0.3.1","command":["python","kube-hunter.py"],"args":["--pod","--report","json","--statistics"],"resources":{},"volumeMounts":[{"name":"default-token-kbclc","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Never","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"kali-worker2","securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true,"preemptionPolicy":"PreemptLowerPriority"},"status":{"phase":"Succeeded","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-05T11:46:58Z","reason":"PodCompleted"},{"type":"Ready","status":"False","lastProbeTime":null,"lastTransitionTime":"2020-10-05T11:48:34Z","reason":"PodCompleted"},{"type":"ContainersReady","status":"False","lastProbeTime":null,"lastTransitionTime":"2020-10-05T11:48:34Z","reason":"PodCompleted"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-05T11:46:58Z"}],"hostIP":"172.18.0.13","podIP":"10.244.1.199","podIPs":[{"ip":"10.244.1.199"}],"startTime":"2020-10-05T11:46:58Z","containerStatuses":[{"name":"kube-hunter","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-10-05T11:47:59Z","finishedAt":"2020-10-05T11:48:18Z","containerID":"containerd://999753f4c6a04dd7813663c1e99ec356dc96cc5da243b720d21c45bbeef6058e"}},"lastState":{},"ready":false,"restartCount":0,"image":"docker.io/aquasec/kube-hunter:0.3.1","imageID":"docker.io/aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781","containerID":"containerd://999753f4c6a04dd7813663c1e99ec356dc96cc5da243b720d21c45bbeef6058e","started":false}],"qosClass":"BestEffort"}}]} 2020-10-05 11:48:35,611 - kubernetes.client.rest - DEBUG - response body: 2020-10-05 11:48:05,563 INFO kube_hunter.modules.report.collector Started hunting 2020-10-05 11:48:05,563 INFO kube_hunter.modules.report.collector Discovering Open Kubernetes Services 2020-10-05 11:48:05,571 INFO kube_hunter.modules.report.collector Found vulnerability "Read access to pod's service account token" in Local to Pod (kube-hunter-j9qbw) 2020-10-05 11:48:05,572 INFO kube_hunter.modules.report.collector Found vulnerability "CAP_NET_RAW Enabled" in Local to Pod (kube-hunter-j9qbw) 2020-10-05 11:48:05,573 INFO kube_hunter.modules.report.collector Found vulnerability "Access to pod's secrets" in Local to Pod (kube-hunter-j9qbw) 2020-10-05 11:48:06,009 INFO kube_hunter.modules.report.collector Found open service "API Server" at 10.96.0.1:443 2020-10-05 11:48:06,083 INFO kube_hunter.modules.report.collector Found vulnerability "Access to API using service account token" in 10.96.0.1:443 2020-10-05 11:48:06,089 INFO kube_hunter.modules.report.collector Found vulnerability "K8s Version Disclosure" in 10.96.0.1:443 2020-10-05 11:48:06,118 INFO kube_hunter.modules.report.collector Found open service "Kubelet API" at 10.244.1.1:10250 {"nodes": [{"type": "Node/Master", "location": "10.96.0.1"}, {"type": "Node/Master", "location": "10.244.1.1"}], "services": [{"service": "API Server", "location": "10.96.0.1:443"}, {"service": "Kubelet API", "location": "10.244.1.1:10250"}], "vulnerabilities": [{"location": "Local to Pod (kube-hunter-j9qbw)", "vid": "KHV050", "category": "Access Risk", "severity": "low", "vulnerability": "Read access to pod's service account token", "description": " Accessing the pod service account token gives an attacker the option to use the server API ", "evidence": "eyJhbGciOiJSUzI1NiIsImtpZCI6IlpONFdnam96M18xM05UN05lb2VaV29sWUZORl9pLUpva3RIR21qd0FySmsifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJrdWJlLWh1bnRlci1rcGM0cSIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJkZWZhdWx0LXRva2VuLWtiY2xjIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQubmFtZSI6ImRlZmF1bHQiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC51aWQiOiIwMWJhZTE1Ny05MzY5LTQzMzEtOWJjYS0wZDZlYzg5NWU5NjkiLCJzdWIiOiJzeXN0ZW06c2VydmljZWFjY291bnQ6a3ViZS1odW50ZXIta3BjNHE6ZGVmYXVsdCJ9.Tvl2AoYuW1h5Bgvkp2b6OQqXs-1NWLXBI-TEWwCto0F74WBgT_9NiywvEp7Rf2moVyiBdMLn5izsRTQF_nOL9mUeTCB_MXFhOIGLIJOt5ZJS0M_yyu_XJqJl21hw3hKvELfH2mOdcpZP6Re1NrG1UKEAPrqOd8JEeTWlNqe8HuYVjEuypUR_655ner9uwq8XRn-Svq1oBxBXQa-BRCcPa3fYAfbR2bmzY0KPcixnbafxGZ4i77L1qR0pkXvln6SYAhSvL7My0WSBxQThV8wVmN7KrMV71VvVHqUsLc_vAy-x5HlGAYwoKlVmS0mx1DuJqUTOAlsNbAcxDyXqI4tMQw", "hunter": "Access Secrets"}, {"location": "Local to Pod (kube-hunter-j9qbw)", "vid": "None", "category": "Access Risk", "severity": "low", "vulnerability": "CAP_NET_RAW Enabled", "description": "CAP_NET_RAW is enabled by default for pods.\n If an attacker manages to compromise a pod,\n they could potentially take advantage of this capability to perform network\n attacks on other pods running on the same node", "evidence": "", "hunter": "Pod Capabilities Hunter"}, {"location": "Local to Pod (kube-hunter-j9qbw)", "vid": "None", "category": "Access Risk", "severity": "low", "vulnerability": "Access to pod's secrets", "description": " Accessing the pod's secrets within a compromised pod might disclose valuable data to a potential attacker", "evidence": "['/var/run/secrets/kubernetes.io/serviceaccount/ca.crt', '/var/run/secrets/kubernetes.io/serviceaccount/token', '/var/run/secrets/kubernetes.io/serviceaccount/namespace', '/var/run/secrets/kubernetes.io/serviceaccount/..2020_10_05_11_46_59.783178622/token', '/var/run/secrets/kubernetes.io/serviceaccount/..2020_10_05_11_46_59.783178622/namespace', '/var/run/secrets/kubernetes.io/serviceaccount/..2020_10_05_11_46_59.783178622/ca.crt']", "hunter": "Access Secrets"}, {"location": "10.96.0.1:443", "vid": "KHV005", "category": "Information Disclosure", "severity": "medium", "vulnerability": "Access to API using service account token", "description": "The API Server port is accessible.\n Depending on your RBAC settings this could expose access to or control of your cluster.", "evidence": "b'{\"kind\":\"APIVersions\",\"versions\":[\"v1\"],\"serverAddressByClientCIDRs\":[{\"clientCIDR\":\"0.0.0.0/0\",\"serverAddress\":\"172.18.0.11:6443\"}]}\\n'", "hunter": "API Server Hunter"}, {"location": "10.96.0.1:443", "vid": "KHV002", "category": "Information Disclosure", "severity": "medium", "vulnerability": "K8s Version Disclosure", "description": "The kubernetes version could be obtained from the /version endpoint ", "evidence": "v1.19.0", "hunter": "Api Version Hunter"}], "hunter_statistics": [{"name": "Kubelet Readonly Ports Hunter", "description": "Hunts specific endpoints on open ports in the readonly Kubelet server", "vulnerabilities": 0}, {"name": "Kubelet Secure Ports Hunter", "description": "Hunts specific endpoints on an open secured Kubelet", "vulnerabilities": 0}, {"name": "AKS Hunting", "description": "Hunting Azure cluster deployments using specific known configurations", "vulnerabilities": 0}, {"name": "API Server Hunter", "description": "Checks if API server is accessible", "vulnerabilities": 0}, {"name": "API Server Hunter", "description": "Accessing the API server using the service account token obtained from a compromised pod", "vulnerabilities": 1}, {"name": "Api Version Hunter", "description": "Tries to obtain the Api Server's version directly from /version endpoint", "vulnerabilities": 2}, {"name": "Pod Capabilities Hunter", "description": "Checks for default enabled capabilities in a pod", "vulnerabilities": 1}, {"name": "Certificate Email Hunting", "description": "Checks for email addresses in kubernetes ssl certificates", "vulnerabilities": 0}, {"name": "K8s CVE Hunter", "description": "Checks if Node is running a Kubernetes version vulnerable to specific important CVEs", "vulnerabilities": 0}, {"name": "Kubectl CVE Hunter", "description": "Checks if the kubectl client is vulnerable to specific important CVEs", "vulnerabilities": 0}, {"name": "Dashboard Hunting", "description": "Hunts open Dashboards, gets the type of nodes in the cluster", "vulnerabilities": 0}, {"name": "Etcd Remote Access", "description": "Checks for remote availability of etcd, its version, and read access to the DB", "vulnerabilities": 0}, {"name": "Mount Hunter - /var/log", "description": "Hunt pods that have write access to host's /var/log. in such case, the pod can traverse read files on the host machine", "vulnerabilities": 0}, {"name": "Proxy Hunting", "description": "Hunts for a dashboard behind the proxy", "vulnerabilities": 0}, {"name": "Access Secrets", "description": "Accessing the secrets accessible to the pod", "vulnerabilities": 2}], "kburl": "https://aquasecurity.github.io/kube-hunter/kb/{vid}"} 2020-10-05 11:48:35,613 - functest_kubernetes.security.security - INFO - 2020-10-05 11:48:05,563 INFO kube_hunter.modules.report.collector Started hunting 2020-10-05 11:48:05,563 INFO kube_hunter.modules.report.collector Discovering Open Kubernetes Services 2020-10-05 11:48:05,571 INFO kube_hunter.modules.report.collector Found vulnerability "Read access to pod's service account token" in Local to Pod (kube-hunter-j9qbw) 2020-10-05 11:48:05,572 INFO kube_hunter.modules.report.collector Found vulnerability "CAP_NET_RAW Enabled" in Local to Pod (kube-hunter-j9qbw) 2020-10-05 11:48:05,573 INFO kube_hunter.modules.report.collector Found vulnerability "Access to pod's secrets" in Local to Pod (kube-hunter-j9qbw) 2020-10-05 11:48:06,009 INFO kube_hunter.modules.report.collector Found open service "API Server" at 10.96.0.1:443 2020-10-05 11:48:06,083 INFO kube_hunter.modules.report.collector Found vulnerability "Access to API using service account token" in 10.96.0.1:443 2020-10-05 11:48:06,089 INFO kube_hunter.modules.report.collector Found vulnerability "K8s Version Disclosure" in 10.96.0.1:443 2020-10-05 11:48:06,118 INFO kube_hunter.modules.report.collector Found open service "Kubelet API" at 10.244.1.1:10250 {"nodes": [{"type": "Node/Master", "location": "10.96.0.1"}, {"type": "Node/Master", "location": "10.244.1.1"}], "services": [{"service": "API Server", "location": "10.96.0.1:443"}, {"service": "Kubelet API", "location": "10.244.1.1:10250"}], "vulnerabilities": [{"location": "Local to Pod (kube-hunter-j9qbw)", "vid": "KHV050", "category": "Access Risk", "severity": "low", "vulnerability": "Read access to pod's service account token", "description": " Accessing the pod service account token gives an attacker the option to use the server API ", "evidence": "eyJhbGciOiJSUzI1NiIsImtpZCI6IlpONFdnam96M18xM05UN05lb2VaV29sWUZORl9pLUpva3RIR21qd0FySmsifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJrdWJlLWh1bnRlci1rcGM0cSIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJkZWZhdWx0LXRva2VuLWtiY2xjIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQubmFtZSI6ImRlZmF1bHQiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC51aWQiOiIwMWJhZTE1Ny05MzY5LTQzMzEtOWJjYS0wZDZlYzg5NWU5NjkiLCJzdWIiOiJzeXN0ZW06c2VydmljZWFjY291bnQ6a3ViZS1odW50ZXIta3BjNHE6ZGVmYXVsdCJ9.Tvl2AoYuW1h5Bgvkp2b6OQqXs-1NWLXBI-TEWwCto0F74WBgT_9NiywvEp7Rf2moVyiBdMLn5izsRTQF_nOL9mUeTCB_MXFhOIGLIJOt5ZJS0M_yyu_XJqJl21hw3hKvELfH2mOdcpZP6Re1NrG1UKEAPrqOd8JEeTWlNqe8HuYVjEuypUR_655ner9uwq8XRn-Svq1oBxBXQa-BRCcPa3fYAfbR2bmzY0KPcixnbafxGZ4i77L1qR0pkXvln6SYAhSvL7My0WSBxQThV8wVmN7KrMV71VvVHqUsLc_vAy-x5HlGAYwoKlVmS0mx1DuJqUTOAlsNbAcxDyXqI4tMQw", "hunter": "Access Secrets"}, {"location": "Local to Pod (kube-hunter-j9qbw)", "vid": "None", "category": "Access Risk", "severity": "low", "vulnerability": "CAP_NET_RAW Enabled", "description": "CAP_NET_RAW is enabled by default for pods.\n If an attacker manages to compromise a pod,\n they could potentially take advantage of this capability to perform network\n attacks on other pods running on the same node", "evidence": "", "hunter": "Pod Capabilities Hunter"}, {"location": "Local to Pod (kube-hunter-j9qbw)", "vid": "None", "category": "Access Risk", "severity": "low", "vulnerability": "Access to pod's secrets", "description": " Accessing the pod's secrets within a compromised pod might disclose valuable data to a potential attacker", "evidence": "['/var/run/secrets/kubernetes.io/serviceaccount/ca.crt', '/var/run/secrets/kubernetes.io/serviceaccount/token', '/var/run/secrets/kubernetes.io/serviceaccount/namespace', '/var/run/secrets/kubernetes.io/serviceaccount/..2020_10_05_11_46_59.783178622/token', '/var/run/secrets/kubernetes.io/serviceaccount/..2020_10_05_11_46_59.783178622/namespace', '/var/run/secrets/kubernetes.io/serviceaccount/..2020_10_05_11_46_59.783178622/ca.crt']", "hunter": "Access Secrets"}, {"location": "10.96.0.1:443", "vid": "KHV005", "category": "Information Disclosure", "severity": "medium", "vulnerability": "Access to API using service account token", "description": "The API Server port is accessible.\n Depending on your RBAC settings this could expose access to or control of your cluster.", "evidence": "b'{\"kind\":\"APIVersions\",\"versions\":[\"v1\"],\"serverAddressByClientCIDRs\":[{\"clientCIDR\":\"0.0.0.0/0\",\"serverAddress\":\"172.18.0.11:6443\"}]}\\n'", "hunter": "API Server Hunter"}, {"location": "10.96.0.1:443", "vid": "KHV002", "category": "Information Disclosure", "severity": "medium", "vulnerability": "K8s Version Disclosure", "description": "The kubernetes version could be obtained from the /version endpoint ", "evidence": "v1.19.0", "hunter": "Api Version Hunter"}], "hunter_statistics": [{"name": "Kubelet Readonly Ports Hunter", "description": "Hunts specific endpoints on open ports in the readonly Kubelet server", "vulnerabilities": 0}, {"name": "Kubelet Secure Ports Hunter", "description": "Hunts specific endpoints on an open secured Kubelet", "vulnerabilities": 0}, {"name": "AKS Hunting", "description": "Hunting Azure cluster deployments using specific known configurations", "vulnerabilities": 0}, {"name": "API Server Hunter", "description": "Checks if API server is accessible", "vulnerabilities": 0}, {"name": "API Server Hunter", "description": "Accessing the API server using the service account token obtained from a compromised pod", "vulnerabilities": 1}, {"name": "Api Version Hunter", "description": "Tries to obtain the Api Server's version directly from /version endpoint", "vulnerabilities": 2}, {"name": "Pod Capabilities Hunter", "description": "Checks for default enabled capabilities in a pod", "vulnerabilities": 1}, {"name": "Certificate Email Hunting", "description": "Checks for email addresses in kubernetes ssl certificates", "vulnerabilities": 0}, {"name": "K8s CVE Hunter", "description": "Checks if Node is running a Kubernetes version vulnerable to specific important CVEs", "vulnerabilities": 0}, {"name": "Kubectl CVE Hunter", "description": "Checks if the kubectl client is vulnerable to specific important CVEs", "vulnerabilities": 0}, {"name": "Dashboard Hunting", "description": "Hunts open Dashboards, gets the type of nodes in the cluster", "vulnerabilities": 0}, {"name": "Etcd Remote Access", "description": "Checks for remote availability of etcd, its version, and read access to the DB", "vulnerabilities": 0}, {"name": "Mount Hunter - /var/log", "description": "Hunt pods that have write access to host's /var/log. in such case, the pod can traverse read files on the host machine", "vulnerabilities": 0}, {"name": "Proxy Hunting", "description": "Hunts for a dashboard behind the proxy", "vulnerabilities": 0}, {"name": "Access Secrets", "description": "Accessing the secrets accessible to the pod", "vulnerabilities": 2}], "kburl": "https://aquasecurity.github.io/kube-hunter/kb/{vid}"} 2020-10-05 11:48:35,616 - functest_kubernetes.security.security - WARNING - Skipping Read access to pod's service account token (severity is configured as high) 2020-10-05 11:48:35,618 - functest_kubernetes.security.security - WARNING - Skipping CAP_NET_RAW Enabled (severity is configured as high) 2020-10-05 11:48:35,620 - functest_kubernetes.security.security - WARNING - Skipping Access to pod's secrets (severity is configured as high) 2020-10-05 11:48:35,621 - functest_kubernetes.security.security - WARNING - Skipping Access to API using service account token (severity is configured as high) 2020-10-05 11:48:35,623 - functest_kubernetes.security.security - WARNING - Skipping K8s Version Disclosure (severity is configured as high) 2020-10-05 11:48:35,636 - functest_kubernetes.security.security - WARNING - +--------------------------------+----------------------------------------------------+------------------+ | CATEGORY | VULNERABILITY | SEVERITY | +--------------------------------+----------------------------------------------------+------------------+ | Access Risk | Read access to pod's service account token | low | | Access Risk | CAP_NET_RAW Enabled | low | | Access Risk | Access to pod's secrets | low | | Information Disclosure | Access to API using service account token | medium | | Information Disclosure | K8s Version Disclosure | medium | +--------------------------------+----------------------------------------------------+------------------+ 2020-10-05 11:48:35,700 - functest_kubernetes.security.security - INFO - +---------------------------------------+------------------------------------------------------------+-------------------------+ | NAME | DESCRIPTION | VULNERABILITIES | +---------------------------------------+------------------------------------------------------------+-------------------------+ | Kubelet Readonly Ports Hunter | Hunts specific endpoints on open ports in the | 0 | | | readonly Kubelet server | | | Kubelet Secure Ports Hunter | Hunts specific endpoints on an open secured | 0 | | | Kubelet | | | AKS Hunting | Hunting Azure cluster deployments using specific | 0 | | | known configurations | | | API Server Hunter | Checks if API server is accessible | 0 | | API Server Hunter | Accessing the API server using the service account | 1 | | | token obtained from a compromised pod | | | Api Version Hunter | Tries to obtain the Api Server's version directly | 2 | | | from /version endpoint | | | Pod Capabilities Hunter | Checks for default enabled capabilities in a pod | 1 | | Certificate Email Hunting | Checks for email addresses in kubernetes ssl | 0 | | | certificates | | | K8s CVE Hunter | Checks if Node is running a Kubernetes version | 0 | | | vulnerable to specific important CVEs | | | Kubectl CVE Hunter | Checks if the kubectl client is vulnerable to | 0 | | | specific important CVEs | | | Dashboard Hunting | Hunts open Dashboards, gets the type of nodes in | 0 | | | the cluster | | | Etcd Remote Access | Checks for remote availability of etcd, its | 0 | | | version, and read access to the DB | | | Mount Hunter - /var/log | Hunt pods that have write access to host's | 0 | | | /var/log. in such case, the pod can traverse read | | | | files on the host machine | | | Proxy Hunting | Hunts for a dashboard behind the proxy | 0 | | Access Secrets | Accessing the secrets accessible to the pod | 2 | +---------------------------------------+------------------------------------------------------------+-------------------------+ 2020-10-05 11:48:35,702 - xtesting.ci.run_tests - INFO - Test result: +---------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +---------------------+------------------+------------------+----------------+ | kube_hunter | functest | 01:37 | PASS | +---------------------+------------------+------------------+----------------+ 2020-10-05 11:48:35,762 - kubernetes.client.rest - DEBUG - response body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-hunter-j9qbw","generateName":"kube-hunter-","namespace":"kube-hunter-kpc4q","selfLink":"/api/v1/namespaces/kube-hunter-kpc4q/pods/kube-hunter-j9qbw","uid":"bcf60b30-5756-4843-8753-e1bab09ac5bb","resourceVersion":"3187293","creationTimestamp":"2020-10-05T11:46:58Z","deletionTimestamp":"2020-10-05T11:48:35Z","deletionGracePeriodSeconds":0,"labels":{"controller-uid":"79083788-3873-4f21-a8ad-7b04e4368412","job-name":"kube-hunter"},"ownerReferences":[{"apiVersion":"batch/v1","kind":"Job","name":"kube-hunter","uid":"79083788-3873-4f21-a8ad-7b04e4368412","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2020-10-05T11:46:58Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-uid":{},"f:job-name":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"79083788-3873-4f21-a8ad-7b04e4368412\"}":{".":{},"f:apiVersion":{},"f:blockOwnerDeletion":{},"f:controller":{},"f:kind":{},"f:name":{},"f:uid":{}}}},"f:spec":{"f:containers":{"k:{\"name\":\"kube-hunter\"}":{".":{},"f:args":{},"f:command":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}},{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2020-10-05T11:48:34Z","fieldsType":"FieldsV1","fieldsV1":{"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"10.244.1.199\"}":{".":{},"f:ip":{}}},"f:startTime":{}}}}]},"spec":{"volumes":[{"name":"default-token-kbclc","secret":{"secretName":"default-token-kbclc","defaultMode":420}}],"containers":[{"name":"kube-hunter","image":"aquasec/kube-hunter:0.3.1","command":["python","kube-hunter.py"],"args":["--pod","--report","json","--statistics"],"resources":{},"volumeMounts":[{"name":"default-token-kbclc","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Never","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"kali-worker2","securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true,"preemptionPolicy":"PreemptLowerPriority"},"status":{"phase":"Succeeded","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-05T11:46:58Z","reason":"PodCompleted"},{"type":"Ready","status":"False","lastProbeTime":null,"lastTransitionTime":"2020-10-05T11:48:34Z","reason":"PodCompleted"},{"type":"ContainersReady","status":"False","lastProbeTime":null,"lastTransitionTime":"2020-10-05T11:48:34Z","reason":"PodCompleted"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-05T11:46:58Z"}],"hostIP":"172.18.0.13","podIP":"10.244.1.199","podIPs":[{"ip":"10.244.1.199"}],"startTime":"2020-10-05T11:46:58Z","containerStatuses":[{"name":"kube-hunter","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-10-05T11:47:59Z","finishedAt":"2020-10-05T11:48:18Z","containerID":"containerd://999753f4c6a04dd7813663c1e99ec356dc96cc5da243b720d21c45bbeef6058e"}},"lastState":{},"ready":false,"restartCount":0,"image":"docker.io/aquasec/kube-hunter:0.3.1","imageID":"docker.io/aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781","containerID":"containerd://999753f4c6a04dd7813663c1e99ec356dc96cc5da243b720d21c45bbeef6058e","started":false}],"qosClass":"BestEffort"}} 2020-10-05 11:48:35,766 - functest_kubernetes.security.security - DEBUG - delete_namespaced_pod: {'api_version': 'v1', 'code': None, 'details': None, 'kind': 'Pod', 'message': None, 'metadata': {'_continue': None, 'remaining_item_count': None, 'resource_version': '3187293', 'self_link': '/api/v1/namespaces/kube-hunter-kpc4q/pods/kube-hunter-j9qbw'}, 'reason': None, 'status': "{'phase': 'Succeeded', 'conditions': [{'type': 'Initialized', " "'status': 'True', 'lastProbeTime': None, 'lastTransitionTime': " "'2020-10-05T11:46:58Z', 'reason': 'PodCompleted'}, {'type': " "'Ready', 'status': 'False', 'lastProbeTime': None, " "'lastTransitionTime': '2020-10-05T11:48:34Z', 'reason': " "'PodCompleted'}, {'type': 'ContainersReady', 'status': 'False', " "'lastProbeTime': None, 'lastTransitionTime': " "'2020-10-05T11:48:34Z', 'reason': 'PodCompleted'}, {'type': " "'PodScheduled', 'status': 'True', 'lastProbeTime': None, " "'lastTransitionTime': '2020-10-05T11:46:58Z'}], 'hostIP': " "'172.18.0.13', 'podIP': '10.244.1.199', 'podIPs': [{'ip': " "'10.244.1.199'}], 'startTime': '2020-10-05T11:46:58Z', " "'containerStatuses': [{'name': 'kube-hunter', 'state': " "{'terminated': {'exitCode': 0, 'reason': 'Completed', 'startedAt': " "'2020-10-05T11:47:59Z', 'finishedAt': '2020-10-05T11:48:18Z', " "'containerID': " "'containerd://999753f4c6a04dd7813663c1e99ec356dc96cc5da243b720d21c45bbeef6058e'}}, " "'lastState': {}, 'ready': False, 'restartCount': 0, 'image': " "'docker.io/aquasec/kube-hunter:0.3.1', 'imageID': " "'docker.io/aquasec/kube-hunter@sha256:2be6820bc1d7e0f57193a9a27d5a3e16b2fd93c53747b03ce8ca48c6fc323781', " "'containerID': " "'containerd://999753f4c6a04dd7813663c1e99ec356dc96cc5da243b720d21c45bbeef6058e', " "'started': False}], 'qosClass': 'BestEffort'}"} 2020-10-05 11:48:35,841 - kubernetes.client.rest - DEBUG - response body: {"kind":"Job","apiVersion":"batch/v1","metadata":{"name":"kube-hunter","namespace":"kube-hunter-kpc4q","selfLink":"/apis/batch/v1/namespaces/kube-hunter-kpc4q/jobs/kube-hunter","uid":"79083788-3873-4f21-a8ad-7b04e4368412","resourceVersion":"3187295","creationTimestamp":"2020-10-05T11:46:58Z","deletionTimestamp":"2020-10-05T11:48:35Z","deletionGracePeriodSeconds":0,"labels":{"controller-uid":"79083788-3873-4f21-a8ad-7b04e4368412","job-name":"kube-hunter"},"finalizers":["orphan"],"managedFields":[{"manager":"OpenAPI-Generator","operation":"Update","apiVersion":"batch/v1","time":"2020-10-05T11:46:58Z","fieldsType":"FieldsV1","fieldsV1":{"f:spec":{"f:backoffLimit":{},"f:completions":{},"f:parallelism":{},"f:template":{"f:spec":{"f:containers":{"k:{\"name\":\"kube-hunter\"}":{".":{},"f:args":{},"f:command":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}}},{"manager":"kube-controller-manager","operation":"Update","apiVersion":"batch/v1","time":"2020-10-05T11:48:34Z","fieldsType":"FieldsV1","fieldsV1":{"f:status":{"f:completionTime":{},"f:conditions":{".":{},"k:{\"type\":\"Complete\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}}},"f:startTime":{},"f:succeeded":{}}}}]},"spec":{"parallelism":1,"completions":1,"backoffLimit":4,"selector":{"matchLabels":{"controller-uid":"79083788-3873-4f21-a8ad-7b04e4368412"}},"template":{"metadata":{"creationTimestamp":null,"labels":{"controller-uid":"79083788-3873-4f21-a8ad-7b04e4368412","job-name":"kube-hunter"}},"spec":{"containers":[{"name":"kube-hunter","image":"aquasec/kube-hunter:0.3.1","command":["python","kube-hunter.py"],"args":["--pod","--report","json","--statistics"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Never","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","securityContext":{},"schedulerName":"default-scheduler"}}},"status":{"conditions":[{"type":"Complete","status":"True","lastProbeTime":"2020-10-05T11:48:34Z","lastTransitionTime":"2020-10-05T11:48:34Z"}],"startTime":"2020-10-05T11:46:58Z","completionTime":"2020-10-05T11:48:34Z","succeeded":1}} 2020-10-05 11:48:35,844 - functest_kubernetes.security.security - DEBUG - delete_namespaced_deployment: {'api_version': 'batch/v1', 'code': None, 'details': None, 'kind': 'Job', 'message': None, 'metadata': {'_continue': None, 'remaining_item_count': None, 'resource_version': '3187295', 'self_link': '/apis/batch/v1/namespaces/kube-hunter-kpc4q/jobs/kube-hunter'}, 'reason': None, 'status': "{'conditions': [{'type': 'Complete', 'status': 'True', " "'lastProbeTime': '2020-10-05T11:48:34Z', 'lastTransitionTime': " "'2020-10-05T11:48:34Z'}], 'startTime': '2020-10-05T11:46:58Z', " "'completionTime': '2020-10-05T11:48:34Z', 'succeeded': 1}"} 2020-10-05 11:48:35,891 - kubernetes.client.rest - DEBUG - response body: {"kind":"Namespace","apiVersion":"v1","metadata":{"name":"kube-hunter-kpc4q","generateName":"kube-hunter-","selfLink":"/api/v1/namespaces/kube-hunter-kpc4q","uid":"ba659acf-e335-4c0f-ac6d-4ebc508cb37a","resourceVersion":"3187296","creationTimestamp":"2020-10-05T11:46:58Z","deletionTimestamp":"2020-10-05T11:48:35Z","managedFields":[{"manager":"OpenAPI-Generator","operation":"Update","apiVersion":"v1","time":"2020-10-05T11:46:58Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{}},"f:status":{"f:phase":{}}}}]},"spec":{"finalizers":["kubernetes"]},"status":{"phase":"Terminating"}} 2020-10-05 11:48:35,894 - functest_kubernetes.security.security - DEBUG - delete_namespace: kube-hunter-kpc4q 2020-10-05 11:48:37,104 - xtesting.core.testcase - DEBUG - Publishing /var/lib/xtesting/results/functest-kubernetes.log ('text/plain', None) 2020-10-05 11:48:37,496 - xtesting.core.testcase - DEBUG - Publishing /var/lib/xtesting/results/functest-kubernetes.debug.log ('text/plain', None)